Object Recognition Setting the Stage For Mixed-Reality Advertising

Posted on: 06/07/17

If you’ve kept up with social media news and updates over the first half of 2017, you’ve read the words “object recognition” about as often as you’ve read “Facebook copies Snapchat.”

Pinterest’s Lens was among the first public-facing applications introduced around object recognition, one of their many moves aimed at integrating into the real world. Over recent months, Facebook, Instagram, Snapchat, and Google, even Amazon, have followed suit in leveraging the technology to improve their respective products.

Additionally, major strides have been taken in targeting content based on location and community. Snapchat has long featured event-, location-, and community-sourced stories, and the platform recently announced geolocated ad targeting for brick and mortar stores to increase foot traffic and sales. Instagram, never too far behind, recently announced its own geolocated stories and will now introduce ad targeting based on physical location.

With every major platform making moves around these elements, it’s time for marketers to dive into how object recognition will transform their roles.

Let’s do a quick run through of platforms and advances made around object recognition.


But what does this mean for marketing, and why does it matter to my brand?

In its infancy, object recognition eliminates major obstacles on the path from product discovery to purchase. Object recognition also offers targeting options similar to, but better, than keyword-based tactics. Keyword targeting reaches consumers directly talking about or searching for a particular product. In addition to returning these exact matches, brands can leverage object recognition to place ads and promotions next to related content.

Example: If you run a furniture store, you can place target potential customers who are searching for sofas or chairs, and display ads for complementary products like throw pillows, coffee tables, and along-side feature products to influence purchase behaviors and cart sizes.

On top of that, geotargeted ads have proven effective, with several stores seeing success in increasing foot traffic for retail venues.

Okay, sure. But this has been widely reported already. Where are you going with this?

Social media is moving towards a world void of billboards. There are no ads plastered on the park bench. Today’s assault of physical advertisements is long gone. Well, at least when you’re not wearing your sunglasses.

Okay, we probably won’t be completely free from physical ads, but that’s where we’re headed, and that’s what these object-recognizing, geotargeting features are foreshadowing. That’s why Snapchat just acquired Placed, an advertising data service that specializes in location analytics.

Combine image and object recognition with geotargeting and what is the result? Hey there, mixed reality. We’ve been expecting you. Mixed-reality advertising is in sight. It’s coming fast, and marketers need to be ready.

Let’s take a minute and brainstorm some opportunities and marketing applications.

  1. An animated coffee cup hovering over every Starbucks, Dunkin Donuts, and Caribou Coffee, offering one, two or even three dollars off specialty drinks.
  2. Music festivals making it easy to find your performer of choice by adding a virtual blimp over each stage with the featured artist’s name plastered on the sides.
  3. Attending sporting events and seeing statistics alongside individual players, along with concession stand offerings and WWE-style mascot battles by wandering and looking around the stadium.
  4. Highways that give detailed information about upcoming exits and towns, rather than simply showing the closest Pilot or McDonalds. (Yes, I know you shouldn’t read and drive, but self-driving cars will be here soon enough.)
  5. What if you went to a museum and were joined by a personal tour guide. However, instead of it being a retired librarian, it’s a cute, talking dog that knows anything and everything about every exhibit, where the bathrooms are, and can point you to the best local taco joint for after the tour. (Side note: If you combine the power of a chat bot with an animated puppy, you can count me in for just about anything.)


Man, the future sounds pretty cool. If you really want to get brainstorming, think about all the potential applications when the entire world is mapped out in 3D.

With AR marketing on the horizon, these foundational features are going to be key in setting brands apart. Early adopters of today’s features, those who regularly practice connecting with audiences and targeting individuals based on object recognition and location, will be well-positioned to be early adopters of AR advertisements. Those who target based on ice cream cones and retail stores will succeed when these features are applicable to physical landmarks and larger infrastructures.

While campaign practice and ad-placement strategy will be atop the priority list, social care will continue to rise in importance.

Knowing your fans and consumers is going to be even more important in developing these advertising strategies. It won’t be enough to simply know a few key interests shared by the target consumer. Marketers will need to know which roads they drive on, what parts of the city they inhabit, and at which restaurants they like to eat.

It could even get so granular that a consumer will be shown an ad for a zoo in Dallas because they follow the Rangers on Twitter, snapped a selfie using the Five Guys filter, and like the Central Park Zoo on Facebook.

Further, brands will need a robust social care strategy to ensure that any potential crisis has a clear, well-marked path to diffuse any frustrations or issues a consumer may find. This is common practice in social media today. However, in a world where ads will be served based on real-time actions rather than predetermined “interests”, the range of potential issues skyrockets, and brands will need to be instantaneously agile as consumers’ acceptable response time continues to fall.

No, I can’t imagine a brand getting so specific that it panders to Rangers-rooting, burger-eating, zoo-goers, but there may be a Dallas-based, animal-rights group out there that is selling vegan meats to raise money. In which case, if you’re reading this, don’t @ me for outing your ad strategy.

Recent Posts

7 Ways to Show Your Followers a Little Love

By Joe Bozic All You Need is Love Can you feel it? There! That warm feeling coming from your computer. No, that’s not just the heat from your MacBook trying to handle the 34 tabs […]

3 Tips to Generate Deeper Engagement and Beat the Facebook Algorithm

Recent announcements surrounding Facebook’s latest News Feed algorithm have left marketers and publishers asking the same question. Facebook wants us to focus on generating meaningful engagement, but how do we go about doing that? Within […]

TSL’s Top-11 Made-for-Social Experiences in Minneapolis during Super Bowl Week

In today’s world, there are few better ways to show off how great of a time you’re having than through social media posts. People are constantly showing off what they’re doing, what they’re eating, where […]

What Brands Can Learn About Live Content From HQ Trivia

By Ben Nesvig For years, people have touted live content as the next big thing. First, Justin.TV paved the way with 24-hour streaming. Before long, seemingly every app in the world introduced live-streaming capabilities. But even […]

Get Social Media Insights

Get Social Media Insights

Subscribe to The Social Lights' blog to stay up-to-date on social media.

You have Successfully Subscribed!