AI

To own an AR future, Niantic wants to build a smarter map of the world

Comment

Image Credits: Nigel Sussman (opens in a new window)

Niantic is continuing to bet heavily on the idea that it knows where consumer computing is headed, namely toward augmented reality.

The game development startup behind Pokémon GO has some good company with companies like Apple, Facebook and Snap making similar bets, but stakes are high for the studio that hopes it can build an early advantage in foundational AR infrastructure and bring third-party developers onboard, edging out efforts from companies that are quite a bit larger.

Niantic’s experiments are still being bankrolled by their 2016 first-party hit Pokémon GO, which SensorTower estimates is having its best year ever in 2020. A report from the firm suggests that the title has pulled in more than $1 billion in revenue since the start of the year, a marked increase since 2019 that might be surprising, given the social effects of a pandemic. Those revenues have allowed Niantic to be one of the more active acquirers in the AR infrastructure space, buying up small buzzy AR startups like Escher Reality, Matrix Mill and, most recently, 6D.ai.

That latest purchase in particular has acted as a signal for what the company’s next plans are for its augmented reality platform. 6D.ai was building cloud AR mapping software, with companies like Airbnb among its early customers. The tech allowed users to quickly gather 3D information of a space just by holding up their phone to the world. Since the acquisition, Niantic has been integrating the tech into their developer platform and has been aiming to juice the technology with their own advances in semantic understanding so they can not only quickly gather what the geometry of a space looks like, but also peer into the context of what the objects are that make up that 3D mesh.

“We ultimately have this vision that for an AR experience, everything has to come together for it to be really magical,” Joel Hesch, Niantic’s senior director of Engineering, told TechCrunch. “You want precise location information so that you can see content in the right location and experience things together with others who are in the same location. You want the geometric information for things like occlusion or physics interactions. And you want to know about what things mean from a semantic perspective so that your characters can interact with the world in an intelligible way.”

Niantic squares up against Apple and Facebook with acquisition of AR startup 6D.ai

While they’ve been building out the tech, they’ve also been pushing users to try it out. Niantic has been urging Pokémon GO players to actively capture videos of certain landmarks and destinations, visual data from which is fed back into bulking up models and improving experiences for subsequent users. As users gain access to more advanced tech like the lidar sensor inside the new iPhone 12 Pro, it’s likely that Niantic will gain access to more quality data themselves.

Niantic to begin collecting 3D visual data from Pokémon GO players

The ultimate goal of this data collection, the startup says, is to build an ever-updating 3D map of the world. Their latest tech allows them to peer into this map and distinguish what types of objects and scenes are in these scans, distinguishing buildings from water from the sky. The real question is how useful all of this data will actually prove to be in practice, compared to more high-level geographic insights like the Google Maps API.

Though the company has been talking about their Real World Platform since 2018, they’ve been slow to officially expand it as the enthusiasm behind phone-based AR has seemed to recede since Apple’s initial unveil of ARKit in 2017 prompted a groundswell of attention in the space. “We’ve primarily been focused on first-party games and applications, but we are very excited about extending the platform to be something that more people can use,” Hesch says.

For Niantic and other companies that are bullish on an AR future, their best bet seems to be quietly building and hoping that their R&D will give them a years-long advantage when the technology potentially starts landing more consumer hits.

The Niantic EC-1

More TechCrunch

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Everything announced so far

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8BN in App Store fraud last year in latest pitch to developers

Online travel agency Expedia is testing an AI assistant that bolsters features like search, itinerary building, trip planning, and real-time travel updates.

Expedia starts testing AI-powered features for search and travel planning

Welcome to TechCrunch Fintech! This week, we look at the drama around TabaPay deciding to not buy Synapse’s assets, as well as stocks dropping for a couple of fintechs, Monzo raising…

Inside TabaPay’s drama-filled decision to abandon its plans to buy Synapse’s assets

The person who claimed to have stolen the physical addresses of 49 million Dell customers appears to have taken more data from a different Dell portal, TechCrunch has learned. The…

Threat actor scraped Dell support tickets, including customer phone numbers

If you write the words “cis” or “cisgender” on X, you might be served this full-screen message: “This post contains language that may be considered a slur by X and…

On Elon’s whim, X now treats ‘cisgender’ as a slur

Facebook once had big ambitions to be a major player in enterprise communication and productivity, but today the social network’s parent company Meta will be closing a very significant chapter…

Meta is shutting down Workplace, its enterprise communications business

The Oversight Board has overturned Meta’s decision to take down a documentary revealing the identities of child abuse victims in Pakistan.

Meta’s Oversight Board overturns takedown decision for Pakistan child abuse documentary

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

Adam Selipsky is stepping down from his role as CEO of Amazon Web Services, Amazon has confirmed to TechCrunch.  In a memo shared internally by Amazon CEO Andy Jassy and…

AWS CEO Adam Selipsky steps down

VC and podcaster David Sacks has revealed a new AI chat app called Glue that fixes “Slack channel fatigue,” he says.

David Sacks reveals Glue, the AI company he’s been teasing on his All In podcast

Harness isn’t founder Jyoti Bansal’s first startup. He sold AppDynamics to Cisco for $3.7 billion in 2017, the week it was supposed to go public. His latest venture has raised…

After surpassing $100M in ARR, Harness grabs a $150M line of credit

You can expect plenty of AI, but probably not a lot of hardware.

Google I/O 2024: What to expect

The company’s autonomous vehicles have had a number of misadventures lately, involving driving into construction sites.

Waymo’s robotaxis under investigation after crashes and traffic mishaps

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: Watch the GPT-4o reveal and demo here

Sona, a workforce management platform for frontline employees, has raised $27.5 million in a Series A round of funding. More than two-thirds of the U.S. workforce are reportedly in frontline…

Sona, a frontline workforce management platform, raises $27.5M with eyes on US expansion

Uber Technologies announced Tuesday that it will buy the Taiwan unit of Delivery Hero’s Foodpanda for $950 million in cash. The deal is part of Uber Eats’ strategy to expand…

Uber to acquire Foodpanda’s Taiwan unit from Delivery Hero for $950M in cash 

Paris-based Blisce has become the latest VC firm to launch a fund dedicated to climate tech. It plans to raise as much as €150M (about $162M).

Paris-based VC firm Blisce launches climate tech fund with a target of $160M

Maad, a B2B e-commerce startup based in Senegal, has secured $3.2 million debt-equity funding to bolster its growth in the western Africa country and to explore fresh opportunities in the…

Maad raises $3.2M seed amid B2B e-commerce sector turbulence in Africa

The fresh funds were raised from two investors who transferred the capital into a special purpose vehicle, a legal entity associated with the OpenAI Startup Fund.

OpenAI Startup Fund raises additional $5M

Accel has invested in more than 200 startups in the region to date, making it one of the more prolific VCs in this market.

Accel has a fresh $650M to back European early-stage startups

Kyle Vogt, the former founder and CEO of self-driving car company Cruise, has a new VC-backed robotics startup focused on household chores. Vogt announced Monday that the new startup, called…

Cruise founder Kyle Vogt is back with a robot startup

When Keith Rabois announced he was leaving Founders Fund to return to Khosla Ventures in January, it came as a shock to many in the venture capital ecosystem — and…

From Miles Grimshaw to Eva Ho, venture capitalists continue to play musical chairs

On the heels of OpenAI announcing the latest iteration of its GPT large language model, its biggest rival in generative AI in the U.S. announced an expansion of its own.…

Anthropic is expanding to Europe and raising more money

If you’re looking for a Starliner mission recap, you’ll have to wait a little longer, because the mission has officially been delayed.

TechCrunch Space: You rock(et) my world, moms

Apple devoted a full event to iPad last Tuesday, roughly a month out from WWDC. From the invite artwork to the polarizing ad spot, Apple was clear — the event…

Apple iPad Pro M4 vs. iPad Air M2: Reviewing which is right for most

Terri Burns, a former partner at GV, is venturing into a new chapter of her career by launching her own venture firm called Type Capital. 

GV’s youngest partner has launched her own firm

The decision to go monochrome was probably a smart one, considering the candy-colored alternatives that seem to want to dazzle and comfort you.

ChatGPT’s new face is a black hole

Apple and Google announced on Monday that iPhone and Android users will start seeing alerts when it’s possible that an unknown Bluetooth device is being used to track them. The…

Apple and Google agree on standard to alert people when unknown Bluetooth devices may be tracking them

A human safety operator will be behind the wheel during this phase of testing, according to the company.

GM’s Cruise ramps up robotaxi testing in Phoenix