Meta and BMW Unveil Future of In-Car Entertainment Featuring VR/AR
In Brief
Meta and BMW collaborate to integrate augmented and virtual reality into smart vehicles, aiming to enhance the passenger experience.
The partnership combines Meta’s AR/VR expertise with BMW’s Group Technology Office USA.
The two companies have overcome challenges faced by VR headsets in moving vehicles by integrating tracking systems and sensor data.
Meta and BMW have joined forces to revolutionize transportation by integrating augmented and virtual reality technology into smart vehicles. The collaboration aims to enhance the passenger experience, offering a more interactive and engaging journey.
The partnership, announced in 2021, marks a significant milestone in the pursuit of a more captivating travel experience. Meta’s Reality Labs Research, a tech division at the forefront of AR/VR advancements, has harnessed its expertise to join forces with BMW’s Group Technology Office USA.
According to Meta’s blog post, the social media giant and BMW have tackled a significant challenge faced by Oculus Insight technology, which tracks VR headset movement using inertial motion sensors and cameras. The conflict arises from the disparity between the cameras observing motion relative to the car’s interior and the IMUs (inertial motion sensors) measuring acceleration and rotational velocity relative to the world. To overcome this limitation, Meta and BMW integrated real-time IMU data from the car’s sensor array into their Project Aria research glasses’ tracking system. The approach enables the glasses to accurately calculate their location relative to the moving car, resulting in the stable anchoring of virtual objects using a digital twin of the vehicle.
In a demonstration, Meta and BMW showcased their ability to accurately and consistently display VR and mixed reality (MR) content to passengers in a fast-moving car. This achievement is a first of its kind, as the stability of the content remains unaffected even during turns, speed bumps, and acceleration. By seamlessly integrating Meta Quest’s tracking system with BMW’s sensor data, the researchers have enabled a series of stable and immersive experiences, ranging from gaming, entertainment, and productivity, specifically designed for the car environment.
Meta and BMW are taking the next step by integrating the car’s location with the world, allowing the rendering of virtual content locked to the real environment. This advancement has the potential to identify landmarks and points of interest outside the vehicle using the car’s precise positioning system.
“It is too early to tell exactly how or when this technology will make it into customers’ hands, but we envision a number of potential use cases for XR devices in vehicles — from assisting the driver in locating their car in a crowded parking lot to alerting them to hazards on the road and surfacing important information about the vehicle’s condition. The implications of future AR glasses and VR devices — for passengers as well as drivers — are promising,”
said Claus Dorrer, Head of BMW Group Technology Office USA in Mountain View.
Last year, BMW integrated blockchain technology into its daily workflow and introduced a blockchain loyalty program for customers in Thailand. In collaboration with Coinweb, a blockchain infrastructure firm, BMW utilized decentralized architecture and settled transactions using Binance’s BNB Chain.
Read more:
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
More articles
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
