Apple’s Patent Suggests Stylus Pencil as a Controller for Playing VR Games Through its Mixed Reality Headset
In Brief
Apple has filed a patent application for a new version of the Apple Pencil that would allow it to serve as a controller for VR gaming and apps in a mixed-reality environment.
The patent details how the Pencil’s touch surface and sensors would detect user inputs for moving objects or characters within a game.
The company has previously patented unique methods for interfacing with VR, including using a set of Apple Watches as controllers within the virtual world.
The US Patent and Trademark Office recently released an Apple patent application to enhance Mixed Reality headset (Reality Pro), iPad, and Mac user interfaces. The patent envisions a future version of the Apple Pencil, resembling Stylus, that could serve as a controller for VR gaming and apps, allowing users to manage interactions with virtual agents or physical objects.
In the patent example, a user holds an Apple Pencil as a gaming controller to move objects or a character in a game called “Virtual Agent.” The Pencil can be gestured in many different ways, tapped, rolled, twirled, flicked, and swiped on its touch surface to control a VR game. The control device has sensors that detect user inputs through touch and feel on the touch-sensitive surface.
Apple explains how to use eye or gaze tracking to control the movement of objects within a game or extended reality (XR) environment. Patent FIG. 5A depicts the first part of a content delivery system, while FIG. 5C shows the other part. FIG. 5B displays sample data structures. Patently Apple summarized this in one picture.
Should the company choose to implement the idea, users who already own a Stylus might be able to avoid purchasing additional controllers for the Reality Pro headset (if the pencil in the patent is Stylus). Besides, the tech giant previously patented other methods for interfacing with virtual reality. As shown in one of its documents, the company proposes using a set of Apple Watches as controllers within the metaverse.
According to the image below and a patent from last summer, Apple Watches can track hand gestures and contact points on the palms using electrodes. This allows users to control their Apple AR/VR headset display.
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
More articles
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
