In summary
- Meta unveiled a series of AI-powered features for its virtual and mixed reality products during its annual Connect event on Wednesday.
- Meta’s prototype augmented reality glasses, Orion, include access to the Meta AI generative artificial intelligence model, holographic displays and hands-free communication.
- Meta’s Ray-Ban eyewear line will receive updates with integrations with Audible and iHeartRadio, improvements to the AI assistant, and live translation features.
Social media and technology giant Meta unveiled a host of AI-powered features for its virtual and mixed reality products during its annual Connect event on Wednesday, showing off some of its latest technologies as the company tries to catch up and surpass industry rivals.
While Meta’s new “Quest” mixed reality glasses and updates to its Horizon app and virtual apps dominated the presentation, it was the company’s new mixed reality glasses, Orion, that stole the show.
Orion augmented reality glasses
Meta’s prototype augmented reality glasses, Orion, formerly known as Project Nazare, include access to the company’s flagship generative artificial intelligence model, Meta AI, holographic displays and hands-free communication.
Instead of generating an image inside the glass, Orion uses projectors built into the arms of the lenses that emit light into the waveguides. These waveguides feature nanometer-scale 3D structures etched into the lenses to diffract light and place holograms at different depths and sizes in the world in front of the user.
Custom-designed silicon and sensors control everything, with a battery embedded in the arm of the glasses providing power.
Calling it the company’s North Star, Meta said the augmented reality glasses combine “the convenience and immediacy of wearables with a large screen, high-speed input, and contextualized artificial intelligence” in a form that’s comfortable for everyday use. .
Users can control the Orion glasses through voice and AI, eye and hand tracking for gesture commands, and a neural interface in the form of a bracelet.
Orion has not yet been released to the public, but will be tested among employees and select partners to iron out any issues before its future release.
Ray-Ban Meta Lenses
Meta’s Ray-Ban eyewear line is also getting an update. That includes future integrations with Audible and iHeartRadio, as well as an improvement to the glasses’ AI assistant.
Users can now look at an object and ask Meta AI a question about the object instead of having to say “Hey Meta” every time they want to ask a question, the CEO explained. Additionally, the glasses will have a reminder function and will be able to scan and remember the objects that the user looks at.
There are also live translations, where two people speaking different languages can understand what the other is saying in real time, as demonstrated live on stage between UFC flyweight champion Brandon Moreno and Zuckerberg.
Meta AI
Meanwhile, Meta AI is being revamped with new features, including voice interaction in the Meta application suite, allowing users to ask questions and receive answers across all platforms.
“We’re adding multi-modal video AI, so now Meta AI will be able to give you real-time help while you’re doing things like trying to decide what outfit you want to wear to a party you’re going to,” Zuckerberg said.
Meta AI users can also ask the chatbot questions and edit photos, thanks to advancements with Llama 3.2. Additionally, an artificial intelligence studio is being implemented, which will allow creators to build their own AI Agents.
Voice conversations for users interacting with the AI will also be available, responding in various celebrity voices, including wrestler and actor John Cena, Judi Dench, Kristen Bell and Nora Lum, known professionally as Awkwafina.
Zuckerberg said that while the AI updates would be available almost everywhere in the world, they would not be available in the EU.
Meta Quest 3S Lenses
The Meta Quest 3S glasses, the company’s latest in virtual reality, made its debut. Shipping on October 15, the new Quest 3S glasses are available for pre-order starting at $299 for the model with 128GB of internal storage and $399 for the 256GB model.
With the launch of the Meta Quest 3 lenses, the company said it would begin reducing sales of its Quest 2 and Pro lenses by the end of the year or while supplies last.
Horizon Operating System
Updates to Meta’s virtual game and environment, Horizon, this year include photorealistic spaces called hyperscape, improved avatars, a new YouTube co-viewing feature in collaboration with Google, plus new exclusive games like Batman: Arkham Shadow, and a updated and more fluid travel experience between experiences.
“We also continue to improve the social experience on Horizon because that’s kind of our thing,” Zuckerberg joked, referring to the company’s history as a social media company. “Because a lot of magic and mixed reality is this technology that allows you to feel a sense of presence.”
Meta is opening up Horizon OS to more third-party developers. Xbox developers Lenovo and ASUS’s Republic of Gamers are already using Horizon OS, Meta revealed.
Generally Intelligent Newsletter
A weekly AI journey narrated by Gen, a generative AI model.
For the Latest Crypto News, Follow ©KeynoteUSA on Twitter Or Google News.
