Monday, June 5th 2023

Apple Announces Apple Vision Pro AR Spatial Computer

Apple today unveiled Apple Vision Pro, a revolutionary spatial computer that seamlessly blends digital content with the physical world, while allowing users to stay present and connected to others. Vision Pro creates an infinite canvas for apps that scales beyond the boundaries of a traditional display and introduces a fully three-dimensional user interface controlled by the most natural and intuitive inputs possible—a user's eyes, hands, and voice. Featuring visionOS, the world's first spatial operating system, Vision Pro lets users interact with digital content in a way that feels like it is physically present in their space. The breakthrough design of Vision Pro features an ultra-high-resolution display system that packs 23 million pixels across two displays, and custom Apple silicon in a unique dual-chip design to ensure every experience feels like it's taking place in front of the user's eyes in real time.

"Today marks the beginning of a new era for computing," said Tim Cook, Apple's CEO. "Just as the Mac introduced us to personal computing, and iPhone introduced us to mobile computing, Apple Vision Pro introduces us to spatial computing. Built upon decades of Apple innovation, Vision Pro is years ahead and unlike anything created before—with a revolutionary new input system and thousands of groundbreaking innovations. It unlocks incredible experiences for our users and exciting new opportunities for our developers."

"Creating our first spatial computer required invention across nearly every facet of the system," said Mike Rockwell, Apple's vice president of the Technology Development Group. "Through a tight integration of hardware and software, we designed a standalone spatial computer in a compact wearable form factor that is the most advanced personal electronics device ever."
Extraordinary New Experiences
Apple Vision Pro brings a new dimension to powerful, personal computing by changing the way users interact with their favorite apps, capture and relive memories, enjoy stunning TV shows and movies, and connect with others in FaceTime.

An infinite canvas for apps at work and at home: visionOS features a three-dimensional interface that frees apps from the boundaries of a display so they can appear side by side at any scale. Apple Vision Pro enables users to be even more productive, with infinite screen real estate, access to their favorite apps, and all-new ways to multitask. And with support for Magic Keyboard and Magic Trackpad, users can set up the perfect workspace or bring the powerful capabilities of their Mac into Vision Pro wirelessly, creating an enormous, private, and portable 4K display with incredibly crisp text.

Engaging entertainment experiences: With two ultra-high-resolution displays, Apple Vision Pro can transform any space into a personal movie theater with a screen that feels 100 feet wide and an advanced Spatial Audio system. Users can watch movies and TV shows, or enjoy stunning three-dimensional movies. Apple Immersive Video offers 180-degree high-resolution recordings with Spatial Audio, and users can access an exciting lineup of immersive videos that transport them to entirely new places.

Spatial computing makes new types of games possible with titles that can span a spectrum of immersion and bring gamers into all-new worlds. Users can also play over 100 Apple Arcade games on a screen as large as they want, with incredible immersive audio and support for popular game controllers.

Immersive Environments: With Environments, a user's world can grow beyond the dimensions of a physical room with dynamic, beautiful landscapes that can help them focus or reduce clutter in busy spaces. A twist of the Digital Crown lets a user control how present or immersed they are in an environment.

Memories come alive: Featuring Apple's first three-dimensional camera, Apple Vision Pro lets users capture, relive, and immerse themselves in favorite memories with Spatial Audio. Every spatial photo and video transports users back to a moment in time, like a celebration with friends or a special family gathering. Users can access their entire photo library on iCloud, and view their photos and videos at a life-size scale with brilliant color and spectacular detail. Every Panorama shot on iPhone expands and wraps around the user, creating the sensation they are standing right where it was taken.

FaceTime becomes spatial: With Apple Vision Pro, FaceTime calls take advantage of the room around the user, with everyone on the call reflected in life-size tiles, as well as Spatial Audio, so it sounds as if participants are speaking right from where they are positioned. Users wearing Vision Pro during a FaceTime call are reflected as a Persona—a digital representation of themselves created using Apple's most advanced machine learning techniques—which reflects face and hand movements in real time. Users can do things together like watch a movie, browse photos, or collaborate on a presentation.

Even more app experiences: Apple Vision Pro has an all-new App Store where users can discover apps and content from developers, and access hundreds of thousands of familiar iPhone and iPad apps that run great and automatically work with the new input system for Vision Pro. Apple's developer community can go even further and take advantage of the powerful and unique capabilities of Vision Pro and visionOS to design brand-new app experiences, and reimagine existing ones for spatial computing.

A Revolutionary Operating System and User Interface
Built on the foundation of decades of engineering innovation in macOS, iOS, and iPadOS, visionOS was designed from the ground up to support the low-latency requirements of spatial computing. The result is a revolutionary operating system that delivers powerful spatial experiences that can take advantage of the space around the user, unlocking new opportunities at work and at home. visionOS features a brand-new three-dimensional interface that makes digital content look and feel present in a user's physical world. By responding dynamically to natural light and casting shadows, it helps the user understand scale and distance. To enable user navigation and interaction with spatial content, Apple Vision Pro introduces an entirely new input system controlled by a person's eyes, hands, and voice. Users can browse through apps by simply looking at them, tapping their fingers to select, flicking their wrist to scroll, or using voice to dictate.

Apple Vision Pro also features EyeSight, an extraordinary innovation that helps users stay connected with those around them. When a person approaches someone wearing Vision Pro, the device feels transparent—letting the user see them while also displaying the user's eyes. When a user is immersed in an environment or using an app, EyeSight gives visual cues to others about what the user is focused on.

Breakthrough Design
Apple Vision Pro builds on Apple innovation and experience designing high-performance products like Mac, iPhone, and wearables like Apple Watch, culminating in the most advanced personal electronics device ever. To achieve ambitious goals for performance, mobility, and wearability, Apple utilized the most advanced materials possible.

Apple Vision Pro has an astonishing amount of technology in a compact design. A singular piece of three-dimensionally formed and laminated glass is polished to create an optical surface that acts as a lens for the wide array of cameras and sensors needed to blend the physical world with digital content. The glass flows into the custom aluminium alloy frame that gently curves around the user's face, while the modular system allows for a tailored fit to accommodate a wide range of people. The Light Seal is made of a soft textile, and comes in a range of shapes and sizes, flexing to conform to a user's face for a precise fit. Flexible straps ensure audio remains close to the user's ears, while a Head Band—available in multiple sizes—is three-dimensionally knitted as a single piece to provide cushioning, breathability, and stretch. The band is secured with a simple mechanism, making it easy to change to another size or style of band.

Unrivaled Innovation in Hardware
Apple Vision Pro is designed to deliver phenomenal compute performance in a compact wearable form factor. Featuring a breakthrough ultra-high-resolution display system built on top of an Apple silicon chip, Vision Pro uses micro-OLED technology to pack 23 million pixels into two displays, each the size of a postage stamp, with wide color and high dynamic range. This technological breakthrough, combined with custom catadioptric lenses that enable incredible sharpness and clarity, delivers jaw-dropping experiences. Users with vision correction needs will use ZEISS Optical Inserts to ensure visual fidelity and eye tracking accuracy.

An advanced Spatial Audio system is core to the Apple Vision Pro experience, creating the feeling that sounds are coming from the environment around the user and matching the sound to the space. Two individually amplified drivers inside each audio pod deliver Personalized Spatial Audio based on the user's own head and ear geometry.

In addition to creating a breakthrough display and advanced audio experiences, the high-performance eye tracking system in Apple Vision Pro uses high-speed cameras and a ring of LEDs that project invisible light patterns onto the user's eyes for responsive, intuitive input. These groundbreaking innovations are powered by Apple silicon in a unique dual-chip design. M2 delivers unparalleled standalone performance, while the brand-new R1 chip processes input from 12 cameras, five sensors, and six microphones to ensure that content feels like it is appearing right in front of the user's eyes, in real time. R1 streams new images to the displays within 12 milliseconds—8x faster than the blink of an eye. Apple Vision Pro is designed for all-day use when plugged in, and up to two hours of use with its external, high-performance battery.

Industry-Leading Privacy and Security
Apple Vision Pro is built on a strong foundation of privacy and security, and keeps users in control of their data. Optic ID is a new secure authentication system that analyzes a user's iris under various invisible LED light exposures, and then compares it to the enrolled Optic ID data that is protected by the Secure Enclave to instantly unlock Apple Vision Pro. A user's Optic ID data is fully encrypted, is not accessible to apps, and never leaves their device, meaning it is not stored on Apple servers. Where a user looks stays private while navigating Apple Vision Pro, and eye tracking information is not shared with Apple, third-party apps, or websites. Additionally, data from the camera and other sensors is processed at the system level, so individual apps do not need to see a user's surroundings to enable spatial experiences. EyeSight also includes a visual indicator that makes it clear to others when a user is capturing a spatial photo or video.

Pricing and Availability
Apple Vision Pro starts at $3,499 (U.S.), and will be available early next year on apple.com and at Apple Store locations in the U.S., with more countries coming later next year.
Source: Apple
Add your own comment

73 Comments on Apple Announces Apple Vision Pro AR Spatial Computer

#51
R0H1T
This will finally turn the human race into the ultimate evolution/form ~


Nope wrong gif :ohwell:


Posted on Reply
#52
evernessince
TropickSo what I'm hearing is I can get 90% of the experience at 50% of the price by taping an iPhone 14 pro max to a set of Google cardboard VR goggles + Anker battery pack?

Apple HATES this one trick!!!
Or just get a Quest 3 at $500. No over-priced Apple gear needed.
dyonoctisSomeone who actually got to use it. The tech is really good, but it does feel dystopian in some way. It doesn't take 360° video/photos, but stereoscopic 3D video and photos... the question is, do you really want to wear it while witnessing important moments in your life? I understand the intent to use technology to "connect", have immersive photos of great moments in your life... but in practicality, it might end up being another case of "starring at your phone instead of being fully in the moment", but in an immersive way.


Yhea, they don't invent new technology, they are just better than most at actually selling the tech to the mass. Who know what could have happen If Xerox put a patent on the mouse/GUI, and sold an OS and computer themselves?
Marques Brownlee is very pro Apple so weigh that when you consider his opinion.

He goes off about the hand tracking not being in any other HMD but Oculus has had that for awhile now on the quest 2 and it's good. Methinks he doesn't have enough experience with VR / AR headsets to say just how good this HMD is compared to other devices already on the market.
Guwapo77Just looking up this set, I think Apple's might be better spec wise. Varjo requires a full up computer to be plugged into. Also, it costs almost 3 times as much. I could go into a long list of pluses here on Apple's product, but it means nothing since it can't be purchased today like Varjo. So ultimately the win goes to Varjo until next year. LoL
Not even the 4090 can drive the high end Varjo in any demanding real-time graphical applications let alone the higher resolution of the Apple HMD. Fine for work but games are too much. Now compare the 4090's 85,000 to the M2's 3,600 in 3DMark Wildlife extreme and it makes you realize that the Apple HMD is beyond under-powered for anything remotely demanding at the resolution it's displays run at. Apple likely demonstrated their HMD only rendering basic 2D objects in a 3D space because doing anything more is a massive challenge for a graphics chip that weak at such a high resolution. The applications that actually run using spatial aspect will be very low resolution or low detail.
Posted on Reply
#53
Bomby569
I have some weird googles to look into a tv or a monitor, and that somehow is the new magic invention. Stupid that's all i got to say
Posted on Reply
#54
Frick
Fishfaced Nincompoop
TropickSo what I'm hearing is I can get 90% of the experience at 50% of the price by taping an iPhone 14 pro max to a set of Google cardboard VR goggles + Anker battery pack?

Apple HATES this one trick!!!
I mean sure, if you buy this and only use it as you would use a phone it's dumb. I could buy a forklift and use it for commuting and shopping and it would be incredibly dumb.
Posted on Reply
#55
Bomby569
FrickI mean sure, if you buy this and only use it as you would use a phone it's dumb. I could buy a forklift and use it for commuting and shopping and it would be incredibly dumb.
Isn't the main uses for this according to Apple, to be used as a phone, a camera, a laptop, a tv? Try to do all that but in a gimmick way and less optimal then the things it tries to replace. It's a fair point.

Apart from that it's a better VR headset but you also pay an insane cost/premium for it. I'm sure the competitors could build a similar VR for less, as it always happens with Apple stuff.
Posted on Reply
#56
foo3
15x the price of a quest for the same experience as an ipad? - tough sell
Posted on Reply
#58
Tropick
FrickI mean sure, if you buy this and only use it as you would use a phone it's dumb. I could buy a forklift and use it for commuting and shopping and it would be incredibly dumb.
I guess the reason I take issue with it is because in the release video they only show it being used for browsing photos, watching movies, searching the internet and other pedestrian tasks that don't warrant the price tag. I would've liked to see some legitimately interesting software that allows you to do things that aren't possible with what we'd consider traditional tech. Someone could buy a kitted out Mac Mini with a max spec M2 Pro and 32GB of memory and one of their 5K studio displays for the same price and probably have a better experience doing the tasks they showed off in the video. I guess what I'm trying to say is I'm more disappointed with their product positioning than the actual product itself.
Posted on Reply
#59
Guwapo77
Bomby569
The quest is hot garbage. Side note...I might had been on board if it was Chic-Fil-A. I wouldn't feed McDonalds nuggets to a PoW.
evernessinceOr just get a Quest 3 at $500. No over-priced Apple gear needed.



Marques Brownlee is very pro Apple so weigh that when you consider his opinion.

He goes off about the hand tracking not being in any other HMD but Oculus has had that for awhile now on the quest 2 and it's good. Methinks he doesn't have enough experience with VR / AR headsets to say just how good this HMD is compared to other devices already on the market.



Not even the 4090 can drive the high end Varjo in any demanding real-time graphical applications let alone the higher resolution of the Apple HMD. Fine for work but games are too much. Now compare the 4090's 85,000 to the M2's 3,600 in 3DMark Wildlife extreme and it makes you realize that the Apple HMD is beyond under-powered for anything remotely demanding at the resolution it's displays run at. Apple likely demonstrated their HMD only rendering basic 2D objects in a 3D space because doing anything more is a massive challenge for a graphics chip that weak at such a high resolution. The applications that actually run using spatial aspect will be very low resolution or low detail.
...Nobody is impressed by the Quest; however, this new Apple toy has all the tech geeks going crazy. This is a bit different my friend.
Posted on Reply
#60
evernessince
Guwapo77The quest is hot garbage. Side note...I might had been on board if it was Chic-Fil-A. I wouldn't feed McDonalds nuggets to a PoW.


...Nobody is impressed by the Quest; however, this new Apple toy has all the tech geeks going crazy. This is a bit different my friend.
It has all the hipsters going crazy, which is pretty typical for an Apple product. The impression at broad in the AR / VR community is pretty mixed. There is more positive sentiment towards quest products in the VR community than there is for this device. The quest lineup has been selling very well so clearly there are people that like it.
Posted on Reply
#61
R0H1T
The proof of the pudding is in the eating, this would definitely be more polished than most other VR/AR headsets because it's Apple. But then it's also stupidly priced. I'd rather buy a second hand car with that money, it could actually take you places for real.
Posted on Reply
#62
trsttte
erockerOne of the few things I'd want a device like this is for having diagrams, schematics, specs, guides for instructional use for building, repairing, constructing, soldering, etc. But in a form akin to reading glasses. This is very cool, but not for me.
That has been one of the key markets for the hololens helping in manufacturing and machine maintenance - the other market being the military for **stuff**
dyonoctisdo you really want to wear it while witnessing important moments in your life?
The guy wearing the headset while he watches the kids play has to be one of the most dystopic things apple ever put in a presentation
Posted on Reply
#63
Frick
Fishfaced Nincompoop
TropickI guess the reason I take issue with it is because in the release video they only show it being used for browsing photos, watching movies, searching the internet and other pedestrian tasks that don't warrant the price tag. I would've liked to see some legitimately interesting software that allows you to do things that aren't possible with what we'd consider traditional tech. Someone could buy a kitted out Mac Mini with a max spec M2 Pro and 32GB of memory and one of their 5K studio displays for the same price and probably have a better experience doing the tasks they showed off in the video. I guess what I'm trying to say is I'm more disappointed with their product positioning than the actual product itself.
I think the idea is to have the market decide how best to use it. At this point it's a massively upgraded Hololens but with mass market appeal. And it does have some advantages: you can use on on a flight or train in a way you wouldn't be able to use a laptop, and a big one is the ability to just put up screens whever you want them.

This specific product won't sell in numbers massive enough to cover the RD costs, obviosuly. But what is interesting is to see ver 3 or 4.
evernessinceIt has all the hipsters going crazy, which is pretty typical for an Apple product. The impression at broad in the AR / VR community is pretty mixed. There is more positive sentiment towards quest products in the VR community than there is for this device. The quest lineup has been selling very well so clearly there are people that like it.
The Quest is a VR headset though, this is not. Apple didn't mention games at all, because that specific market at this time is pretty mich saturated.
Posted on Reply
#64
dyonoctis
FrickI think the idea is to have the market decide how best to use it. At this point it's a massively upgraded Hololens but with mass market appeal. And it does have some advantages: you can use on on a flight or train in a way you wouldn't be able to use a laptop, and a big one is the ability to just put up screens whever you want them.

This specific product won't sell in numbers massive enough to cover the RD costs, obviosuly. But what is interesting is to see ver 3 or 4.


The Quest is a VR headset though, this is not. Apple didn't mention games at all, because that specific market at this time is pretty mich saturated.
that's pretty much what he's suggesting in that video, but he's also worried that Apple "doing what other can, but better" might not be enough. Unless the devs are really inspired, it's just going to be another very good headset, If Apple themselves couldn't think outside the box when it comes to the software
Posted on Reply
#65
Mussels
Freshwater Moderator
Somehow the front view says "glossier quest 2" while the back says "I belong with your SNES"


The quest 2 got some crazy updates over time, and using third party software like virtual desktop streamer DRASTICALLY changes what they can do, with far higher performance... I dont even use oculus/meta software at all, just steam VR and the virtual streamer and it chugs away at 120Hz/FPS problem free.

The problem is I can never convince anyone to use it often - and because of that software devs never spend much money on them. When there are so few must have VR apps and they're only available on other platforms, what's apple going to do to make users/businesses use their VR/AR instead?
Posted on Reply
#66
aciDev
Musselsit chugs away at 120Hz/FPS problem free.
Is it overclockable?
Posted on Reply
#67
evernessince
FrickThe Quest is a VR headset though, this is not. Apple didn't mention games at all, because that specific market at this time is pretty mich saturated.
The quest is an XR headset, which means it can do both VR and AR. By default the Quest pro doesn't even come with light blockers (which you need for immersive VR) and is clearly angled at the same market as the Apple HMD.

The entire reason you buy the pro over the quest is for it's ability as an AR HMD. The ironic part is that the quest pro didn't sell well at it's higher launch MSRP targeting the same market that Apple is going for. It wasn't until they lowered the price and started advertising more to the VR market that sales improved.

Also, I feel like it needs to be pointed out that Apple is claiming copyright on YouTuber's videos who's impressions of the product were not approved of by Apple.
Posted on Reply
#68
Wrigleyvillain
PTFO or GTFO
gffermariI find it impressive.
Not hardware but software-wise.

Yes there are/will be probably better VR sets but I don't think there is software, environment or apps in general in that scale that work without issues from day one.

I like it and I could put some money on a set like this.
But I don't like iOS (apart from the one in my mobile phone). When Windows, apps, games and VR sets match that level of user friendliness, I will definitely consider buying one.
Good lord, man...what a reasonable comment!

Yeah the price is high ah...but then it reminds me of the original Mac like that (and which is why I never got to touch one beyond school back when). We do all know how that product worked out.
aciDevIs it overclockable?
I like you.

There is apparently some killer content that already exists too incl something LOTR my superfan wife tells me. Which could ultimately also have to do w/ a Orlando attraction someday, as an aside.
Posted on Reply
#69
mb194dc
Have they lost the plot finally?
Posted on Reply
#70
Mussels
Freshwater Moderator
aciDevIs it overclockable?
yup, got that done too
They added a devmode feature for a 7% Overclock boost mode, and you can enable it with these tools (like choosing 72/90/120Hz) at the cost of battery life and heat - letting you choose the balance you want.
Quest2 being android based has a *lot* of awesome features available to devs. At this point I think they just unlocked it for everyone, and put it in the in-headset settings.

Mine runs OC'd and at 120Hz because i run a headband with hotswap magnetic battery packs, so i have about 5x the battery life without even taking the headset off if i had the spare in a pocket

SideQuestVR was used to sideload apps, but also change all these settings before they're officially released unlocked
Virtual desktop streamer has an awkward name, unfortunately but it's an alternative to the stock software - you can use it to stream a 2D desktop directly, or use with steamVR with gaming
Oculus tray tools uses their software, but with a ton of tweaks


The BoboVR strap is freaking amazing, the gel cushioning is cooler and less forceful, and the battery weight at the back rebalances the headset to prevent as much pressure on your face - big game changer for headache prevention




The batteries use strong magnets and a loud beep, so you know when its connected even with the headset on, with blind hotswaps


Apple wants another device to sell expensive accesories for, and i fear they'll try to patent lock a bunch of good designs or ideas and prevent them being used on other devices


Sidequest image, i think this is no longer needed. The Quest2 devs seemed to notice what was popular in the modding community and adopted a lot of tweaks officially, and since i use VDS and it has these options, I havent used this in a long time.
Posted on Reply
#71
aciDev
Musselsyup, got that done too
They added a devmode feature for a 7% Overclock boost mode, and you can enable it with these tools (like choosing 72/90/120Hz) at the cost of battery life and heat - letting you choose the balance you want.
Quest2 being android based has a *lot* of awesome features available to devs. At this point I think they just unlocked it for everyone, and put it in the in-headset settings.

Mine runs OC'd and at 120Hz because i run a headband with hotswap magnetic battery packs, so i have about 5x the battery life without even taking the headset off if i had the spare in a pocket

SideQuestVR was used to sideload apps, but also change all these settings before they're officially released unlocked
Virtual desktop streamer has an awkward name, unfortunately but it's an alternative to the stock software - you can use it to stream a 2D desktop directly, or use with steamVR with gaming
Oculus tray tools uses their software, but with a ton of tweaks


The BoboVR strap is freaking amazing, the gel cushioning is cooler and less forceful, and the battery weight at the back rebalances the headset to prevent as much pressure on your face - big game changer for headache prevention


The batteries use strong magnets and a loud beep, so you know when its connected even with the headset on, with blind hotswaps


Apple wants another device to sell expensive accesories for, and i fear they'll try to patent lock a bunch of good designs or ideas and prevent them being used on other devices


Sidequest image, i think this is no longer needed. The Quest2 devs seemed to notice what was popular in the modding community and adopted a lot of tweaks officially, and since i use VDS and it has these options, I havent used this in a long time.
Wow, that's a lot of information. Thanks! I'm going to pass them on to my father-in-law, who has one and I suppose he only uses it for iRacing. Perhaps I'll borrow it.
Posted on Reply
#72
Wye
Fake clickbait title in trending topics "Apple VR Headset Launched".
It did not launched, just announced.
Are you THAT desperate?
Posted on Reply
#73
Mussels
Freshwater Moderator
WyeAre you THAT desperate?
Who? Apple or techpowerup?

News articles are repeated with the original wording, otherwise they're not news
Posted on Reply
Add your own comment
Jun 28th, 2024 03:52 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts