Apple Vision Pro for a 3D Artist
What This Device Means for You
This week, I delved into the capabilities of the Apple Vision Pro, specifically focusing on its implications for 3D Artists. This isn't about whether or not to purchase the device; rather, it's an exploration of its present and potential impact on the work of 3D artists.
So, if you are interested and can afford it, go for it. If you would rather take that money and put it toward The Human Bowling Ball, I’m here for that too.
Device Capabilities for 3D Artists
Seamless 3D Model Integration
The Apple Vision Pro introduces an unparalleled ease in handling 3D models. Unlike other devices that require complex software like Blender or Maya just to view a 3D model, the Vision Pro simplifies the process. To view a model, simply double-click the file on the device—no additional software or apps with cumbersome interfaces needed. The model opens instantly, allowing immediate interaction.
Simple Steps to View a 3D Model on the Vision Pro
Convert your 3D model into a USDz format.
Transfer the USDz file to an Apple computer.
Right-click the file, select "Share," and AirDrop it to your Apple Vision Pro.
The 3D model will appear in your space, ready for interaction. The USDz file format retains all vital information, including materials, animations, and other details, ensuring a comprehensive viewing experience. If you need to reopen the model, just double-click it in the file browser.
Here is a quick video breakdown:
Creating a USDz File
For individuals not well-versed in generating USDz files, Apple provides a convenient tool known as Reality Converter through its Apple Developer Plan. This tool is capable of transforming a wide range of 3D file formats into the USDz format, making it simpler to share and display your models on the Apple Vision Pro.
Visual Quality of 3D Models
An unexpected aspect of my experience was the high quality of the 3D models displayed on the device. While they may not achieve perfect photorealism, the visual fidelity is significantly better than anticipated, offering a pleasing and immersive viewing experience.
JigSpace
The integration of USDz files into the Apple ecosystem is just the beginning. Applications like JigSpace take this a step further by enabling the creation of dynamic 3D models. These models can be interactively viewed on the Apple Vision Pro, offering a transformative tool for design reviews and presentations. The ability to dissect and discuss each component of a 3D model in real-time with others is not just impressive—it's a game-changer, especially for professionals, despite the high cost for individual users.
Swatchbook Remix
Swatchbook Remix introduces a simple, yet innovative, platform for designing garments. With a base library of materials at your disposal, the app broadens creative possibilities, even though it's not specifically aimed at 3D Artists. Its importance lies in demonstrating the potential of interacting with digital products through 3D assets, paving the way for more creators to join the 3D content creation sphere.
The Future
The launch of the Apple Vision Pro isn't just about what's currently achievable; it's a window into a future filled with possibilities.
Immersive Storytelling
The Apple Vision Pro offers a range of immersive video experiences, from prehistoric dinosaur adventures and Alicia Keys recording sessions to tightrope walks over cliffs, among other engaging VR-style encounters. A particular moment that caught my attention was a notification during the dinosaur experience, hinting that the creatures could "see" me and react accordingly. This revelation prompted me to ponder the extent of my influence over the narrative unfolding before me. Could the physical environment around me also affect the storyline? For instance, would characters in an augmented reality (AR) drama need to navigate around actual objects in my room, like a sharply edged side table?
This interactive form of storytelling, familiar within the gaming world, feels profoundly different when you transition from observing a character on a screen to becoming part of the narrative yourself. The moment a T-Rex gazed directly at me during the dinosaur experience, I found myself reacting with a level of surprise and excitement unprecedented in my gaming history.
This opens up fascinating possibilities for artists, filmmakers, and storytellers to exploit this novel medium. They can craft unique, immersive narratives that allow viewers to influence and be an integral part of the story in ways previously unimaginable.
Collaborative Space
Despite the Apple avatars being pure nightmare fuel, the interaction capabilities within the Apple Vision Pro drastically surpass those of current platforms like FaceTime, Zoom, and Oculus Horizon. My personal experience of spending time with my brother through the device was nothing short of captivating.
The Vision Pro uses spatial audio, enhancing the realism of interactions; for example, when I positioned his avatar next to me, it genuinely felt like he was there. I had to do some work in my virtual world and he was playing chess against a computer in his virtual world but we were still hanging out and occupying the same joint space.
Expanding this concept to professional scenarios offers even more potential. The common corporate complaint that remote work detracts from company culture and collaboration might be addressed by this technology. Similarly, it counters the primary grievances of remote workers, such as commuting and a desire for flexible work environments. The Apple Vision Pro could enable a scenario where colleagues can come together in a virtual space to review projects, brainstorm ideas, and engage in casual interactions, all without the need to physically be in the same location. This approach offers the best of both worlds: the collaboration and camaraderie of office life, coupled with the convenience and flexibility of working from home.
Personalized Reality
The spatial memory feature of the device deeply impressed me. Once I placed a 3D model on my kitchen counter, it stayed there in that session and in future sessions. Every time I put on the headset, that 3D object remained in place. It became a semi-permanent fixture in my augmented reality landscape until I chose to remove it. This capability opens the door to endlessly customizable environments. Imagine redesigning your home with augmented reality, adding virtual billboards to your daily route to brighten your day, or creating and selling a collection of abstract 3D sculptures for others to display in their spaces.
The possibilities of how this technology might be used are vast and uncertain, yet the prospect of being able to customize one's environment in such a personal and enduring way is incredibly exciting. This feature alone showcases the device's potential to revolutionize our interaction with our surroundings.
Conclusion
None of the current applications for this device represent the indispensable "killer app" we often await with new technology—and that's entirely acceptable. History shows us that groundbreaking applications need time to emerge. Consider the timeline of iconic iPhone apps: Instagram debuted three years post-iPhone launch, Uber four years, and TikTok a full nine years before it kicked off.
We're on the threshold of a novel domain, rich with unique features yet to be fully discovered and leveraged.
The infrastructure and potential for transformative experiences are already in place. My initial explorations didn't just hint at the future of augmented reality (AR), virtual reality (VR), mixed reality (MR), and extended reality (XR); they offered a glimpse into a realm of boundless opportunity for 3D creatives. This isn't just about the future of a specific technology—it's about previewing the future of creative expression and interaction.
Join The Spatial Explores Community
Join The Spatial Explorers, a dynamic community for artists and enthusiasts passionate about immersive storytelling. We specialize in creating 3D content for headsets like Meta Quest 3 and Apple Vision Pro. This is a space for collaboration, learning, and growth in the realm of augmented reality. Dive into the future of immersive storytelling with us!!
3D News of the Week
Disney invests $1.5B in Fortnite maker Epic Games to build a persistent game universe - Venture Beat
Free USD DataSet of ‘DaVinci’s Workshop’ - NVidia
Spin Your Substance 3D Painter Models in AR with Apple Vision Pro - 80.lv
The Earlies AI Images Exhibited at the Whitney in NYC - whitney.org
Rookie Awards 2024 Announced! - TheRookies.co
3D Merch is here!
Click here to Get Your 3D Artist Swag!
3D Tutorials
3D Job Spreadsheet
Link to Google Doc With A TON of Jobs in Animation (not operated by me)
Check Out The New Wednesday Artist Spotlight Email!
LINK TO ARTIST SPOTLIGHT
Want to be featured!?!?! Submit your work here
Hello! Michael Tanzillo here. I am the Head of Technical Artists with the Substance 3D Growth team at Adobe. Previously, I was a Senior Artist on animated films at Blue Sky Studios/Disney with credits including three Ice Age movies, two Rios, Peanuts, Ferdinand, Spies in Disguise, and Epic.
In addition to his work as an artist, I am the Co-Author of the book Lighting for Animation: The Visual Art of Storytelling and the Co-Founder of The Academy of Animated Art, an online school that has helped hundreds of artists around the world begin careers in Animation, Visual Effects, and Digital Imaging. I also created The3DArtist.Community and this newsletter.
www.michaeltanzillo.com
Free 3D Tutorials on the Michael Tanzillo YouTube Channel
Thanks for reading The 3D Artist! Subscribe for free to receive new posts and support my work. All views and opinions are my own!