AUXI – A Virtual Shopping App for Apple Vision Pro

Three questions to the project team

What was the particular challenge of the project from a UX point of view?
From a UX point of view, the main challenge was recreating key in-store shopping experiences within a new spatial interface while keeping the experience low effort and intuitive for users. The project had to restore user confidence in online shopping by addressing fit, sizing, and fabric issues, while making the Vision Pro AR experience intuitive despite unfamiliar gestures and controls. Another major UX challenge was creating a clear, coherent journey across devices, as mobile onboarding for body scanning and Vision Pro shopping initially caused confusion around sign-up, handoff, and app value. Overall, the core UX challenge was balancing immersion with simplicity so users felt confident and comfortable shopping in an unfamiliar AR space.

What was your personal highlight in the development process? Was there an aha!-moment, was there a low point?
A personal highlight was seeing the app come to life on the Apple Vision Pro during testing. Experiencing how spatial computing could make virtual objects feel alive and present, almost as if they could interact with the user, and observing participants test the Figma prototype, mimicking virtual try-ons and floating screens, was a real “aha” moment that made all the research and design work feel tangible. A low point was 3D modeling; with no prior experience, learning from scratch was overwhelming. Overcoming this challenge was highly instructive and made the successes even more rewarding.

Where do you see yourself and the project in the next five years?
AUXI has significant potential. It could integrate with major retail brands, pulling clothing and accessory data in real time so users can browse and try items virtually. It could support seamless transactions, inventory updates, and personalized recommendations using the brands’ systems. SDKs act as a bridge, bringing products into AUXI’s immersive world. Beyond that, AUXI could host online fashion shows and second-hand sales, and the possibilities are extensive. AUXI offered a glimpse into the potential of mixed reality. Imagine spatial experiences in education, such as children exploring the solar system or swimming with sea life from the classroom. The next step is to explore spatial experiences further and lead projects that create meaningful, engaging interactions.