top of page

TZUNAMI XR

Release Date: 5/20/23

The TZUNAMI XR project was initiated as an innovative mixed reality experience, purposed to transition users from an AR portal into an immersive and complex VR environment and audio-visual experience. The project was envisioned as a unique promotional tool for the TZUNAMI album by Zahid Planet.

Technical Details

The project extensively employed A-Frame, a web-based VR framework, and 8th Wall for AR capabilities. Building the project involved a variety of tools and programming languages:

  • 3D Modelling tools: Blender, Rhino 3D, and Grasshopper were used for creating and optimizing 3D assets.

  • Texturing: Adobe Photoshop was leveraged for designing and editing texture files, while Midjourney was used for textures generation.

  • Programming:: Javascript and HTML were used for web development, and Python for debugging and optimization.

  • Animation: D-ID was used for animating the avatar.

  • Audio: Logic Pro X was employed for music production and spatial audio integration.

  • Graphics and UI: Adobe XD was used for the user interface design.

  • AI Assistance: ChatGPT and Bard AI were used for learning coding practices and solving project challenges.

  • Video Editing: CapCut was used to edit the video within the portal.

 

Project Development and Challenges

Throughout the project, several technical and design hurdles were faced. These included optimizing complex 3D models for the web, applying game mathematics for object rotation, designing immersive spatial audio experiences, and creating interactive elements in the VR environment.

Issues such as the rotation of rings in the VR environment were debugged by modifying the code of the A-Frame component. Optimization was a significant part of the project, particularly reducing the size and quantity of textures. To assist with this, a Python script was developed in Blender, providing an overview of the textures, their sizes, and the 3D models utilizing them.

One of the notable challenges was the optimization of complex, parametric, architectural designs and scripted geometries. An optimization plugin was used within Blender to simplify triangles without significant reduction in visual quality.

Another challenge was the excess in texture size which could potentially cause loading issues. Given the large number of textures in use, identification of the problematic texture was required. A Python plugin was developed within Blender that listed all textures, the objects using them, and their resolutions. From this, it was determined that the issue wasn't within the Blender project but with the skydome texture used within 8th Wall. This challenge was successfully addressed by eliminating options with the custom-built Python plugin within Blender.

WebXR Optimization

WebXR performance optimization was a crucial aspect of the project. Key performance metrics such as the number of triangles, number of textures, draw calls, and geometries were thoroughly examined. Substantial efforts were made to simplify the number of textures, reduce draw calls, and significantly reduce the number of triangles while preserving the complexity of advanced geometries.

Initially, the Tex (Max) value seemed concerning, as it represented the maximum texture size used in the project. However, after further analysis, it was found that the high Tex (Max) value was primarily due to the skydome texture. Given that this was acceptable for the skydome, the focus then shifted to other aspects of performance optimization.

 

Future Directions

The project concluded with a clear path for the next phase, which includes developing additional XR experiences for other tracks in the TZUNAMI album, exploring innovative marketing strategies using mixed reality technology, and investigating new methods of integrating XR into lifestyle applications.

bottom of page