Decart XR

Decart XR is a Unity-based Meta Quest 3 application that captures live video from the headset's passthrough cameras, streams it over WebRTC to Decart AI's server-side video-to-video neural network, applies an AI style transformation, and superimposes the processed output back into the user's view in near real time. The application's primary mode, Warp the World, uses Decart's Mirage model offering 61 premade world transformation prompts plus unlimited custom voice-described styles. A secondary mode, Swap Your Friend, uses the Lucy model to apply 15 person-specific transformations to people in the camera view. Processing runs at 30fps with a VP8-encoded WebRTC video pipeline and delivers end-to-end latency of approximately 150 to 200 milliseconds. The current implementation transforms a rectangular 2D viewport within the headset's view rather than a full stereoscopic 3D environment, which is a structural limitation of the current architecture. See related options. Decart XR is primarily of interest to VR developers, XR researchers, and technology enthusiasts who want to explore real-time AI video-to-video transformation on consumer VR hardware. Developers use it as a technical reference for building Quest 3 applications that combine passthrough camera access, WebRTC streaming, and AI service integration — Decart's team published a detailed technical breakdown of the architecture on their developer cookbook. Researchers investigating the feasibility of real-time AI scene transformation in mixed reality contexts use it as a working implementation to study latency, consistency, and practical constraints. The fully open-source client codebase, available on GitHub under MIT license, makes it a concrete starting point for developers building on similar VR AI interaction concepts Find related tools.