Decart XR

Decart XR is a Unity-based Meta Quest 3 application that captures live video from the headset's passthrough cameras, streams it over WebRTC to Decart AI's server-side video-to-video neural network, applies an AI style transformation, and superimposes the processed output back into the user's view in near real time. The application's primary mode, Warp the World, uses Decart's Mirage model offering 61 premade world transformation prompts plus unlimited custom voice-described styles. A secondary mode, Swap Your Friend, uses the Lucy model to apply 15 person-specific transformations to people in the camera view. Processing runs at 30fps with a VP8-encoded WebRTC video pipeline and delivers end-to-end latency of approximately 150 to 200 milliseconds. The current implementation transforms a rectangular 2D viewport within the headset's view rather than a full stereoscopic 3D environment, which is a structural limitation of the current architecture. Decart XR is primarily of interest to VR developers, XR researchers, and technology enthusiasts who want to explore real-time AI video-to-video transformation on consumer VR hardware. Developers use it as a technical reference for building Quest 3 applications that combine passthrough camera access, WebRTC streaming, and AI service integration — Decart's team published a detailed technical breakdown of the architecture on their developer cookbook. See related options. Researchers investigating the feasibility of real-time AI scene transformation in mixed reality contexts use it as a working implementation to study latency, consistency, and practical constraints. The fully open-source client codebase, available on GitHub under MIT license, makes it a concrete starting point for developers building on similar VR AI interaction concepts. Decart XR is free to use and is available on the web at vr.decart.ai and as a sideloadable Quest 3 app via SideQuest. The client code is open-source under MIT license, though the Decart AI service it connects to is governed by separate terms of service. The app requires a Meta Quest 3 — it does not support Quest 2 or other headsets — and sideloading requires enabling developer mode on the device. Independent testing has noted that in practice the latency can be perceptible to higher-end than the specified range, and the 2D viewport framing means the style transformation does not fill the full field of view, making the current version a compelling technical demonstration rather than a polished consumer product Find related tools.