/lab

The private repos are getting restless.

11 products in active development (plus a peek at the internal tooling), all pointed at the same future: spatial computing where the engines, the assets, and the AI agents finally cooperate. Hardware-verified, demo-ready, and approaching the launch pad.

Looking for what's already shipped? Licensed Unreal Engine plugins are live now.

Video QA Workbench

Design-partner preview · local-first

Stop scrubbing for proof. Review the whole render with evidence.

Seekable local review board with timestamped technical evidencePaired still and matched-video-frame comparison — regions, tiles, and heatmaps instead of a winner scoreOptional local semantic observation, explicitly separate from measured evidence

full briefing →

Forage

Private beta — wishlist open

Fab's best friend. An AI-first scout and installer for the Unreal Engine packs you already own.

Creative intent in, 2–3 best-fit owned packs outMCP server + structured JSON handoff to any AI build agentGuided install — from open-it-and-you-click to hands-free, your choice

full briefing →

Project Ion

Beta · 50+ TestFlight testers

Your Vision Pro is a projector now. Professional-grade projection-mapping previsualization — honest ambient simulation, real projector specs, and a full creative rig in your room.

Head-locked or world-placed projectors — each with its own content, look, and real projector specHonest projector twin: Christie, Barco, Epson, Samsung, BenQ, Hisense presets + lumens/sharpness calculatorReal light spills into your room — directional spotlight + fill that colors every scanned surface

full briefing →

UnRealityKit Bridge

Collaborator beta — hardware-verified

Unreal Engine as the simulation brain. RealityKit as the renderer. The architecture ILM shipped, opened up.

UE simulation + RealityKit rendering — best of both worlds for MRLive Link Previewer: stream your live UE editor to device, no packaged build requiredBridgeabilityAnalyzer: classify every material before you invest in a full bridge build

full briefing →

UE→RenderMan Bridge

In development — renders end to end from the button

One button in the Unreal editor. Film-grade Pixar RenderMan on the other side.

"Send to RenderMan" button in the Unreal editor — async render, no CLIUSD interchange to an out-of-process RenderMan host, verified on macOS and WindowsScene transfer: geometry, instancing, animation, lights, and cameras with real filmback and DoF

full briefing →

Pinchwork

In development

Universal OpenXR hand tracking. Built in Unreal first — designed for every headset, not just one.

Pinch-to-grab with throw physics, rotate-with-hand, hide-on-grabGesture → Enhanced Input codification — rebindable, platform-agnosticPassthrough-safe material library for mixed immersion

full briefing →

Unreal × visionOS

Ongoing engine contributions

The punch list for making Unreal Engine on Apple Vision Pro feel production-ready.

Crown-exit lifecycle fix — no more reboot-to-recoverOpenLevel / ServerTravel compositor fix, upstreamed as a fork PRPassthrough translucency depth/alpha fix — real glass in mixed reality

full briefing →

Constellation

Private — building toward bring-your-own-vault

Your second brain as a navigable 3D star map. Walk through your own notes on Apple Vision Pro.

Force-directed 3D graph of your markdown notes — wiki-links become edges of lightvisionOS 27: RealityKit SurroundingsLight casts a real Room Glow + selection light onto your wallsLive physics — pinch-grab and drag any star, the whole graph reheats around your hand

full briefing →

Promptbook

Private — built for Agile Lens, exploring wider release

Spatial blocking and set previz for theatre on Apple Vision Pro — the stage manager's promptbook, reimagined in 3D.

Tabletop miniature staging that promotes to a full-scale, walk-in stage with one tapRecord-the-walk: perform a character's path once, play it back against the rest of the castScript reader (text/PDF/Final Draft .fdx) stays synced to the blocking timeline both directions

full briefing →

AgileLensMultiplayer

Private SDK — powers every Agile Lens Vision Pro multiplayer app

The shared SharePlay engine every Agile Lens Vision Pro multiplayer app runs on.

MultiplayerSession<Activity>: one @Observable wrapper around GroupSession for every appType-safe messaging, participant tracking, and connection-state management out of the boxPeerStateTracker + HeadPoseBroadcaster keep every remote player's position current

full briefing →

Mission Control

Private — Agile Lens' internal SharePlay diagnostics tool

A live radar for SharePlay sessions — watch every player, in every app, without joining the call.

Live tactical radar over Bonjour — no FaceTime call needed to watch a sessionCRT-styled 2D display: positions, FOV cones, team colors, blast lines, live heatmap3D mesh viewer for room scans streamed live from RoomScanPro

full briefing →

xrsim

Public CLI, private source — install with npm, the repo itself isn't open yet

A simulator for VR apps: boot the build, script the headset, assert on what the app actually believes — no headset, no human in the room.

Scripted virtual headset + controllers played back from a JSON trajectoryLive introspection channel — assert on the app's actual internal state, not screenshotsOne-command, pass/fail runs an AI agent can drive in its own edit-test loop

full briefing →

RoomScanPro

Private — Agile Lens internal, exploring wider release

Collaborative room scanning and real-world measurement for Apple Vision Pro and iPhone.

Multi-device collaborative scanning over SharePlay — mesh streams live between everyoneDeliberate middle-finger-pinch measurement, 0.5cm/0.5in precision, imperial or metricUSDZ export via a custom ZIP packer that routes around a broken visionOS API path

full briefing →

Co-Location Engine

Private — Agile Lens internal, in active development

Fiducial-marker-based co-location for Unreal Engine VR — real and virtual players sharing one room, without a shared coordinate system to begin with.

Joint N-marker rigid-body solve — yaw and position from every visible marker at once, not sequential 2-marker hacksVelocity-gated drift correction: still = untouched, walking = imperceptible, grossly wrong = clean snapArUco + AprilTag + QR detection unified behind one localizer, namespaced marker IDs

full briefing →

Want early access to any of these?