Surreal Minds
Prototype study · in progressFour small Unreal worlds learning to react to photos, wishes, gestures, and keys.
Memory Portal, Impossible Conservatory, Creature Home, and Living Tabletop are a connected prototype study for spatial AI on standalone headsets. The work compares what can run on the headset, what benefits from a nearby studio PC, and what—if anything—earns a cloud call. The development diary keeps editor, emulator, and headset evidence separate, including the ideas that did not survive a wearer test.
The reaction has to be visible
A correct model response is not enough. Each result needs readable confirmation, sound, and a dramatic change in the world: a garden transforms, a memory assembles, a creature reacts, or a tabletop grows.
Three AI routes, measured on the same work
The diary compares on-device, LAN and cloud results for the same synthetic photo, with measured latency and explicit test conditions. Cloud vision now supplies grounded object layouts for a toy diorama. Desktop, emulator and headset evidence remain separately labeled; a controlled three-backend headset comparison is still open.
Unreal is part of the point
Lighting, atmosphere, material response, animation and in-world typography are not decoration after the AI. They are how a model result becomes a moment worth wearing and filming.
At a glance
- ✦Real captures from Unreal desktop preview, the PICO emulator, and a Quest 3 headset
- ✦On-device caption and wish inference alongside a studio-PC depth route
- ✦Hands and keyboard remain the primary interaction paths
- ✦Open defects and rejected directions stay in the public record
An experiment, not a product.
There is nothing to install or join here — Surreal Minds is a write-up of one night's work and what it taught me. Read the devlog above, and if this kind of AI-driven engine work is relevant to what you are building, get in touch.
Also in the lab
Harborfolk
A little world at human scale, with people at every station.
Persona Live
Your Vision Pro Persona, driving a live MetaHuman.
Nightbloom
Procedural fireworks in your real sky.
SceneAudit
Measure the gap your viewport hides.
Video QA Workbench
Stop scrubbing for proof. Review the whole render with evidence.
Forage
Fab's best friend. An AI-first scout and installer for the Unreal Engine packs you already own.
Project Ion
Your Vision Pro is a projector now. Professional-grade projection-mapping previsualization — honest ambient simulation, real projector specs, and a full creative rig in your room.
UnRealityKit Bridge
Unreal Engine as the simulation brain. RealityKit as the renderer. The hybrid architecture Unity proved out with PolySpatial — open for Unreal.
UE→RenderMan Bridge
One button in the Unreal editor. Film-grade Pixar RenderMan on the other side.
Pinchwork
Universal OpenXR hand tracking. Built in Unreal first — designed for every headset, not just one.
Apple Vision Pro + OpenXR
The engine-level work behind Unreal on Apple Vision Pro over OpenXR — punch-list fixes today, Lumen and Nanite research pushing further.
Constellation
Your second brain as a navigable 3D star map. Walk through your own notes on Apple Vision Pro.
Promptbook
Spatial blocking and set previz for theatre on Apple Vision Pro — the stage manager's promptbook, reimagined in 3D.
AgileLensMultiplayer
The shared SharePlay engine every Agile Lens Vision Pro multiplayer app runs on.
Mission Control
A live radar for SharePlay sessions — watch every player, in every app, without joining the call.
xrsim
A simulator for VR apps: boot the build, script the headset, assert on what the app actually believes — no headset, no human in the room.
Ultimate OpenXR Template
Hands. Controllers. Your next XR project.
See it in action. Then make it yours.
Echo Cathedral
Draw a line in VR.
Then play the room.
RoomScanPro
Collaborative room scanning and real-world measurement for Apple Vision Pro and iPhone.
Co-Location Engine
Fiducial-marker-based co-location for Unreal Engine VR — real and virtual players sharing one room, without a shared coordinate system to begin with.
Fable Showcase
A playable experiment in how reliably AI and a headless Unreal toolchain can build a museum-scale experience with limited handholding.