XR Daily: Snap's Agent Lands First

Snap’s Specs Ships an Agent Before Anyone Else’s AR Glasses

Snap’s launch event in Los Angeles this week added two things to its $2195 AR glasses: an AI agent, and a cellular case so the glasses do not have to lean on your phone. Specs still targets a fall release in the US, UK, and France, with preorders open since June. The new feature is Specs Intelligence, and Snap frames it as an agent rather than a chatbot, one that anticipates when help is useful and surfaces information and actions without waiting for a prompt.

The preview is narrower than that pitch. On iPhone, the US-only public preview pulls insights from Gmail and Google Calendar. The fuller macOS experience is invite-only. Snap declined to say which model provider powers it, or what pricing looks like after the free preview. The cellular case bundle costs $2395, a $200 premium over the included case, with service through Verizon at $10 per month if you also use Verizon for your phone and $20 otherwise, plus EE in the UK and Orange in France. Public demos begin October 1 at Westfield Century City in Los Angeles. There is still no concrete ship date, despite the event being staged as a launch.

CEO Evan Spiegel’s on-stage demo is the closest thing buyers have to a real performance claim: palm-mounted shortcuts poked with the other hand, floating windows opened by pointing and pinching, Snapchat capture triggered by snapping your fingers, first-person video calls, YouTube launched in the browser by voice through the agent, a Shopify flow that places a product in your room at true scale, the Quest app Pencil ported across, and an HBO Harry Potter experience that casts Wingardium Leviosa. For developers the input vocabulary is the substance here. Point, pinch, and palm tap are the primitives you get, and an agent that acts before you ask needs persistent context and cloud inference sitting behind a body-worn display. Snap is also first to market with an agent-first standalone AR device, ahead of Meta’s Connect keynote on September 23 and 24.

→ UploadVR · UploadVR on the live demo

---

visionOS 27 Quietly Opens Tracking to Everyone Else

Apple shipped visionOS 27 for both M2 and M5 Vision Pro headsets, and it is a larger release than the lack of fanfare suggests. The change with the longest tail is the IR LED tracked accessory framework. visionOS 26 shipped hardcoded support for two Sony and Logitech products, the PSVR 2 Sense controllers and the Muse stylus, which both hide a constellation of infrared LEDs under the plastic. visionOS 27 exposes the APIs to anyone, with optical tracking at 90Hz fused with the accessory’s IMU, which is the same quality tier as the Sense controllers and roughly what SteamVR Lighthouse gives PC accessory makers.

There are two integration paths. A hardware maker can ship a visionOS companion app that registers an object’s shape and LED layout with the system, which suits consumer devices, or a developer can bake those details into an app, which suits enterprise. DFRobot and MikroE already announced reference designs, and the DFRobot kit is purchasable now.

The second addition matters for content that was never static. Apple added a high-frame-rate object tracking mode for moving and held objects, where visionOS 2’s system assumed static anchors and reacted slowly if the object moved. Apple does not publish the update rate, though developer reports put it around 30Hz, well below what hand tracking and IR accessories deliver. Apple recommends the new Extended Training mode, which improves tracking but lengthens model training considerably: XR tinkerer Brad Lynch measured about 18 hours to train a single fish toy. visionOS 27 also extends the Gaussian splatting based spatial scene system from visionOS 26 to iPhone panoramas, which can now serve as your home environment, and it rolls out Siri AI in beta through a Settings waitlist, powered by Apple Foundation Models co-developed with Google and built on Gemini, with a hybrid split between an on-device model and Private Cloud Compute. Background: the Gaussian splatting pipeline.

→ UploadVR

---

Gaussian Splats on Quest: A Measured Tour of What Actually Runs

UploadVR’s Alan Truly spent weeks testing splat viewers on a Quest 3 and came back with the frame budget numbers that usually stay hidden. AirVis took his top slot: a native Quest app with public cloud scenes plus 5GB of free personal storage, capture from phones, drones, and 360 video, and controls that hold up whether you fly through a scene or walk it. He also streamed local splats to the headset through AirVis’s CloudXR option, which reported 30 to 40 frames per second on a 5M splat scene from an RTX 4070 Super.

The rest of the field is a study in tradeoffs. SuperSplat runs in the Quest browser and has the largest community library, but many scenes forced him into performance mode and lag was sometimes enough to cause motion sickness. GSVision, for files transferred over USB, recommends 700,000 splats and showed noticeable lag around 1.2 million, fixed partly by setting Sort Every Nth Frame to 20, which trades sort accuracy for frame time. A fixed gray platform he could not disable blocks part of the view, and culling had to be pulled in to 0.2 metres to stop nearby detail vanishing. Into the Scaniverse links phone capture to Quest viewing but only with its older processing system, since Niantic Spatial told him it is not developing Quest support for the newer one. Horizon Hyperscape delivered his best combination of quality and smoothness, with the harshest limits: capture requires a Quest 3 or 3S, and personal captures cannot be shared, because Meta removed sharing and shared visits in May. Marble’s generated worlds and Gracia’s moving subject captures both ran acceptably in the browser, and moving splats are the more interesting direction.

The numbers are the useful part for anyone shipping volumetric content. Roughly 700,000 splats is the comfort point on Meta’s best standalone headset, and the sort step is the expensive one, which is exactly why temporal sort caching shows up as a viewer option rather than an internal optimization. Meta’s newest headset is three years old, and the ceiling is visible in the results. See also off-head XR compute.

→ UploadVR

---

Remedy’s Northlight Is the Real Star of Control Resonant

Control Resonant is out, sitting at an 84 Metacritic aggregate across 60 critic reviews and the same top critic average on OpenCritic, slightly above the original Control and below Alan Wake II. It swaps Jesse Faden for her brother Dylan, trades the Service Weapon for a shapeshifting melee weapon called Aberrant, and moves the series out of the Oldest House into sections of Manhattan that bend, fracture, and reorganize themselves.

The rendering story is why it is here. Remedy says Northlight’s latest technology is doing the work: denser geometry, richer materials, better ray tracing, and neural rendering features, which show up in the density of the city, the physical destruction during combat, and lighting that shifts as reality rearranges around you. 80 Level reports the game looks and runs great on PS5 Pro, and notes the opening is slower than the combat suggests and some RPG systems are opaque.

Put that against an XR budget and the gap is instructive. Destruction plus ray traced lighting plus per-object density is the same combination that makes a stereo frame at 90Hz so expensive, which is the reason reconstruction and neural rendering matter more on a headset than on a console. This is a good look at where a well-funded engine puts its rasterization budget when it only has one camera and a 60Hz to 120Hz output to hit.

→ 80 Level

---

Computer-Use Agents Get a Compact Decision Model

The trycua/cua project pulled 89 points on Hacker News this week, and its framing is the useful part: “Computer-Use 2.0,” where an agent moves between code, APIs, and graphical interfaces inside a single task. The repository now sits at 25,300 stars and 1,700 forks, and it bundles four pieces. Cua Fleets provisions isolated cloud Linux desktops with a Sandbox SDK for running commands, capturing screenshots, and interacting with apps. Cua Driver gives an agent tools for native apps on macOS, Windows, and Linux, including a background delivery mode so the agent can work without moving your pointer or stealing focus when the platform allows it. Cua Bench evaluates agents on simulated tasks, and CUA-S1 is a family of small specialist models for computer-use decisions rather than a frontier model called per step.

That last piece is the interesting one for headset work. Anything that runs per interaction on a standalone device sits inside a battery and thermal envelope, and a decision model in the hundreds of millions of parameters is affordable where a cloud round trip is not. The screen-observe, decide, act loop also maps cleanly onto a spatial compositor: capture the window, choose a target, emit an input event. Background input delivery without focus theft is the hard requirement, and it is worth watching whether spatial OS vendors expose an equivalent automation surface before third parties invent four incompatible ones.

→ GitHub: trycua/cua

---

Steam Frame’s Waitlist Is Now a Scalper Market

Valve started emailing Steam Frame reservation holders this week, and a lot of them landed on a waitlist instead of a checkout page, which is exactly the opening scalpers wait for. Listings have appeared on eBay since registration opened on September 14, including ones that cannot possibly be legitimate, since nobody outside a dev kit has a confirmed unit to ship. As the waitlist emails went out, a second wave arrived with screenshots of reservation queue confirmations attached, and those are trivially copied or altered. The Steam Controller shows the same pattern: a $100 accessory listed as high as $300, with some buyers told they are waitlisted into 2027.

Valve used the same registration system it built for the Steam Machine to blunt this, and it clearly was not enough. For developers the practical question is dev kit access, not consumer pricing, and a secondary market priced above retail is a poor way to find out how the hardware performs on real content. See also Steam Frame scalper market.

→ UploadVR

---

Quick Bites

• A surfacing workflow built for last-minute color changes. Character artist Fabien Metais modeled and sculpted in Maya without retopologizing, then painted every value in Substance 3D Painter in black and white, duplicating layers with anchor points so the whole palette can be swapped later. He finished in Blender’s shader and compositing editors with reduced shadow impact, a light halo, and grain for a 2D look. → 80 Level
• Forefront adds fighter jets and a new map. The multiplayer shooter’s latest content update lands two new vehicles and another battleground. → UploadVR
• CleanSheet Soccer 2 is out on Quest. The arcade football game shipped on Meta’s platform today. → UploadVR
• Sol Protocol’s early access first impressions. UploadVR calls the space set shooter a solid foundation in progress. → UploadVR