Talk to us

VR WEBSIM / PLAYER GUIDE

Player
guide

Stack cups as a simulated Booster T1 humanoid, in VR. Your PC browser runs the sim and your Meta Quest pairs with a 6-digit code. Nothing to install, and about two minutes to your first run.

OPEN THE SIM SOMETHING'S WRONG?
PC
Chrome or EdgeOn a PC or laptop.
HEADSET
Meta Quest 2, 3, 3S or ProWith both controllers.
NETWORK
Same Wi-Fi works bestDifferent networks also work, through a relay.
INSTALL
NothingThe Quest's built-in Browser app is enough.

STEP 01 · PC

On the PC

  1. Go to homebrew.build/sim. On the This is the PC card, choose OPEN CONTROL ROOM.

  2. First visit only: read the simulator data notice, tick the box and press ACCEPT & OPEN CONTROL ROOM.

    What it covers is under Your data.

  3. Wait for the robot and table to appear. This tab is the simulation, so keep it open and on screen for the whole session.

    If it is minimized or hidden behind another tab, the robot freezes but the game clock keeps running.

  4. Find the 6-digit code in the PAIR A QUEST panel.

    One headset per code. A code lasts about an hour from when it was made or last paired; refresh the page for a new one.

The PC control room: the Booster T1 and table on the left, the PAIR A QUEST panel with a 6-digit code on the right
PC · CONTROL ROOMThis tab runs the physics and streams the robot's view to your headset.

STEP 02 · HEADSET

In the headset

  1. Put the headset on and open the built-in Browser app, the regular web browser.

  2. Go to homebrew.build/sim. On the This is the Quest card, choose OPEN HEADSET LINK, type the code and press CONNECT TO PC.

  3. When the page says READY FOR VR., press ENTER VR and choose Allow.

    The headset may go dark briefly while it switches to VR. You then see CONNECTING (ESTABLISHING ROBOT VISION) until the robot's video arrives. Give it about 10 seconds.

The headset link page twice: the 6-digit code typed above CONNECT TO PC, then READY FOR VR with the ENTER VR button
QUEST BROWSERType the code, press CONNECT TO PC, then ENTER VR.
The VR view while connecting: a toolbar of buttons on top, the video panel showing CONNECTING, ESTABLISHING ROBOT VISION, and a status bar reading WAITING FOR PC VIDEO
IN VR · FIRST SECONDSCONNECTING stays up until the robot's video arrives.

WHAT YOU SEE IN VR

TOP TO BOTTOM
Toolbar
⚙ view distance, EASY, MEDIUM, HARD, RESET and EXIT. Point at a button and pull the trigger.
Video panel
The robot's camera. Look down to see the table and cups.
Status bar
What to do next, the difficulty and the game clock.

STEP 03 · DON'T SKIP

Calibrate

  1. Stand up. The robot's torso is fixed, so seated poses map badly and the arms fight you.

  2. Look straight ahead, let your arms hang relaxed at your sides, then press A or X on either controller.

    This pose becomes your zero point. Calibrating with raised arms uses up your reach and leaves the robot with short arms.

  3. Look down. The table and cups are below you in the robot's camera view.

The headset after calibrating: NEXT, LOOK DOWN, IN THE CAMERA SCREEN ITSELF, with the table and cups below
IN VR · AFTER CALIBRATINGLOOK DOWN shows for a few seconds, then GRAB A CUP TO START.
QUICK STARTTIME 0:00.000

FIRST, TO CALIBRATE

PRESS A / X

EITHER CONTROLLER

What the headset asks for first. Until you calibrate, the robot doesn't move.

DO THIS

Standing, arms down, eyes forward.

NOT SEATED

The robot's torso is fixed.

NOT ARMS UP

It wastes your reach.

REFERENCE

Controls

Meta Quest Touch controllers. Use the controllers: hand tracking isn't supported yet.

Meta Quest Touch Plus controller map Top and side views of Meta Quest 3 Touch Plus controllers. X or A calibrates. Thumbstick click switches head view and third person. Hold trigger or grip for the magnet grab; let go of both to drop. Y and B are unused. Menu and Meta are system buttons. TOP VIEW · HANDLE TOWARD YOU LEFT RIGHT Y X B A Ydoes nothing in the sim Thumbstick clickswap head view / third person Xcalibrate / recalibrate Menusystem button Bdoes nothing in the sim Thumbstick clickswap head view / third person Acalibrate / recalibrate Metasystem button X or A works on either controller; the right controller must be tracked. SIDE VIEW · SEEN FROM THE INNER SIDE LEFT RIGHT Gripmiddle finger · same job as trigger Triggerindex finger, under the front Gripmiddle finger · same job as trigger Triggerindex finger, under the front Hold trigger or grip magnet grabs the nearest cup let go of both to drop used in the sim unused (Y, B) system (Menu, Meta) Drawn as Quest 3 / 3S Touch Plus (no ring). Same buttons on Quest 2 and Pro controllers.

YOUR BODY

ALWAYS ON
Head
Turns the robot's head
Hands
Move the robot's hands
Arms
Both follow you after calibration

LEFT CONTROLLER

X · Y · MENU
X
Calibrate or recalibrate
Trigger or grip, hold
Left magnet on
Thumbstick click
Head view or third person
Y
Not used
Menu
System button

RIGHT CONTROLLER

A · B · META
A
Calibrate or recalibrate
Trigger or grip, hold
Right magnet on
Thumbstick click
Head view or third person
B
Not used
Meta
System button

ABOVE THE VIDEO PANEL IN VR

Point a controller at a button and pull the trigger.

The VR toolbar: a gear button, then EASY, MEDIUM, HARD, RESET and EXIT

CLOSERFARTHER

Moves the video panel nearer or further away.

EASYMEDIUMHARD

Picks the pyramid size. Switching resets the cups.

RESET

Puts the cups back and clears the clock.

EXIT

Leaves VR and drops the pairing. Type the same PC code to play again.

THE TASK

Cup stack

Pick the size from the buttons above the video panel in VR. Start with Easy.

A finished easy pyramid, 2–1, 3 cups, on the table in front of the robot
Easy2–1 · 3 cups
A finished medium pyramid, 3–2–1, 6 cups, on the table in front of the robot
Medium3–2–1 · 6 cups
A finished hard pyramid, 4–3–2–1, 10 cups, on the table in front of the robot
Hard4–3–2–1 · 10 cups
  1. The headset before the first pickup: GRAB A CUP TO START, the timer starts on your first magnet pickup

    01PICK UP

    Move a hand within about 11 cm of a cup and hold its trigger or grip. The clock starts on your first pickup.

  2. Both robot hands carrying cups: PLACE BOTH CUPS IN THE PYRAMID

    02PLACE

    Carry it over and let go of both trigger and grip. Every cup upright, each row centred on the one below.

  3. A finished pyramid with the STACK CONFIRMED IN countdown and PYRAMID SET, HOLD STILL

    03HOLD STILL

    Let go of every cup. A 2-second STACK CONFIRMED IN countdown runs. Bump it and it starts over.

  4. The result: NEW BEST TIME 0:21.924

    04YOUR TIME

    The clock stops on YOUR TIME or NEW BEST TIME, 2-second hold included. Press RESET to go again.

TIPS FROM OUR FIRST OPERATORS

  • Move small and slow. The robot's arms are shorter than yours, so work in a box in front of your chest.
  • Turn, don't stretch. Big reaches pin the arm at its limits. If a cup is far away, turn your body.
  • Settle, then release. The magnet is forgiving on pickup. Hold your hand over the spot before letting go.
  • Use both hands. The cups start on both sides, so let each hand fetch its own.
  • Lost the table? Look down. If it stays out of view, the headset points the way, for example ◀ THE TABLE IS TO YOUR LEFT.

LEADERBOARD

Post your time

You can play without signing in. Your runs just stay off the public board.

  1. On the PC, press SIGN IN WITH GOOGLE, before playing or right after a run.

  2. Pick a display name or your X handle and press SET ONCE.

    3 to 24 letters, numbers or underscores. The leaderboard shows it instead of your Google name, and it can't be changed later.

  3. From then on, every verified run saves to the public leaderboard automatically.

  4. Press SHARE RESULT, then SHARE ON X.

    A post opens with your time and a homebrew.build link that shows your card in the post. COPY IMAGE and DOWNLOAD PNG are there too.

A result card: Homebrew VR WebLink, Hard 4–3–2–1 cup stack, best time 0:21.924, player @player, homebrew.build/sim
RESULT CARDWhat SHARE ON X shows in your post. The card is public at its share link with your display name, time and rank; your email and Google name stay private.

PRIVACY

Your data

IN SHORT

We record your runs to check times for the leaderboard. We may also use them, labelled as sim data, in robot learning research.

Read the full policy

SIMULATOR DATA NOTICE

Completed runs are recorded.

The PC shows this before the control room opens on your first visit. It covers simulator state, Quest motion and controls, cup motion, task timing and technical diagnostics for every completed stack, used to verify scores and possibly to develop and evaluate future robot models. Simulation data only.

We also log which setup steps each browser tab reaches (visit, control room, pairing, runs, sign-in) to see where players get stuck. Signed in, the PC panel has DELETE PUBLIC SCORES and DELETE ACCOUNT.

TROUBLESHOOTING

If something's wrong

ProblemFix
Headset says "That PC room is not available."Codes last about an hour, and refreshing or closing the PC tab makes a new one. Use the code the PC shows right now.
Headset says "That PC already has a Quest connected."One headset per PC. Exit VR on the other headset, or refresh the PC page for a new code.
Pairing hangs or the link is laggyTurn off any VPN. Same Wi-Fi works best; other networks connect through a relay (the PC shows RELAY) and may add lag.
Dark screen after ENTER VRNormal for a moment while the headset switches to VR, then CONNECTING shows until the video arrives. Give it about 10 seconds. If it doesn't clear, check the PC tab is on screen, exit VR and enter the code again.
ENTER VR reads HTTPS REQUIRED, WEBXR UNAVAILABLE or HEADSET NOT FOUNDOpen homebrew.build/sim in the Quest's built-in Browser app, not on a phone or PC.
FINDING CONTROLLERS or RIGHT CONTROLLER NOT TRACKEDHold both controllers in front of the headset, then press A or X.
CONTROL LINK NOT READY, HEADSET TRACKING NOT READY or CALIBRATION FAILEDWait for the robot's video to appear, then press A or X again.
Arms feel short, offset or drunkYou calibrated seated or with raised arms. Stand, arms at your sides, look ahead, press A or X.
Video frozenThe PC tab is minimized or hidden behind another tab. Bring it back to the front; the clock keeps running meanwhile.
A cup won't stickBring the hand closer: the magnet only grabs within about 11 cm. After a finished run, press RESET first.
Clock won't stopLet go of every cup. Check each cup is upright and each row is centred, then hold still for 2 seconds.
My time isn't on the leaderboardSign in with Google and set your display name. Without an account your runs stay off the public board.
Kicked back to the code screenExiting VR drops the pairing. The headset asks for a new code, but the PC room stays open: type the same code again.

RESET BUTTONS ON THE PC

RESET POSE

Resets the robot, cups and clock. Then press A or X in VR to calibrate.

RECENTER VIEW

Resets the PC's 3D camera, which is also the headset's third-person view.

RESET + RECALIBRATE

For short or offset arms. Keeps the cups; press A or X in VR when ready.

RESET CUP STACK

Starts the cups over, same as RESET in VR.

END SESSION

Ends the session on both devices.