Skip to main content

Camera Tracking

Camera tracking in Vū Studio lets you achieve realistic parallax on your LED wall using a mobile phone as a tracking device. The system uses a 2.5D depth-extruded image and your phone's motion sensors to shift the background perspective in real time as the camera moves.

How It Works​

Vū Studio generates a 3D depth map from a 2D image. Your phone — mounted to the camera — continuously transmits its position and orientation to the Vū Media Server software over the network. The Vū Media Server uses that data to shift the background perspective, creating convincing parallax that matches the camera's point of view.

Network requirement

Camera tracking requires a stable internet connection. The phone sends thousands of data points per second to the Vū Media Server software in real time. Any network instability will reduce tracking accuracy.

Setup​

Step 1 — Display a 2D image​

Select a still image from your library and display it on your LED wall. If you're new to displaying content, see Displaying Content →.

Step 2 — Generate the depth map​

With the image displayed, tap the 3D button below the image in the Vū Studio control panel. This triggers the AI depth map generation — it may take a few moments to complete.

Step 3 — Adjust depth extrusion​

Once the depth map is ready, scroll down in the settings panel to Depth Extrusion and use the slider to set how much depth separation you want between foreground and background layers.

Step 4 — Open VS Cam Track​

Scroll back to the top of the remote control panel and tap Use Camera Tracking. This opens the VS Cam Track app, which is supported on both iOS and Android.

If the app doesn't open automatically, open it manually on your phone and enter your Wall ID (found in Vū Studio Settings), then tap Connect to Vū.

Step 5 — Calibrate​

  1. Stand centered in front of your LED wall, approximately half the wall's width away. For example, for a 20-foot wide wall, stand about 10 feet back.
  2. Hold the phone at chest height with the camera pointed at the screen.
  3. Tap Begin Tracking.

Your phone's position is now being transmitted to the Vū Media Server software continuously.

Step 6 — Mount and shoot​

For a real production shoot, mount the mobile device to your camera. The phone's movement mirrors the camera's movement, and the background shifts accordingly to create parallax.

Recalibrating​

If the parallax starts to feel off or becomes unresponsive:

  1. Tap Exit Tracking on the phone
  2. Re-run the calibration from Step 5

Tips​

  • The further back you stand during calibration, the more subtle the parallax effect will be at that distance
  • For maximum parallax effect, use images with clear foreground and background separation
  • Avoid repositioning the wall or drastically changing the camera angle after calibrating — recalibrate if you do