Meta Quest Hand Tracking Upgrades Explained

Yes, Meta has significantly upgraded hand tracking on Quest headsets since it first launched in 2019, with major improvements arriving in 2023 and 2024. The current version (as of late 2024) is far more robust, faster, and supports more gestures and interactions than the original release. Here is a detailed look at what has changed, how it works, and what you can expect.

Background: From Experimental to Core Feature

Hand tracking first appeared on the Oculus Quest in 2019 as an experimental feature. It allowed basic pointing and clicking but was slow, unreliable in low light, and stopped working whenever your hands moved outside the camera’s field of view. Many users dismissed it as a gimmick.

Over the next few years, Meta incrementally improved the technology. The Quest 2 received updates that improved speed and added gesture support. However, the real leap came with the Quest 3 in late 2023, which introduced a new depth sensor and higher-resolution cameras. This hardware, combined with a completely rewritten hand-tracking engine, made hand tracking feel like a first-class input method rather than a fallback.

In early 2024, Meta released a major software update (v62) that brought the improved hand tracking to the Quest 2 and Quest Pro as well, narrowing the gap between the hardware generations. The company has continued to refine it since, focusing on reducing latency and improving accuracy during fast movements.

How the Current Hand Tracking Works

The system uses the headset’s outward-facing cameras to capture infrared images of your hands. A neural network running on the headset’s processor analyzes these images in real time, identifying 21 key points on each hand (joints and fingertips). It then reconstructs a 3D skeletal model of your hands and tracks its position and orientation in space.

Key improvements in the current version include:

• Lower latency: The time between your hand moving and the virtual hand moving has been reduced from roughly 100ms to under 30ms on Quest 3, making interactions feel immediate.
• Better occlusion handling: The system can now briefly keep tracking a hand even when it’s partially hidden behind the other hand or an object, using predictive motion models.
• Improved gesture recognition: It can distinguish between more subtle gestures, such as a pinch, a point, a grab, and a thumbs-up, with higher reliability.
• Adaptive lighting: The software automatically adjusts to low-light and bright-light conditions better than before, though very dim or very bright environments still cause issues.
• Faster hand reacquisition: When your hands leave the camera view and come back, the system reacquires them almost instantly, rather than making you wait.

What’s New in the 2024 Updates

The most notable recent upgrade came with the v62 software update in early 2024. This update introduced a new hand-tracking model that Meta claims is more accurate and requires less processing power. This freed up resources for other tasks, improving overall system performance.

One of the most user-visible changes was the addition of hand tracking in the main menu and system UI. Previously, you had to switch to controllers to navigate menus reliably. Now, you can pinch to select, grab and drag windows, and even type on the virtual keyboard with your hands. The keyboard still requires a deliberate “pecking” motion, but it’s usable.

Another significant addition is hand tracking for passthrough. In mixed reality apps, you can now see your real hands rendered as virtual hands or as a simple outline, which helps with depth perception and reduces the weirdness of seeing your real hands floating in a virtual world. This was a major request from developers.

How to Enable and Use Hand Tracking

Hand tracking is not always on by default. Here’s how to set it up on a Quest 2, 3, or Pro:

1. Put on your headset and navigate to Settings (the gear icon in the menu bar).
2. Select Movement Tracking or Hands and Controllers (the exact name varies by software version).
3. Toggle Hand Tracking to On.
4. You can also enable Auto-Switch, which lets the headset automatically switch between controllers and hands depending on which one you’re holding.
5. If you want to use hand tracking in apps that normally require controllers, you may need to enable Hand Tracking in Apps in the same menu. Not all apps support it, but many do.

Once enabled, you can use your hands in any app that supports it. Common gestures include:

• Pinch (thumb and index finger together) to click or select.
• Pinch and hold to grab and drag objects.
• Point with your index finger to hover or aim.
• Make a fist to grab or to use a tool in some apps.
• Thumbs up to confirm or like.

Common Problems and Fixes

Even with the upgrades, hand tracking isn’t perfect. Here are the most common issues and how to address them:

• Hands disappear or jitter: This is usually caused by poor lighting. Make sure the room is well-lit but not directly facing a bright window or lamp. Try turning on more ambient light.
• Tracking stops when hands are close to the headset: The cameras have a minimum focus distance. Try holding your hands slightly farther away (about 10-15 cm from the headset).
• Hands are not detected at all: Check that hand tracking is enabled in Settings. Also, make sure your hands are not covered by long sleeves or gloves that obscure the camera’s view.
• Latency or lag: This can happen if the headset is overheating or if too many apps are running in the background. Close unnecessary apps and let the headset cool down.
• Tracking fails in bright sunlight: The infrared cameras can be overwhelmed by direct sunlight. Move to a shaded area.

Comparison: Quest 3 vs Quest 2 vs Quest Pro

While the software is largely the same, the hardware differences matter:

• Quest 3: Best hand tracking due to its depth sensor and higher-resolution cameras. It handles occlusion and fast movements better than the others.
• Quest Pro: Also has excellent hand tracking, with additional outward-facing cameras that cover a wider vertical field of view. It’s slightly better than Quest 2 but not as good as Quest 3.
• Quest 2: The oldest supported headset. Hand tracking works but is noticeably less accurate and has more latency, especially in low light. It’s still a significant upgrade from the original Quest.

Frequently Asked Questions

Can I use hand tracking in all apps?

No. App developers must explicitly enable hand tracking in their apps. Many popular apps like Beat Saber and Population: One still require controllers for good reason (fast, precise input). However, an increasing number of apps, especially social and productivity apps, support hand tracking.

Does hand tracking work with gloves or long sleeves?

It depends. The system tracks the shape of your hands, so anything that significantly changes that shape (like thick gloves) will confuse it. Lightweight fingerless gloves or short sleeves usually work fine. Long sleeves that cover your wrists can sometimes cause issues because the system uses wrist position to help predict hand orientation.

Will hand tracking ever replace controllers?

For casual and productivity tasks, yes, it’s already a viable alternative. For gaming that requires fast, precise, or tactile feedback, controllers are still superior. The lack of physical buttons and haptic feedback is a major limitation for hand tracking. It’s likely that future headsets will support both, letting you switch based on the task.

Why does my hand tracking stop when I put my hands behind my back?

The cameras on the headset only have a certain field of view. If your hands are outside that view (behind you, below your waist, or above your head), the system can’t see them and loses tracking. This is a hardware limitation that can’t be fixed with software alone.

Is hand tracking available on the Quest 1?

No. The Quest 1 received a basic hand tracking update in 2020, but it was experimental and never received the later improvements. Meta stopped supporting the Quest 1 with new features in 2021, and the hand tracking on it is not recommended for regular use.

Does hand tracking work in the dark?

No. The cameras use infrared light, but they still need some ambient light to function. In complete darkness, hand tracking will not work. You need at least a dim light source in the room.

Future Outlook

Meta continues to invest heavily in hand tracking, and it’s a core part of their vision for AR glasses and the metaverse. Expect further improvements in accuracy, speed, and the number of supported gestures. The company is also researching ways to add haptic feedback to hand tracking using ultrasound or wristbands, which would address one of the biggest current limitations. For now, hand tracking on Quest headsets is a solid, usable feature that has come a long way from its experimental roots.

Related

• AirTag Not Updating Location? Fixes That Work
• Slate Truck Fixes Biggest Problem Modern Dashboards?
• Honda vs Toyota: 5 SUVs Dominating Sales Charts?