Project Natal

Project Natal is the code name for a "controller-free gaming and entertainment experience" by Microsoft for the Xbox 360 video game platform. Based on an add-on peripheral for the Xbox 360 console, Project Natal enables users to control and interact with the Xbox 360 without the need to touch a game controller, through gestures, spoken commands, or presented objects and images. The project is aimed at broadening the Xbox 360's audience beyond its typically hardcore base. Project Natal was first announced on June 1 at the 2009 E3 Convention. Microsoft said that over 1000 devolpment kits began shipping to game developers that same day. Microsoft has not revealed any price or release date projections for Project Natal, though several observers expect the control system to be released in late 2010.

An approximately nine-inch (23 cm) wide horizontal bar connected to a small circular base with a ball joint pivot, the Project Natal sensor is designed to be positioned lengthwise above or below the video display. The device features an RGB camera, depth sensor, multi-array microphone, and custom processor running proprietary software, which provides full-body 3D motion capture, facial recognition, and voice recognition capabilities. The Project Natal sensor's microphone array enables the Xbox 360 to conduct acoustic source localization and ambient noise suppression, allowing for things such as headset-free party chat over Xbox Live.

The depth sensor consists of an infrared projector combined with a monochrome CMOS sensor, and allows the Project Natal sensor to see in 3D under any ambient light conditions. The active depth-sensing range of the depth sensor is adjustable, with the Project Natal software capable of automatically calibrating the sensor based on the gameplay and environment conditions, such as the presence of couches.

Project Natal is reportedly based on software technology developed internally by Microsoft and hardware intellectual property acquired by time-of-flight camera developer 3DV Systems. Before agreeing to sell all its assets in March 2009, 3DV had been preparing a similar device, known as the ZCam.

Described by Microsoft personnel as the primary innovation of Project Natal, the software technology enables advanced gesture recognition, facial recognition, and voice recognition.The skeletal mapping technology shown at E3 2009 was capable of simultaneously tracking multiple users for motion analysis, with a real-time extraction of 48 interest points for each human body.Depending on a user's distance from the sensor, Project Natal is capable of tracking models that can identify individual fingers.