E3 2009: Microsoft unveils motion-sensing camera

360 News | It's called Project Natal.

Microsoft's 2009 E3 press conference has confirmed the existence of the much-rumoured Xbox 360 motion-sensing camera, with Microsoft calling it Project Natal.

It's not just a camera, either. It is also capable of voice and facial recognition, and resembles the Wii sensor bar, and will be compatible with every Xbox 360 ever sold.

The conference featured a video showcasing various people using the controller, such as a family steering a controller from the couch by leaning, people kicking imaginary soccer balls and a boy jumping on an imaginary skateboard. Menus can even be navigated with hand gestures.

Microsoft boss Don Mattrick and Hollywood director Steven Spielberg unveiled the new control scheme, with Mattrick stating that "It's not about reinventing the wheel, it's about no wheel at all."

Kudo Tsunoda, the Project Leader for Natal, demonstrated the device's abilities with Ricochet, a tech demo using the Unreal Engine 3, and a paint-type game. All mentions he made were replicated by his on-screen avatar.

According to Microsoft, Natal is the first device to combine an RGB camera, depth sensor, multi-array microphone and custom processor into one tiny little package, allowing it to fully track player movement in 3D. Impressive.

"The next step in interactive entertainment is to make the controller disappear," said Spielberg. "With Project Natal, we’ll see games that bring everyone together through technology that actually recognizes us."

As of yet, no specific games have been confirmed. Both Spielberg and Molyneux confirmed that they had teams working on some software, but with most developers having not yet received a development kit, it might be a while before we are enjoying Project Natal in our homes.

More details as they surface.

Related Content

E3 2009: Microsoft Conference Liveblog
01 Jun, 2009 Project Natal, Metal Gear Solid: Rising, Alan Wake, Forza 3, Beatles Rock Band.

E3 2007: Buzz! comments on Scene It?
12 Jul, 2007 Scene It? More like, Copied It?

Project Sylpheed and Vampire Rain being translated
03 Apr, 2007 Kill vampires or shoot ships. Your choice.

PagePrevious 12

46 Comments

G3ck0

2 years ago

Sin Ogaris wrote

Benza wrote

If it works as advertised, judging from that skateboard bit in the ad, it makes Tony Hawks ride kind of redundant, on 360 at least.

Must piss off activision.

That's what I'm thinking, although it'd be pretty damn hard to pull off a nollie 360 flip without something under you as a guide.

Peter Molyneaux gives this thing some hope, either that or a lot of failed expectations but hey, at least ONE developer is on board.

I don't see how that "game" could work though. Surely he couldn't respond to everything you say...

Namarrgon

2 years ago

@A13X: The IR cam doesn't use light fall-off, that's too easily confused by surfaces with different albedo. Google "3dv zcam" - it uses reflection timing to estimate depth per pixel, then it outputs a greyscale depthmap as in your render.

hkdrift

2 years ago

its just the next step forward for gaming. microsoft will be desparate to release this as their hardcore demographic market share is being quickly eroded by ps3. remember that although they have sold ~7 million consoles than ps3, they had a 1 year headstart.

the most interesting thing outta this all will be how ninty approaches their next console since they've absolutely spanked the competition and left them all in its wake!

can they keep it up by continually innovating by bringing something completely new to the table or will they become complacent, keep releasing half-baked motion-sensing remakes and let the competition overtake them in the transition stage to the next-gen class of consoles ala sony ps2.

Benza

2 years ago

hkdrift wrote

the most interesting thing outta this all will be how ninty approaches their next console since they've absolutely spanked the competition and left them all in its wake!

Honestly, why would Nintendo even release a new console? There main audience doesn’t give a **** about HD graphics and processing power, the consoles are still selling **** and there games are making ridiculous amounts of money.

From a financial point of view making a new console and splitting there market seems like a really dumb option when they could make a new add on (Some camera system to compete with PS3 Eye and this Natal thing?) wack it onto there Wii and bobs your uncle, they sell another 500 billion add ons and go back home to swim in there money pit while snorting crack cocain out of the arse of a 12 year old boy.

Maybe a Wii slim or something, but the Wii is pretty slim already so yeah, I think the Wii has a far better chance of a 10 year life span then say the PS3 or the 360. Simply because the target audience just, doesn’t give a ****.

ArcherGrave

2 years ago

Microsoft PWND sony and nintendo

Sony Released EYETOY then Motion ControllerFail
Nintendo based On motion Controller

Microsoft decided to knock them both out with one big ball and it looks like they might of succeeded.

If it really is like in the trailer then its the future

, how awesome was that hand signal they were using to pick a movie ? AWESOME.

I like

waz79

2 years ago

KEY to this being a joke -http://www.youtube.com/watch?v=oACt9R9z37U

Disclaimer at the start of the video says - Product Vision: Actual Features and Functionality may vary

So basically its not real, its a product vision, whatever the hell that means.

LeonJ

2 years ago

Pretty impressed. But with most motion type apps, normally it looks much better in the trailer...

Benza

2 years ago

waz79 wrote

It means that it's not real yet, and is basicly the equivilent of a target render. Considering that as far as I can tell Lionhead are the only people with dev kits for the stuff they would only have pretty simle tech demos to show at the moment wich isn't really the way to sell your product to people who don't know much about games (IE the casuals they're targeting)

stave

2 years ago

Will this come bundled with the new Leisure suit Larry game?

Sin Ogaris

2 years ago

You just put the most horrid image in my head, some 300 kilo dude simulating sex with an imaginary character all the while watching himself on a tv screen.

Mush Man

2 years ago

And Microsoft's share price rose...

All I can say is that this'll be interesting, like On Live was when it was announced.

Also, A13x, nice render.

Did you use Blender or something for that?

Lord Haart

2 years ago

If this works as well as in the video, I will never leave the lounge room.

If nothing else, flicking between items like the dude in Minority Report is exactly what computer interfacing should be like in the future.

Of course, the proof is in the pudding, and all we've seen so far is one they've prepared earlier.

/nthony

2 years ago

I would have thought that Peter Molyneaux's reputation for overhyping stuff would have been brought up by now. His tech demo would have been very impressive if it werent for the fact that I couldnt believe any of it.

I did see some pretty neat potential for the microphone though. Imagine in Mass Effect or Dragon Age. Instead of reading what you are going to say and selecting it via a menu. You just have the options written at the bottom of the screen and read out loud the line you want. It would be tremendously immersive, particularly coupled with the cut scenes expected.

Granted, thats if voice recognition will work. I once had a PDA with voice activation set up as a universal remote. I could very easily say "TV on" and the TV would switch on. But doing anything else didnt work because once it was on, there was too much noise for the PDA to detect my voice. Not sure how specialised equipment will fair.

kartanym

2 years ago

Certainly agree with the voice recognition. That alone could be the catalyst for new game designs aka the Wii, if done correctly of course. At least it has the potential to be something different, which I applaud, but I'm cautiously optimistic about the outcome in a year (or more likely two years) time.

macca macca

2 years ago

It just seems like another attempt to bit into Nintendo's market. The mere fact that you don't have anything in your hand (unlike the wiimote), will maker this fail. No one wants to sit there waving their arms and talking to the tv.

Phreakuency

2 years ago

Scene It and Lips haven't sold 1/10th of Buzz or Singstar...

I'm not bitter at all. I'll buy any console and any game, spoil myself because I make enough money too and because I love games.

I just think this motion crap is stupid and MS are wasting their time with it.

Sin Ogaris

2 years ago

I already wave my arms and talk to the tv, although generally in frustration. It'd be a welcome change if my abuse actually sinks in.

Crank

2 years ago

I think this could be a really interesting way to compliment current controllers and not necessarily replace them outright.

For example, in an FPS, the camera could track your head movements, to control where your character is looking. You could gesture to throw a grenade, melee or open a door. Meanwhile, the controller would control movement, shooting and so on. And it could be customisable, to give different levels of control, depending on how lazy you are.

RTS on console would also be awesome with this new device. A combination of gestures and voice commands is just about perfect for this style of game.

And sledging people in multiplayer could take on whole new levels... or rather, depths.

EXC355UM

2 years ago

Can you imagine trying to play Street Fighter4 with the Natal Project?...
Man its harder then it looks!! =P

http://www.youtube.com/watch?v=-_nNkiPbRik

=[

Sin Ogaris

2 years ago

Crank wrote

I hope to God that no developer ever thinks that this is a good idea, think about it, if you have to turn your head to turn the character... how are you going to see the screen? Even little movements would become a major burden after a while.

Aussie XP

2 years ago

When i first saw this I thought, [/i]great, another gimmicky motion controlling device, then I started to look at what it actually does, including the Milo demo, and the sort of technology they are using and I realised just how amazing this thing really is.

I dont think its really hit alot of people at just how revolutionary this technology can be for the 360 (maybe not right now, but in a few years time). This isnt just a motion camera, they've been working on this thing (according to Lionhead) since 2001.

Sure, it will appeal to the casual market, but theres so many other directions this thing can go. The Milo demo was just a taste to demonstrate what is possible...it reads your emotions, it knows exactly what you are saying, not just picking up keywords. Imagine commanding a squad in detail by actually speaking to them instead of just "attack" "cover" "defend".

It might only be in its primitive stages now, but I guarantee you this thing will pave the way for amazing mindblowing gameplay if not on the 360, then in the next generation of consoles.

Crank

2 years ago

Sin Ogaris wrote

But like I said, it could be customised, depending on how much you want to use it. And like Motion Plus, they could dial it down so that it doesn't pick up every little twitch.

And I didn't mean that your whole character would turn, just where they are looking. Tilt you head upwards slightly, the characters 'eyes' would follow yours. You could turn the actual character with the controller itself. Done right, I think it could be incredibly immersive.

PagePrevious 12

View as forum topic

Add Comment