GTA V and speech technology

[Long_Haired_Boy]

Since Rockstar announced GTA V fans of the franchise have been interested in many aspects of the game, such as a release date, characters, the story and graphics. There is another feature of the game that seems to have been overlooked and that is speech technology, which for some gamers is as important as the graphics themselves.

Having already covered the issue of MotionScan and how it’s more than likely not going to feature in Grand Theft Auto V, there are other ways to make the game more realistic and how the characters face reacts when they are talking will be of great importance to some gamers.

 

 

There is a new technology called Speech Graphics and could be a better system than MotionScan due to that technology requiring less storage space, which is a bigger issue for Xbox 360 users because it would not require as many discs as a game does with MotionScan. The team behind Speech Graphics would be able to work with Rockstar very closely due to the fact they are also based in Edinburgh.

While the technology involved is very complex the idea is not, as their multi-lingual solution uses muscle dynamics and acoustic analysis in order to manipulate a characters face in order for it to match each and every word being spoken.

As yet neither companies have announced any sort of partnership, but according to this article a big developer company and a motion capture studio have begun an integration process. While we have no information as to what companies these are, it’s a strong bet that the triple-A developer mentioned could be Rockstar Games – what do you think?

We hope to hear more about this and other aspects of GTA V next month during the Game Developers Conference 2012, as Speech Graphics will be showcasing their technology and if Rockstar is involved it shows they are trying to stay one-step ahead of the competition.

Looking at the video of the technology in action below it’s easy to see the benefits this would have in a game, along with being less data intensive, but we cannot help thinking the facial expressions still needs some work. The details in the movement of the mouth, muscles and lower part of the face are spot on, but we have noticed how expressionless the upper part of the face is such as the eyes and forehead, which are important when it comes to determining the emotions of a person.

 

Let’s say this technology were to be implemented into GTA V then more work needs to be done or we could have emotionless characters running around. If we are to believe that Grand Theft Auto V will still be out this year then Speech Graphics and Rockstar has to be much further into this partnership than we think – if they are the developer of course.

 

 

 

 

 

 

 

http://www.inentertainment.co.uk/20120211/...ech-technology/

 

 

What you guys think?

Edited February 12, 2012 by Long_Haired_Boy

[Jeeebuuus]

Pretty good. I would like to see the whole face being expressive but the mouth area looks pretty life like while talking. Whatever they end up going with I'm sure it will be in the spirit of GTA and nicely done.

[Samsuxx]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

[senor_huevos_benedicto]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

[SGT. Johnson]

This is interesting, as why would Rockstar need to focus so much emphasis on facial technology, other than to improve on their originals?

[GtaVComments]

Since Rockstar announced GTA V fans of the franchise have been interested in many aspects of the game, such as a release date, characters, the story and graphics. There is another feature of the game that seems to have been overlooked and that is speech technology, which for some gamers is as important as the graphics themselves.

Having already covered the issue of MotionScan and how it’s more than likely not going to feature in Grand Theft Auto V, there are other ways to make the game more realistic and how the characters face reacts when they are talking will be of great importance to some gamers.

 

 

There is a new technology called Speech Graphics and could be a better system than MotionScan due to that technology requiring less storage space, which is a bigger issue for Xbox 360 users because it would not require as many discs as a game does with MotionScan. The team behind Speech Graphics would be able to work with Rockstar very closely due to the fact they are also based in Edinburgh.

While the technology involved is very complex the idea is not, as their multi-lingual solution uses muscle dynamics and acoustic analysis in order to manipulate a characters face in order for it to match each and every word being spoken.

As yet neither companies have announced any sort of partnership, but according to this article a big developer company and a motion capture studio have begun an integration process. While we have no information as to what companies these are, it’s a strong bet that the triple-A developer mentioned could be Rockstar Games – what do you think?

We hope to hear more about this and other aspects of GTA V next month during the Game Developers Conference 2012, as Speech Graphics will be showcasing their technology and if Rockstar is involved it shows they are trying to stay one-step ahead of the competition.

Looking at the video of the technology in action below it’s easy to see the benefits this would have in a game, along with being less data intensive, but we cannot help thinking the facial expressions still needs some work. The details in the movement of the mouth, muscles and lower part of the face are spot on, but we have noticed how expressionless the upper part of the face is such as the eyes and forehead, which are important when it comes to determining the emotions of a person.

 

Let’s say this technology were to be implemented into GTA V then more work needs to be done or we could have emotionless characters running around. If we are to believe that Grand Theft Auto V will still be out this year then Speech Graphics and Rockstar has to be much further into this partnership than we think – if they are the developer of course.

 

 

 

 

<iframe width="420" height="315" src="http://www.youtube.com/embed/oySSgNfrfF8" frameborder="0" allowfullscreen></iframe>

 

 

http://www.inentertainment.co.uk/20120211/...ech-technology/

 

 

What you guys think?

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he shouldve used the search function. Serously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

[meson1]

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he should've used the search function. Seriously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

No. Your thread was talking about some "Screen Graphic Technology." Didn't make a lot of sense really. Didn't pay it much attention.

[Long_Haired_Boy]

Anyone thinks this maybe true. Im thinking about what HHG said on his show.

 

 

[boogachamp]

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he shouldve used the search function. Serously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

Thats what you get for citing your source. You should have just blatantly stole the igtav post like the OP did

[Long_Haired_Boy]

Yelp. Could anyone post the video?

[Snake Without a Tongue]

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he shouldve used the search function. Serously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

LOL I was thinking the same thing. This is the most assbackward forum I've ever seen. I love it, but it is so unintentionally funny sometimes.

[Gtaghost22]

I dont know what is the technology used in Uncharted 2,3 !! But the Facial animations are really good.. Better than La Noire to be honest... The facial animations in La Noire was alttle bit too realistic to be in a video game!! It looked quite ackward.. So i want GTA V to have Facial animations like the ones used in Uncharted 1, 2, 3 ..they are the best facial animation in any game to date

[Death2Drugs]

GTA V definitely needs some sort of speech technology. It would make the game look a lot better.

[aaronimpact]

I hope they don't tweak facial animations too much. I liked how the characters looked in GTA IV, not too cartoonish looking and not too realistic looking like LA Noire.

[D.Dodge]

Bitch please, the Source engine was able to do this 9 years ago:

[TheGodDamnMaster]

To be honest, I was perfectly content with, and enjoyed, the facial animation and mo-cap system from GTA IV.

[Magic_Al]

For major story cutscenes there's no substitute for having a full motion capture and facial performance capture by actors. This technology is just better lipsyncing for when they don't have that. There are a lot of minor cutscenes and scripted moments in GTA where, due to budget or schedule, all they've got is the actor's audio, and the character models are made to lipsync and move using stock animations such as various "peds conversing" hand gestures. Rockstar's not going to close their mocap studio because of this technology.

[Long_Haired_Boy]

How do you know if they are not using this in MP3?

 

I hope GTA V cut scenes will be as good as MP3.

[senor_huevos_benedicto]

The Max Payne graphics would do me just fine.

 

One thing I hated in GTA IV was those mini-cutscenes during the mission, where everyone would move their mouths like a Canadian on South Park - we need lip syncing for all dialogue.

[Snake Without a Tongue]

 

 

One thing I hated in GTA IV was those mini-cutscenes during the mission, where everyone would move their mouths like a Canadian on South Park - we need lip syncing for all dialogue.

 

 

There are a lot of minor cutscenes and scripted moments in GTA where, due to budget or schedule, all they've got is the actor's audio, and the character models are made to lipsync and move using stock animations such as various "peds conversing" hand gestures. Rockstar's not going to close their mocap studio because of this technology.

 

LOL Yeah, I hated that, too. The random gesticulating and such. They put all the prerendered stuff at the front of the game and a little at the end. In between they subbed with in-game models. Stood out like a sore thumb.

[Johnny Playert]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

What??? Was that on X360 then? Faces have never looked better (not just the expressions) in any game imo... even though a lot of male characters looked alike (bad casting though)

[senor_huevos_benedicto]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

What??? Was that on X360 then? Faces have never looked better (not just the expressions) in any game imo... even though a lot of male characters looked alike (bad casting though)

No, I only have a PS3.

 

Maybe I should clarify - people's mouths were blurry.

[Johnny Playert]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

What??? Was that on X360 then? Faces have never looked better (not just the expressions) in any game imo... even though a lot of male characters looked alike (bad casting though)

No, I only have a PS3.

 

Maybe I should clarify - people's mouths were blurry.

Oh ok, could be, i surely never noticed it though.

The eyes, brows, texture, everything was gorgeous.

[senor_huevos_benedicto]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

What??? Was that on X360 then? Faces have never looked better (not just the expressions) in any game imo... even though a lot of male characters looked alike (bad casting though)

No, I only have a PS3.

 

Maybe I should clarify - people's mouths were blurry.

Oh ok, could be, i surely never noticed it though.

The eyes, brows, texture, everything was gorgeous.

For sure - any game in which I can see a character's Adam's apple move is a special one.

[Johnny Playert]

I didnt like Motion Scan that much. Yeah, the emotions looked fine but the face itself looked somehow squishy and unrealistic. I prefered the technique used Uncharted. The faces looked really great and realistic. But I go also fine with the faces from RDR, they were very detailed, too.

Yeah I agree that the Uncharted faces look better than LA Noire's, which looked quite...blurry.

What??? Was that on X360 then? Faces have never looked better (not just the expressions) in any game imo... even though a lot of male characters looked alike (bad casting though)

No, I only have a PS3.

 

Maybe I should clarify - people's mouths were blurry.

Oh ok, could be, i surely never noticed it though.

The eyes, brows, texture, everything was gorgeous.

For sure - any game in which I can see a character's Adam's apple move is a special one.

[jmb180]

 

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he shouldve used the search function. Serously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

Thats what you get for citing your source. You should have just blatantly stole the igtav post like the OP did

Agreed. Don't know why ppl howl when other sites rip off gtaforums' original content (perfect example: the mapping Los Santos thread), but then wantonly plagiarise other sites like igta5 without giving 'em any credit.

Edited February 12, 2012 by jmb180

[Long_Haired_Boy]

WTF? I posted this topic yesterday with some of you saying lock it, and now this guy makes it and its ok? Even though its already been talked about and he shouldve used the search function. Serously wtf is wrong with some of you unbelievable. Lock This IF ANYTHING!!!

Thats what you get for citing your source. You should have just blatantly stole the igtav post like the OP did

Agreed. Don't know why ppl howl when other sites rip off gtaforums' original content (perfect example: the mapping Los Santos thread), but then wantonly plagiarise other sites like igta5 without giving 'em any credit.

Nothing new under the sun. I solved the Genesis topic do you see me crying about it?