[games_access] Semi-OT... ??

[AudioGames.net]

*Quote*
it suggested that the service would be used for all online gamers while they are using this technology while they are playing a game translate to other gamers online possibly?  To me that would be very invasive and not private having a third-party some person we don't know who visually telling the other person what we're seeing are doing in the game 
*Quote end*

What I meant was this: instead of using 'just' on-screen text to let the player know what a certain character is saying , you could port the text (which is there in the subtitles anyway) to a plugin/HUD element such as VSign which would then translate the text automatically to an animation of a 3D character doing sign language. So there's no 3rd party person visually telling someone what's there to hear... it's a 3D character sign-languaging the speech....

Here's a quick sketch of what I mean: http://kmt.hku.nl/~richard/gdc/vsigngames/vsigningames.gif
On the left is the "regular" SpeechToText subtitles in the HUD, while on the right is an animation of the character doing the SpeechToSign Language (I've added some text so you know what he means ;). 

But what you immediately can see in this example is that in a fighting game like this, sign language might turn out to be pretty useless. You are watching the game (I've added some "visual captioning" á la Batman as well for dramatic accessible effect) on the left and so you miss the info on the right. Text usually remains on screen for some period of time, giving you the chance to start reading a while after it appeared on screen. While you need to follow the sign language from the beginning otherwise you'll have missed it. 

So sign language is probably more useful in games with "slower" gameplay or where you can easily replay the message (adventure genre would be great I think).

Greets,

Richard





  ----- Original Message ----- 
  From: Robert Florio 
  To: games_access at igda.org 
  Sent: Thursday, April 13, 2006 7:03 PM
  Subject: [games_access] Semi-OT... ??


  Mentioning using the technology of video phone translators for emotional translation translating emotions in the voice with sign language in a videogame is very interesting.  Is it suggested that the service would be used for all online gamers while they are using this technology while they are playing a game translate to other gamers online possibly?  To me that would be very invasive and not private having a third-party some person we don't know who visually telling the other person what we're seeing are doing in the game but the link Richard gave for a virtual sign language person I think could definitely be implemented.  Perhaps creating a mode of animation for the death were all the characters are sign language into each other and the camera angles would have to pick up their hand motion that would eliminate the text on the screen may be a different approach than has been done before but it is a lot of animation however ritual gloves could be used to track that motion and simply motion tracking that into the animation.  A lot of extra work creating a second animation sequence for videogames unless it's just tied in as part of how the people in the game such as the characters communicate.
  Robert
  http://www.wired.com/news/technology/0,70585-0.html

  http://www.vsign.nl/EN/vsignEN.htm

  AI online SGA President

  arthit73 at cablespeed.com

  www.RobertFlorio.com



------------------------------------------------------------------------------


  _______________________________________________
  games_access mailing list
  games_access at igda.org
  http://seven.pairlist.net/mailman/listinfo/games_access
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist7.pair.net/pipermail/games_access/attachments/20060413/c38f66ff/attachment.htm>