[games_access] Toolkits for making GL rendered content screen reader accessible?

[Ian Hamilton]

Not at all unfortunately, games have more diverse ranges of typefaces and typography than most other media, which is an accessibility issue in itself, for people who have difficulty reading.. e.g. a tiny bespokely made ornate fantasy font in full caps.

It's something that could/should be done just a single time by the engine developer. That way it should just work like native iOS app development.. the UI accessibility mostly just works (e.g. the accidental blind accessibility here, just from having logically named UI elements), all that's left for game developers is just a bit of tweaking, which is a much more realistic ask than the current option of dumping your engine and starting again from scratch.

No articles about the BBC tests beyond a little bit that I wrote here -

http://ian-hamilton.com/screenreaders-and-game-engines/

It's just that simple of thing of one layer being CPU and one being GPU, which kills the idea due to the tiny bus width on mobiles. It's fine as a hacky workaround for games that have static visuals so can happily run at 2fps, but many games don't work with that.

Again things like that and TOLK are just hacky workarounds to try and substitute for work that game engines should have taken care of themselves, game engines are where the issue lies.

It isn't an issue that's unique to game development, you see the same thing anywhere where frameworks are used. But because there are a small range of popular ones in gamedev it would be very easy to make a difference, particularly as the vast majority of games that have a mechanic suited to screenreader accessibility are made in Unity anyway. Just Unity fixing it would make a staggering difference.

Ian

________________________________
From: games_access <games_access-bounces at igda.org> on behalf of Brandon Keith Biggs <brandonkeithbiggs at gmail.com>
Sent: 13 January 2017 15:19
To: IGDA Games Accessibility SIG Mailing List
Subject: Re: [games_access] Toolkits for making GL rendered content screen reader accessible?

Hello,
Are most games using a limited number of typeface and fonts?
If so, one could just tell an OCR engine that this is A, this is B and whatnot. It would probably be more accurate than current OCR. Also, most players have more free time to create an accessibility layer than the game devs do. anything that would take the work and give it to the non technical community would be more than worth it.

Do you have any articles or talks about the BBC Unity accessibility experience? I really want to learn as much as possible about what they did, what worked, what didn't work and whatnot. I would also love to reference their case in a paper I am writing.
Thanks,


Brandon Keith Biggs<http://brandonkeithbiggs.com/>

On Fri, Jan 13, 2017 at 6:47 AM, Ian Hamilton <i_h at hotmail.com<mailto:i_h at hotmail.com>> wrote:

Yes, BBC tried it, didn't work sadly!


Reason being that the layer is rendered by the CPU and the visual by the GPU, and mobiles only have a tiny bus width, so constantly switching between the two layers do to the updates caused framerates to slow to an unplayable crawl. So BBC just put an end to developing with Unity for cross platform web games and use HTML5 instead.

For PC you can use Tolk, Skullgirls managed to get it working nicely for their UI. It still needs to be actively integrated by a developer, it only outputs what is passed out to it so is still far more work than it should be, involving focus management and passing the info out to all be handled at a game developer level, and doesn't work with all screenreaders or cross-platform either. But it's something at least. That's about as good as it gets for now, until if/when engine devs integrate something like it internally.

https://davykager.com/projects/tolk/

I don't think OCR would have much chance of working with most games due to the kind of typefaces and typography used, but most of the text, text strings for copy and text labels for UI elements, is already there inside the game anyway. Just (just..) need the engine devs to implement a way of exposing it.

That's easily my top thing I'd like to see happen in accessibility, such a frustrating barrier.

Ian

________________________________
From: games_access <games_access-bounces at igda.org<mailto:games_access-bounces at igda.org>> on behalf of Brandon Keith Biggs <brandonkeithbiggs at gmail.com<mailto:brandonkeithbiggs at gmail.com>>
Sent: 13 January 2017 14:20
To: IGDA Games Accessibility SIG Mailing List
Subject: [games_access] Toolkits for making GL rendered content screen reader accessible?

Hello,
I am wondering what research or work has been done on making GL rendered content accessible to screen reader users?
Ian was mentioning on the Unity Screen reader accessibility thread:
https://feedback.unity3d.com/suggestions/screen-reader-accessibility
That Apple had an idea to replicate the UI above the app, but I can't find any information about this at all. Are there any articles or papers on Apple's trial? Was this invisible UI ever tried on the PC?

I think that a layer like this would be very useful, especially if the application had some sort of image or character recognition to present new content to the screen reader.
Are there any other applications or companies who have made (or tried to make) any programs to add accessibility to prebuilt apps and particularly GL rendered apps and games?
Thanks,

Brandon Keith Biggs<http://brandonkeithbiggs.com/>

_______________________________________________
games_access mailing list
games_access at igda.org<mailto:games_access at igda.org>
https://pairlist7.pair.net/mailman/listinfo/games_access
The main SIG website page is http://igda-gasig.org


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist7.pair.net/pipermail/games_access/attachments/20170113/bf215e8f/attachment.htm>