Microsoft’s Seeing AI app uses artificial intelligence to narrate the world for visually impaired

Posted 12 July 2017 18:07 CEST by Jan Willem Aldershoff

Microsoft has released Seeing AI, an app targeted at visually impaired that is able to provide information about the world around the user. It uses artificial intelligence to describe people, text and objects through the iPhone camera.

“A free app that narrates the world around you. Designed for the low vision community, this research project harnesses the power of AI to describe people, text and objects,” Microsoft writes about the app. With the app the iPhone camera is used to watch what’s around which is then described by a voice.

The app can be used in several different situations. Seeing AI recognizes people it has seen before and can tell more about household products by scanning the barcode. It’s also able to speak out text, to describe the scene around an user and to identify currency bills.

To recognize objects and persons, the app uses neural networks. The most important calculations are performed on the phone, so Seeing AI can also be used without an internet connection. Experimental features, such as describing the scene around the user, requires a connection to the cloud.

Seeing AI is currently only available for American Apple users. settings

Several settings at can be changed, they are stored in cookies, which means they will be reset if you clear cookies


Change the background to a plain color or trianglified image (similar to the default image)

No tracking features

At Myce most social media feature are done server side and impose no privacy risk to the visitor when not used. Several features use Javascript with you can turn off here


Switch to the List layout for an index with chronologycally listed news items or Grid layout for a block based layout. To see the change you need to reload the page