Thursday, 3 April 2014

App Helps the Blind "See" With Their Ears

It's not a magic act however an indication of a brand new app that allows the visually impaired to listen to data typically perceived through sight. the lady is carrying headphones and a miniature camera hooked up to a pair of glasses, that are connected to a laptop computer on the table. A series of musical cues—which mix into a nice tune—let her recognize the color, shape, and placement of the fruit.

The app, referred to as EyeMusic SSD (for sensory substitution device), uses a computer algorithmic program to construct a "soundscape" that conveys visual data through musical notes. With coaching to extract which means from patterns of notes, people that are blind since birth will learn to browse letters and numbers, tell what they're watching from far-off, and even acknowledge facial expressions and body postures.

When somebody is smiling, for instance, a visually impaired person would hear a string of high notes descending then ascending once more (sort of a formed curve, sort of a smile). displeased would be the opposite—low notes ascending then descending.

recently developed sensory substitution code which will run on a smartphone, minimizing the need for plenty of clumsy equipment and creating the technology easier to use.

After downloading EyeMusic, users merely enter their headphones and hold their phone up to the scene ahead of them to begin taking note of their surroundings. The camera within the phone scans the setting every 2 seconds, and EyeMusic builds the image pixel by pixel.

Notes compete earlier within the sequence correspond to things situated toward the left of the scene, and notes compete later correspond to things toward the proper. Height is indicated by pitch—with higher notes signal that one thing is toward the highest of the scene and lower notes signal that it's toward all-time low. A line across, therefore, sounds like a flat line on associate degree encephalogram, and a diagonal line from left to right would sound sort of a descending scale.

Color is sent through differing types of instruments. White, for example, is meaning by human voices, blue by a trumpet, yellow by a string, and red by popular music chords compete on an organ. Black is depicted by silence.

So staring at a busy street, a person using EyeMusic would possibly hear an approaching taxi as a string sequence growing louder because the vehicle gets nearer, and a crossing as 2 low, even tones played in unison.

The program takes about seventy hours to master. coaching sessions teach users a way to establish various broad classes of objects, like faces, bodies, and landscapes, that are every processed in an exceedingly completely different area of the cortical region within the brain.

Each class has its own set of distinctive characteristics, Amedi says. for example, a musical notation that goes up and down linearly indicates buildings and homes, that are created from straight lines and 90-degree angles; the vertical lines of buildings may be signaled by short bursts of many notes compete at identical time. For faces, that are rounder and have softer contours, the musical notation descends and ascends exponentially.

For more from the XpertCrewTM team please follow us on Twitter @Techvedic or 

our Facebook Page- 

or  contact us at

U.S. +855-859-0057 (  )
U.K. +800-635-0716 ( )
CA  1-855-749-5861 ( )
AU  1-800-197-298  ( )
And yes, we are eagerly waiting for your valuable feedback. Do write us back. We would be more than happy to help you. We are available 24/7.

1 comment:

  1. I enjoy what you’ve got right here, adore what you’re stating and the way you say it.This is a very interesting article.
    Visit at Online Big Store