Many tech corporations have give you display reader software program for visually impaired folks to make it straightforward for them to make use of social media platforms. Nonetheless, till now there was no expertise accessible to translate memes that don’t have different textual content or alt textual content to explain the meme.
Now, researchers from Carnegie Mellon College have invented a technology that identifies memes and provides descriptive alt textual content to make it accessible for visually impaired folks.
Based on Jeff Bigham, affiliate professor in CMU’s Human-Pc Interplay Institute (HCII), “Memes could not appear to be an important downside, however an important a part of accessibility just isn’t selecting for folks what deserves their consideration.”
Normally, it’s not doable for meme creators so as to add alt textual content on social media the place a lot of the memes are discovered. Twitter, nevertheless, permits customers so as to add alt textual content the photographs they’re importing however the function is tough to seek out and most customers usually ignore it.
A research performed by CMU researchers confirmed that solely 0.1% of the a million photograph tweets had alt textual content.
The brand new expertise makes use of primary pc imaginative and prescient strategies for figuring out the meme template and OCR strategies are deployed for studying the overlaid textual content on memes. Researchers are attempting to standardize a template for describing a meme and the overlaid textual content could be added in response to a selected meme.
Nonetheless, changing a meme into accessible textual content for visually impaired remains to be a problem.
As Cole Gleason, a Ph.D. pupil at HCII says, “It depended on the meme if the humor translated. Some of the visuals are more nuanced”
Researchers have additionally created a platform for changing memes into audio format. The platform permits customers to tug and drop audio recordsdata into meme templates. The system can be able to translating present memes into audio memes to convey the message by way of sound results.
Gleason says, “One of many causes we tried the audio memes was as a result of we thought alt textual content would kill the joke, however folks nonetheless most well-liked the textual content as a result of they’re so used to it.”
Now that researchers have developed the expertise, the following step is to combine it into numerous meme generator web sites and social media platforms.
Researchers are serious about chatting with Twitter for including a brand new function to make it straightforward for including alt textual content. CMU researchers are additionally engaged on creating a browser extension for Twitter so as to add alt textual content for each picture.
In one other associated mission, researchers are discovering a way to combine alt textual content into the metadata uploaded with the picture. It will append the alt textual content with the picture whatever the platform it’s uploaded on.
Additionally Learn: Lenovo’s Leez Single Board Computer Is Here To Rival Raspberry Pi Boards