Portable captioning device brings captions to the real world
Sometimes it is difficult to understand what someone is saying when wearing a mask – often this problem is already a problem when the listener is dependent on lip reading or is hard of hearing or even deaf.
However, problems like this lead to great solutions and ideas like this Kevin Lewis portable captioning device (@_phzn) showed up on Twitter.
– Kevin Lewis (he / him) (@_phzn) January 4, 2022
“The mask presents some interesting challenges – first of all, some people have a hard time getting along with any of them, but some people also rely on lip reading and without the ability to lip read, they will have a hard time communicating with me, ”said Lewis.
“When I go to events in the next few months or even a year, I will definitely be wearing a mask.
“So I built this. This is a small screen, powered by the Deepgram speech recognition API that presents what I’m saying in real time, it goes into this little mic here. And while I still have to work on the type of packaging, I think it’s going to be super useful.
This portable captioning device absolutely reigns supreme. It basically provides TV-style closed captioning through an in-person device.
Lewis is a senior developer advocate for Deepgram, an end-to-end AI speech recognition service that focuses on delivering lightning-fast real-time transcriptions. If these videos are any indicator, Deepgram is not messing around. It is used by a wide range of organizations including NASA, Tethr, and Khoros.
As requested by a group of you, there is now a live translation built into this @DeepgramAI-Powered portable caption device! The next step will take a few days but it is the case of the device so it can be more easily carried. Thank you for those kind words. Information about Deepgram on https://t.co/6NA2qQMVTT pic.twitter.com/SrEiFjFJCJ
– Kevin Lewis (he / him) (@_phzn) January 6, 2022
Honestly, it’s quite remarkable how compact such a device is also, providing large, understandable captions on a display mounted in the user’s chest pocket near eye level. It would also cost Lewis only around £ 70 ($ 132.45) with parts readily available, including a Raspberry Pi and a Hyperpixel screen.
“It’s going to make it more portable and less ‘just to stand on my pocket,'” Lewis added on Twitter.
It is even capable of translating languages in real time (via iTranslate). It’s incredible. It is not the first of its kind, but it is certainly one of the first developed in this current form.
In the future, it would be great to see this kind of reliable closed captioning at events, possibly powered by phones and not relying on a cloud-based API. There is absolutely interest in the technology, with Twitter users praising the device’s creativity.
“My deaf wife would love this. I’m used to living with subtitles so I’d love that too. Well done,” a twitter user wrote. “As someone who often wanted subtitles even before the pandemic, that’s great,” writes another.
This is certainly a realizable reality on a large scale, given that the Pixel 6 and Pixel 6 Pro have offline text-to-speech software.
Rules of technology.