Portable captioning device brings captions to the real world

Sometimes it is difficult to understand what someone is saying when wearing a mask – often this problem is already a problem when the listener is dependent on lip reading or is hard of hearing or even deaf.

However, problems like this lead to great solutions and ideas like this Kevin Lewis portable captioning device (@_phzn) showed up on Twitter.

“The mask presents some interesting challenges – first of all, some people have a hard time getting along with any of them, but some people also rely on lip reading and without the ability to lip read, they will have a hard time communicating with me, ”said Lewis.

“When I go to events in the next few months or even a year, I will definitely be wearing a mask.

“So I built this. This is a small screen, powered by the Deepgram speech recognition API that presents what I’m saying in real time, it goes into this little mic here. And while I still have to work on the type of packaging, I think it’s going to be super useful.

This portable captioning device absolutely reigns supreme. It basically provides TV-style closed captioning through an in-person device.

Lewis is a senior developer advocate for Deepgram, an end-to-end AI speech recognition service that focuses on delivering lightning-fast real-time transcriptions. If these videos are any indicator, Deepgram is not messing around. It is used by a wide range of organizations including NASA, Tethr, and Khoros.

Honestly, it’s quite remarkable how compact such a device is also, providing large, understandable captions on a display mounted in the user’s chest pocket near eye level. It would also cost Lewis only around £ 70 ($ 132.45) with parts readily available, including a Raspberry Pi and a Hyperpixel screen.

“It’s going to make it more portable and less ‘just to stand on my pocket,'” Lewis added on Twitter.

It is even capable of translating languages ​​in real time (via iTranslate). It’s incredible. It is not the first of its kind, but it is certainly one of the first developed in this current form.

In the future, it would be great to see this kind of reliable closed captioning at events, possibly powered by phones and not relying on a cloud-based API. There is absolutely interest in the technology, with Twitter users praising the device’s creativity.

“My deaf wife would love this. I’m used to living with subtitles so I’d love that too. Well done,” a twitter user wrote. “As someone who often wanted subtitles even before the pandemic, that’s great,” writes another.

This is certainly a realizable reality on a large scale, given that the Pixel 6 and Pixel 6 Pro have offline text-to-speech software.

Rules of technology.

Source link

Comments are closed.