Future Speech Interfaces with Sensors and Machine Intelligence

Speech is the most spontaneous and natural means of communication, as well as the preferred modality for interacting with mobile or fixed electronic devices, but speech in-terfaces have drawbacks, such as a lack of user privacy; non-inclusivity for certain users; poor robustness in noisy conditions;...

Ամբողջական նկարագրություն

Պահպանված է:
Մատենագիտական մանրամասներ
Ձևաչափ: Online
Լեզու:անգլերեն
Հրապարակվել է: MDPI - Multidisciplinary Digital Publishing Institute 2023
Խորագրեր:
Առցանց հասանելիություն:ONIX_20230405_9783036569383_216
Ցուցիչներ: Ավելացրեք ցուցիչ
Չկան պիտակներ, Եղեք առաջինը, ով նշում է այս գրառումը!
_version_ 1869517837067878400
collection Directory of Open Access Books
description Speech is the most spontaneous and natural means of communication, as well as the preferred modality for interacting with mobile or fixed electronic devices, but speech in-terfaces have drawbacks, such as a lack of user privacy; non-inclusivity for certain users; poor robustness in noisy conditions; and the difficulty of creating complex man–machine interfaces. The Special Issue “Future Speech Interfaces with Sensors and Machine Intelligence” assembles eleven contributions that cover multimodal and silent speech interfaces; lip reading applications; novel sensors for speech interfaces; and enhanced speech inclusivity tools for future speech interfaces. The articles make important improvements beyond the state of the art, advancing the state of the art to new frontiers in some cases. Short summaries of all articles, grouped by topic, are presented, followed by a global commentary and evaluation.
format Online
id doab-20.500.12854ir-98937
institution Directory of Open Access Books
language eng
publishDate 2023
publishDateRange 2023
publishDateSort 2023
publisher MDPI - Multidisciplinary Digital Publishing Institute
publisherStr MDPI - Multidisciplinary Digital Publishing Institute
record_format ojs
spelling doab-20.500.12854ir-989372024-04-09T23:16:00Z Future Speech Interfaces with Sensors and Machine Intelligence Denby, Bruce Gábor Csapó, Tamás Wand, Michael neural machine translation (NMT) transformer Arabic dialects modern standard Arabic subword units multi-head attention shared vocabulary self-attention 3D densely connected CNN 3D multi-layer feature fusion CNN convolutional neural network deep learning lipreading speech recognition visual speech recognition silent speech continuous-wave radar European Portuguese machine learning multimodal speech lip reading ultrasound tongue imaging pose estimation speech kinematics keypoints landmarks audio-visual speech recognition lip-reading application programming interface multi-modal interaction deep neural networks multi-view VSR attention mechanism spatial attention module local self-attention connectionist temporal classification text-to-lip speech synthesis text-to-speech speech-to-lip zero-shot adaptation generative models artificial intelligence objective measures hybrid models end-to-end recognition reliability measures decision fusion net articulation-to-speech synthesis silent speech interface speaker adaption voice conversion audiovisual speech recognition multimodal interaction edutainment virtual aquarium speech processing ultrasound imaging silent speech interfaces speech sensors thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues::TBX History of engineering and technology Speech is the most spontaneous and natural means of communication, as well as the preferred modality for interacting with mobile or fixed electronic devices, but speech in-terfaces have drawbacks, such as a lack of user privacy; non-inclusivity for certain users; poor robustness in noisy conditions; and the difficulty of creating complex man–machine interfaces. The Special Issue “Future Speech Interfaces with Sensors and Machine Intelligence” assembles eleven contributions that cover multimodal and silent speech interfaces; lip reading applications; novel sensors for speech interfaces; and enhanced speech inclusivity tools for future speech interfaces. The articles make important improvements beyond the state of the art, advancing the state of the art to new frontiers in some cases. Short summaries of all articles, grouped by topic, are presented, followed by a global commentary and evaluation. 2023-04-05T12:59:55Z 2023-04-05T12:59:55Z 2023 book ONIX_20230405_9783036569383_216 9783036569383 9783036569390 https://directory.doabooks.org/handle/20.500.12854/98937 eng application/octet-stream Attribution 4.0 International https://mdpi.com/books/pdfview/book/6990 https://mdpi.com/books/pdfview/book/6990 MDPI - Multidisciplinary Digital Publishing Institute 10.3390/books978-3-0365-6939-0 10.3390/books978-3-0365-6939-0 46cabcaa-dd94-4bfe-87b4-55023c1b36d0 9783036569383 9783036569390 252 Basel open access
spellingShingle neural machine translation (NMT)
transformer
Arabic dialects
modern standard Arabic
subword units
multi-head attention
shared vocabulary
self-attention
3D densely connected CNN
3D multi-layer feature fusion CNN
convolutional neural network
deep learning
lipreading
speech recognition
visual speech recognition
silent speech
continuous-wave radar
European Portuguese
machine learning
multimodal speech
lip reading
ultrasound tongue imaging
pose estimation
speech kinematics
keypoints
landmarks
audio-visual speech recognition
lip-reading
application programming interface
multi-modal interaction
deep neural networks
multi-view VSR
attention mechanism
spatial attention module
local self-attention
connectionist temporal classification
text-to-lip
speech synthesis
text-to-speech
speech-to-lip
zero-shot adaptation
generative models
artificial intelligence
objective measures
hybrid models
end-to-end recognition
reliability measures
decision fusion net
articulation-to-speech synthesis
silent speech interface
speaker adaption
voice conversion
audiovisual speech recognition
multimodal interaction
edutainment
virtual aquarium
speech processing
ultrasound imaging
silent speech interfaces
speech sensors
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues::TBX History of engineering and technology
Future Speech Interfaces with Sensors and Machine Intelligence
title Future Speech Interfaces with Sensors and Machine Intelligence
title_full Future Speech Interfaces with Sensors and Machine Intelligence
title_fullStr Future Speech Interfaces with Sensors and Machine Intelligence
title_full_unstemmed Future Speech Interfaces with Sensors and Machine Intelligence
title_short Future Speech Interfaces with Sensors and Machine Intelligence
title_sort future speech interfaces with sensors and machine intelligence
topic neural machine translation (NMT)
transformer
Arabic dialects
modern standard Arabic
subword units
multi-head attention
shared vocabulary
self-attention
3D densely connected CNN
3D multi-layer feature fusion CNN
convolutional neural network
deep learning
lipreading
speech recognition
visual speech recognition
silent speech
continuous-wave radar
European Portuguese
machine learning
multimodal speech
lip reading
ultrasound tongue imaging
pose estimation
speech kinematics
keypoints
landmarks
audio-visual speech recognition
lip-reading
application programming interface
multi-modal interaction
deep neural networks
multi-view VSR
attention mechanism
spatial attention module
local self-attention
connectionist temporal classification
text-to-lip
speech synthesis
text-to-speech
speech-to-lip
zero-shot adaptation
generative models
artificial intelligence
objective measures
hybrid models
end-to-end recognition
reliability measures
decision fusion net
articulation-to-speech synthesis
silent speech interface
speaker adaption
voice conversion
audiovisual speech recognition
multimodal interaction
edutainment
virtual aquarium
speech processing
ultrasound imaging
silent speech interfaces
speech sensors
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues::TBX History of engineering and technology
topic_facet neural machine translation (NMT)
transformer
Arabic dialects
modern standard Arabic
subword units
multi-head attention
shared vocabulary
self-attention
3D densely connected CNN
3D multi-layer feature fusion CNN
convolutional neural network
deep learning
lipreading
speech recognition
visual speech recognition
silent speech
continuous-wave radar
European Portuguese
machine learning
multimodal speech
lip reading
ultrasound tongue imaging
pose estimation
speech kinematics
keypoints
landmarks
audio-visual speech recognition
lip-reading
application programming interface
multi-modal interaction
deep neural networks
multi-view VSR
attention mechanism
spatial attention module
local self-attention
connectionist temporal classification
text-to-lip
speech synthesis
text-to-speech
speech-to-lip
zero-shot adaptation
generative models
artificial intelligence
objective measures
hybrid models
end-to-end recognition
reliability measures
decision fusion net
articulation-to-speech synthesis
silent speech interface
speaker adaption
voice conversion
audiovisual speech recognition
multimodal interaction
edutainment
virtual aquarium
speech processing
ultrasound imaging
silent speech interfaces
speech sensors
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues
thema EDItEUR::T Technology, Engineering, Agriculture, Industrial processes::TB Technology: general issues::TBX History of engineering and technology
url ONIX_20230405_9783036569383_216