João Freitas

Subject	Silent Speech for Human-Computer Interface in European Portuguese - MAPi
Advisor	António J. S. Teixeira, Miguel Sales Dias
Group
Status	PhD student
Starts	2010/10/01
Ends	2015/01/20
Country	Portugal
Projects
Past projects
Events	InterSpeech 2014, Interspeech 2012, iberSpeech 2014
Proposals
Personal page

Objectives

This thesis aims at investigating and developing a successful and natural SSI HCI modality which targets all users (universal HCI) including elderly, for European Portuguese (EP). This SSI will be then used as a HCI modality to interact with computing systems and smartphones. The research will be specifically interested in studying the benefit brought by this novel HCI modality for EP elderly speakers, for whom speaking might require a substantial effort.

Publications

Books

• João Freitas, António J. S. Teixeira, Miguel Sales Dias, Samuel Silva. An Introduction to Silent Speech Interfaces. Springer, 2016

Articles in international journals listed in the ISI

• João Freitas, António J. S. Teixeira, Samuel Silva, Catarina Oliveira, Miguel Sales Dias. Detecting Nasal Vowels in Speech Interfaces based on Surface Electromyography. PLoS ONE, vol. 10, no. 6, p. e0127040, June 2015 [IF 2015: 3.057 (Q1, 11/63)] [IF 2018: 2.776 (Q2, 24/69)]

Chapters in books

• Catarina Oliveira, Luciana Albuquerque, Annika Hämäläinen, Fernando Miguel Pinto, Miguel Sales Dias, Ana Júdice, João Freitas, Carlos Galinho Pires, Vitor Duarte Teixeira, António Calado, Daniela Braga, António J. S. Teixeira. Tecnologias de Fala para Pessoas Idosas. Laboratório Vivo de Usabilidade (Living Usability Lab), ARC Publishing, p. 167-181, October 2013
• João Freitas, António J. S. Teixeira, Miguel Sales Dias, Carlos A C Bastos. Towards a Multimodal Silent Speech Interface for European Portuguese. Speech Technologies, INTECH, vol. Book 1, 2011

Articles in conference proceedings

• António J. S. Teixeira, Nuno Vitor, João Freitas, Samuel Silva. Silent Speech Interaction for Ambient Assisted Living Scenarios. Proc. HCI International 2017, July 2017
• Nuno Almeida, António J. S. Teixeira, Samuel Silva, João Freitas. Towards Integration of Fusion in a W3C-based Multimodal Interaction Framework: Fusion of Events. Proc. IberSpeech, Lisboa, November 2016
• Diogo Vieira, João Freitas, Cengiz Acartürk, António J. S. Teixeira, Luís Sousa, Samuel Silva, Sara Candeias, Miguel Sales Dias. "Read That Article": Exploring Synergies between Gaze and Speech Interaction. Proc. 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS), p. 341-342, 2015
• Nuno Almeida, António J. S. Teixeira, Ana Filipa Rosa, Daniela Braga, João Freitas, Miguel Sales Dias, Samuel Silva, Jairo Avelar, Christiano Chesi, Nuno Saldanha. Giving Voices to Multimodal Applications. Proc. HCI International 2015, Los Angeles, August 2015
• João Freitas, Miguel Sales Dias, António J. S. Teixeira. Can Ultrasonic Doppler Help Detecting Nasality for Silent Speech Interfaces? An Exploratory Analysis based on Alignement of the Doppler Signal with Velum Aperture Information from Real-Time MRI'. Proceedings of PhyCS, 2014
• João Freitas, Samuel Silva, António J. S. Teixeira, Miguel Sales Dias. Assessing the Applicability of Surface EMG to Tongue Gesture Detection. Proc. IberSpeech, Las Palmas, Gran Canaria, Spain, vol. LNAI 8854, p. 189 - 198, October 2014
• João Freitas, Artur Ferreira, Mário Figueiredo, António J. S. Teixeira, Miguel Sales Dias. Enhancing Multimodal Silent Speech Interfaces with Feature Selection. Proceedings InterSpeech, Singapura, September 2014
• Luciana Albuquerque, Catarina Oliveira, António J. S. Teixeira, Pedro Sá-Couto, João Freitas, Miguel Sales Dias. Impact of age in the production of European Portuguese vowels. Proceedings InterSpeech, Singapura, September 2014
• João Freitas, António J. S. Teixeira, Miguel Sales Dias. Multimodal Corpora for Silent Speech Interaction. LREC, Reykjavik, Iceland, May 2014
• João Freitas, Miguel Sales Dias, Samuel Silva, Catarina Oliveira, António J. S. Teixeira. Velum Movement Detection based on Surface Electromyography for Speech Interface'. BIOSIGNALS 2014 – Int Conf on Bio-inspired Systems and Signal Processing, Angers, France, March 2014
• João Freitas, António J. S. Teixeira, Miguel Sales Dias. Silent Speech for Human-Computer Interaction. Doctoral Consortium BIOSTEC 2014, Angers, France, March 2014
• João Freitas, António J. S. Teixeira, Miguel Sales Dias. Multimodal Silent Speech Interface based on Video, Depth, Surface Electromyography and Ultrasonic Doppler: Data Collection and First Recognition Results. Workshop on Speech Production in Automatic Speech Recognition, Lyon, August 2013
• João Freitas, António J. S. Teixeira, Francisco Vaz, Miguel Sales Dias. Automatic Speech Recognition based on Ultrasonic Doppler Sensing for European Portuguese. Advances in Speech and Language Technologies for Iberian Languages, vol. CCIS 328, Springer, 2012
• José Serra, Manuel Ribeiro, João Freitas, Verónica Orvalho, Miguel Sales Dias. A proposal for a visual speech animation system for European Portuguese. IberSPEECH 2012, November 2012
• João Freitas, Miguel Sales Dias, António J. S. Teixeira. Towards a Silent Speech Interface for Portuguese: Surface Electromyography and the nasality challenge. International Conference on Bio-inspired Systems and Signal Processing (BIOSIGNALS 2012), Vilamoura, Portugal, February 2012
• Ana Júdice, João Freitas, Daniela Braga, António Calado, Miguel Sales Dias, António J. S. Teixeira, Catarina Oliveira. Elderly Speech Collection for Speech Recognition Based on Crowd Sourcing. Int. Conf. on Software Development for Enhancing Accessibility and Fighting Info-exclusion (DSAI), SAE, Littlemore Park, Armstrong Road, Oxford, OX4 4FY Oxford, UK, 2010

PhD thesis

• João Freitas. Articulation in Multimodal Silent Speech Interface for European Portuguese. PhD Thesis, University of Aveiro, January 2015