Introduction
Hello and welcome to this site, which is dedicated to the author's interests in Audio Visual Speech Recognition (AVSR) and, more generally, in Automatic Speech Recognition (ASR).
Information and resources that were produced developping some recognition prototypes can be found in Projects.
Some didactic material is available in Education.
Basic information, including contacts, concerning the author are available in About the author.
Projects
ABCP-1
The ABCP-1 system is a speaker dependent, large vocabulary and continuous speech recognizer, that is based on acoustic and visual speech features.
Follows some of the available technical reports (and respective slides):
- ABCP1-TR-00 (slides-00) - a general overview of the recognizer;
- ABCP1-TR-01 - the ABCP-db1 application specific corpus;
- ABCP1-TR-02 (slides-02) - the system's language model
- ABCP1-TR-03 - the Acoustic Model;
- ABCP1-TR-04 - the Visual Model;
- ABCP1-TR-05 - the Decoder;
- ABCP1-TR-06 - the Acoustic Acquisition and Analysis Module;
- ABCP1-TR-07 - the Visual Acquisition and Analysis Module (WORK IN PROGRESS).
A few notes on building a DBN-based ABCP-1 version (WORK IN PROGRESS).
Other technical reports: ABCP1-TR-14-01 - ("LM using marginals" - WORK IN PROGRESS).
From the Language Model of the ABCP-1 recognizer, some Lexicons, nGrams and Perl scripts are available in this directory.
In relation to the the initial version of theVisual Acquisition and Analysis Module, are also available the C++ code and a sample video (23MB AVI or 500kB FLV).