| Lab |
| 情報研究棟IS Building Ｉ 8F |
| TEL：1235 |
To Lab's Site |
| Japanese | English |
| Full text / JAIST Repository |
Jianwu Dang Professor
School of Information Science（Department of Information Science・Human Information Processing）
■Degrees
B.E. from Tsinghua University, China (1982), M.E from Tsinghua University, China (1984), Ph.D. from Shizuoka University (1992)
■Professional Career
Associate of Dept. of Computer Science and Technology of Tianjin University, China (1984), Lecture of Dept. of Computer Science and Technology of Tianjin University, China (1986-1988), Visiting researcher of ATR Human Information Processing Research Laboratories (1992), Senior researcher of ATR Human Information Processing Research Laboratories (1998-2001)
■Specialties
Speech Information Science, Modeling of Speech Production Mechanism of Humans, Speech Synthesis, Speech Recognition, and Brain Functions of Spoken Language
■Research Keywords
Speech Production, Speech Synthesis, Speech Recognition, and Cognitive Science
■Research Interests
Research on speech recognition considering auditory, articulatory and physiological features:
We are going to develop some novel method for speech recognition by considering human mechanisms. We are using human auditory property for developing a robust speech recognition method for a noisy environment, coarticulatory mechanism for missing speech recognition, and physiological features for speaker identification.
Researches on speech production mechanisms and their modeling:
There are still a number of unsolved questions on mechanisms of speech production, especially for production of emotional speech. To answer those questions, we used a physiological articulatory model, which has been developed based on MRI data by this Lab and ATR, to simulate the processing from articulatory target to speech sound and the inverse processing from speech sound to articulatory target. The “true” mechanisms can be approached using such an iterative approach. An additional part of this topic is to refine the articulatory model based on physiological discoveries.
Researches on speech cognitive science:
Speech cognition (perception) can be considered as an inverse procedure of the speech production. Since numbers of articulatory situations are able to produce the same sound, there is one-to-many inverse problem occurring in the cognition processing, which is a crucial topic in speech cognition. We are going to challenge the problem by investigating its causes, which are concerned with the stability of the articulatory situation, and the physiological and morphological constraints, via the physiological articulatory model.
Research on speech communication within the brain
According to the motor theory of speech perception, a famous hypothesis, speech perception is realizing with reference to image or knowledge of the motor (production) areas (Liberman et al., 1960, 1985). In this research, we are going to verify this theory by investigating interaction between speech perception and production via acoustic analysis, EMG measurement and articulatory observation.
・ Individuality of speech depends on physiological (inborn) factors and social (habit-forming) factors. In this study, we focus on the analysis and modeling of the effects of the former factors on speech.・ Emotion is the paralinguistic information to describe a state of the speaker, which cannot be logically produced. The study is trying to study emotional speech generation by adapting our experience to the articulatory model and clarify the relation between the emotion and acoustic parameters besides the fundamental frequency.
Science and Technology of Speech communication: Process of speech production and its inverse process - cognition
Communication using speech production and speech perception is one of the basic ways for human to exchange information. Fully understanding such mechanisms of human and realizing them by a computer system are the research goal of our laboratory.
■Publications
◇Books
- Speech Analysis: The Production-Perception Perspective/Advances in Chinese Spoken Language Processing,C. H. Lee, et al.,，L. Deng and J. Dang，World Scientific ，2007，1-32
- Physiological Articulatory Model for Investigating Speech Production: modeling and Control ，Qiang Fang, Jianwu Dang，ISBN-NR. 978-3639173871, VDM Verlag，2009/7
◇Published Papers
- Comparison of Emotion Perception among Different Cultures，J. Dang, A. Li, D. Erickson, A. Suemitsu, M. Akagi, et. al，coustics of Science and Technology，31，6，394-402，2010, 12
- Study of Control Strategy Mimicking Speech Motor Learning for a Physiological Articulatory Model，Xiyu Wu, Jianguo Wei and Jianwu Dang，Journal of Signal Processing，15，4，295-298，2011, 7
- Voice Activity Detection Based On An Unsupervised Learning Framework，D. Ying, Y. Yan, J. Dang, and F. Soong (2011)，IEEE Trans. Audio, Speech and Language Processing (in press)
◇Lectures and Presentations
- A method of speaker identification based on phoneme mean F-ratio contribution，Songgun Hyon, Hongcui Wang, Chen Zhao, Jianguo Wei, Jianwu Dang，Interspeech，Portland USA，2012,9
- Discrimination between Natural and Unnatural Articulations based on Articulatory Structure，A. NISHIKIDO, S. KAWAMOTO and J. DANG，Proc. ISCSLP 2010,，Tainan, Taiwan，2010,12
- Acoustic and Articulatory Analysis on Mandarin Chinese Vowels in Emotional Speech，A. LI, Q. FANG, F. HU, L. ZHENG, H. WANG and J. DANG，Proc. ISCSLP 2010，Tainan, Taiwan，2010, 12
■Extramural Activities
◇Academic Society Affiliations
- Association for Computing Machinery (ACM)，Member，2010-
- China Computer Federation，Scholarly Communications Committee，2010-
- International Speech Communication Association，Member，2005-
◇Other Activities
- the University of Waterloo，Visiting Scholar，1998/08/01 - 1999/07/31
- ATR Intistute International，Visiting Researcher, (2001-)
- Institut de la Communication ParleeCNRS UMR 5009 & INPG & University Stendhal，Senior Researcher，2002/10/01 - 2003/09/30