Robust visual lips feature extraction method for improved visual speech recognition system
المؤلفون المشاركون
Ali, Wisam H.
Muhammad, Mahmud H.
Said, Thamir R.
المصدر
Engineering and Technology Journal
العدد
المجلد 36، العدد 2A (28 فبراير/شباط 2018)، ص ص. 136-145، 10ص.
الناشر
تاريخ النشر
2018-02-28
دولة النشر
العراق
عدد الصفحات
10
التخصصات الرئيسية
تكنولوجيا المعلومات وعلم الحاسوب
الموضوعات
الملخص EN
Recently, automatic lips reading ALR acquired a significant interest among many researchers due to its adoption in many applications.
One such application is in speech recognition system in noisy environment, where visual cue that contain some integral information added to the audio signal, as well as the way that person merges audio-visual stimulus to identify utterance.
The unsolved part of this problem is the utterance classification using only the visual cues without the availability of acoustic signal of the talker's speech.
By taking into considerations a set of frames from recorded video for a person uttering a word; a robust image processing technique is used to isolate the lips region, then suitable features are extracted that represent the mouth shape variation during speech.
These features are used by the classification stage to identify the uttered word.
This paper is solve this problem by introducing a new segmentation technique to isolate the lips region together with a set of visual features base on the extracted lips boundary which able to perform lips reading with significant result.
A special laboratory is designed to collect the utterance of twenty six English letters from a multiple speakers which are adopted in this paper (UOTEletters corpus).
Moreover; two type of classifier (using Numeral Virtual generalization (NVG) RAM and K nearest neighborhood KNN) where adopted to identify the talker’s utterance.
The recognition performance for the input visual utterance when using NVG RAM is 94.679%, which is utilized for the first time in this work.
While; 92.628% when KNN is utilize.
نمط استشهاد جمعية علماء النفس الأمريكية (APA)
Muhammad, Mahmud H.& Said, Thamir R.& Ali, Wisam H.. 2018. Robust visual lips feature extraction method for improved visual speech recognition system. Engineering and Technology Journal،Vol. 36, no. 2A, pp.136-145.
https://search.emarefa.net/detail/BIM-832185
نمط استشهاد الجمعية الأمريكية للغات الحديثة (MLA)
Muhammad, Mahmud H.…[et al.]. Robust visual lips feature extraction method for improved visual speech recognition system. Engineering and Technology Journal Vol. 36, no. 2A (2018), pp.136-145.
https://search.emarefa.net/detail/BIM-832185
نمط استشهاد الجمعية الطبية الأمريكية (AMA)
Muhammad, Mahmud H.& Said, Thamir R.& Ali, Wisam H.. Robust visual lips feature extraction method for improved visual speech recognition system. Engineering and Technology Journal. 2018. Vol. 36, no. 2A, pp.136-145.
https://search.emarefa.net/detail/BIM-832185
نوع البيانات
مقالات
لغة النص
الإنجليزية
الملاحظات
Includes appendix : p. 145
رقم السجل
BIM-832185
قاعدة معامل التأثير والاستشهادات المرجعية العربي "ارسيف Arcif"
أضخم قاعدة بيانات عربية للاستشهادات المرجعية للمجلات العلمية المحكمة الصادرة في العالم العربي
تقوم هذه الخدمة بالتحقق من التشابه أو الانتحال في الأبحاث والمقالات العلمية والأطروحات الجامعية والكتب والأبحاث باللغة العربية، وتحديد درجة التشابه أو أصالة الأعمال البحثية وحماية ملكيتها الفكرية. تعرف اكثر