تشخیص عبارت‌های گفتاری برای اخبار فارسی صداوسیمای جمهوری اسلامی ایران

هدف از تشخیص عبارت‌های گفتاری یا جستجوی کلیدواژه، تشخیص و جستجوی مجموعه‌ای از کلیدواژه‌ها در مجموعه‌ای از اسناد گفتاری (مانند سخنرانی‌ها،‌ جلسه‌ها) است. در این پژوهش تشخیص عبارت‌های گفتاری فارسی برپایه سامانه‌های بازشناسی گفتار با کاربرد در بازیابی اطلاعات در بایگانی‌های گفتاری و ویدئویی سازمان صدا و سیما طراحی و پیاده‌سازی شده است. برای این کار، ابتدا اسناد گفتاری به متن، بازشناسی، سپس بر روی این متون جستجو انجام می‌شود. برای آموزش سامانه بازشناسی گفتار فارسی، دادگان فارس‌دات بزرگ به‌کار رفته است. این سامانه به نرخ خطای واژه 2.71 درصد بر روی همین دادگان و 28.23 درصد بر روی دادگان اخبار فارسی با استفاده از مدل‌ زیر فضای مخلوط گوسی (sgmm) رسید. برای تشخیص عبارت‌های گفتاری از روش پایه واژگان نماینده استفاده شده و با استفاده از شبکه حافظه کوتاهمدت ماندگار و دسته‌بندی زمانی پیوندگرا (lstmctc) روشی برای بهبود تشخیص واژگان خارج از واژگان (oov) پیشنهاد شده است. کارایی سامانه تشخیص عبارات با روش واژه‌های نماینده بر روی دادگان فارس‌دات بزرگ بر طبق معیار ارزش وزنی واقعی عبارت (atwv) برابر با 0.9206 برای کلیدواژه‌های داخل واژگان و برابر با 0.2 برای کلیدواژه‌های خارج از واژگان رسید که این نرخ برای واژگان oov با استفاده از روش lstmctc با حدود پنجاه درصد بهبود به مقدار 0.3058 رسید؛ همچنین، در تشخیص عبارت‌های گفتاری بر روی دادگان اخبار فارسی، atwv برابر 0.8008 حاصل شد.

Spoken Term Detection for Persian News of Islamic Republic of Iran Broadcasting

Islamic Republic of Iran Broadcasting (IRIB) as one of the biggest broadcasting organizations, produces thousands of hours of media content daily. Accordingly, the IRIBchr('39')s archive is one of the richest archives in Iran containing a huge amount of multimedia data. Monitoring this massive volume of data, and brows and retrieval of this archive is one of the key issues for this broadcasting. The aim of this research is to design a content retrieval engine for the IRIB rsquo;s media and production using spoken term detection (STD) or keyword spotting. The goal of an STD system is to search for a set of keywords in a set of speech documents. One of the methods for STD is using a speech recognition system in which speech is recognized and converted into text and then, the text is searched for the keywords. Variety of speech documents and the limitation of speech recognition vocabulary are two challenges of this approach. Large vocabulary continuous speech recognition systems (LVCSR) usually have limited but large vocabulary and these systems canchr('39')t recognize out of vocabulary (OOV) words. Therefore, LVCSRbased STD systems suffer OOV problem and canchr('39')t spotting the OOV keywords. Methods such as the use of subword units (e.g., phonemes or syllables) and proxy words have been introduced to overcome the vocabulary limitation and to deal with the out of vocabulary (OOV) keywords. This paper proposes a Persian (Farsi) STD system based on speech recognition and uses the proxy words method to deal with OOV keywords. To improve the performance of this method, we have used Long ShortTerm MemoryConnectionist Temporal Classification (LSTMCTC) network.In our experiments, we have designed and implemented a large vocabulary continuous speech recognition systems for Farsi language. Large FarsDat dataset is used to train the speech recognition system. FarsDat contains 80 hours voices from 100 speakers. Kaldi toolkit is used to implement speech recognition system. Since limited dataset, Subspace Gaussian Mixture Models (SGMM) is used to train acoustic model of the speech recognition. Acoustic model is trained based context triphones and language model is probability trigram words model. Word Error Rate (WER) of Speech recognition system is 2. 71% on FARSDAT test set and also 28.23% on the Persian news collected from IRIB data.Term detection is designed based on weighted finitestate transducers (WFST). In this method, first a speech document is converted to a lattice by the speech recognizer (the lattice contains the full probability of speech recognition system instead of the most probable one), and then the lattice is converted to WFST. This WFST contains the full probability of words that speech recognition computed. Then, text retrieval is used to index and search over the WFST output. The proxy words method is used to deal with OOV. In this method, OOV words are represented by similarly pronunciation invocabulary words. To improve the performance of the proxy words methods, an LSTMCTC network is proposed. This LSTMCTC is trained based on charterers of words separately (not a continuous sentence). This LSTMCTC recomputed the probabilities and reverified proxy outputs. It improves proxy words methods dues to the fact that proxy words method suffers false alarms. Since LSTMCTC is an endtoend network and is trained based on the characters, it doesnchr('39')t need a phonetic lexicon and can support OOV words. As the LSTMCTC is trained based on the separate words, it reduces the weight of the language model and focuses on acoustic model weight. The proposed STD achieve 0.9206 based Actual Term Weighted Value (ATWV) for in vocabulary keywords and for OOV keywords ATWV is 0.2 using proxy word method. Applying the proposed LSTMCTC improves the ATWV rate to 0.3058. On Persian news dataset, the proposed method receives ATWV of 0.8008.