Improving Arabic light stemming in information retrieval systems
Other Title(s)
تحسين التجذير العربي الخفيف في أنظمة استرجاع البيانات
Dissertant
al-Musaddar, Muhammad Yahya Ali
Thesis advisor
Comitee Members
al-Hanjuri, Muhammad Ahmad Muhammad
Zaqqut, Ihab Salah al-Din
University
Islamic University
Faculty
Faculty of Engineering
Department
Department of Computer Engineering
University Country
Palestine (Gaza Strip)
Degree
Master
Degree Date
2014
English Abstract
Information retrieval refers to the retrieval of textual documents such as newsprint and magazine articles or Web documents.
Due to extensive research in the IR field, there are many retrieval techniques that have been developed for Arabic language.
The main objective of this research to improve Arabic information retrieval by enhancing light stemming and preprocessing stage and to contribute to the open source community, also establish a guideline for Arabic normalization and stop-word removal.
To achieve these objectives, we create a GUI toolkit that implements preprocessing stage that is necessary for information retrieval.
One of these steps is normalizing, which we improved and introduced a set of rules to be standardized and improved by other researchers.
The next preprocessing step we improved is stop-word removal, we introduced two different stop-word lists, the first one is intensive stop-word list for reducing the size of the index and ambiguous words, and the other is light stop-word list for better results with recall in information retrieval applications.
We improved light stemming by update a suffix rule, and introduce the use of Arabized words, 100 words manually collected, these words should not follow the stemming rules since they came to Arabic language from other languages, and show how this improve results compared to two popular stemming algorithms like Khoja and Larkey stemmers.
The proposed toolkit was integrated into a popular IR platform known as Terrier IR platform.
We implemented Arabic language support into the Terrier IR platform.
We used TF-IDF scoring model from Terrier IR platform.
We tested our results using OSAC datasets.
We used java programming language and Terrier IR platform for the proposed systems.
The infrastructure we used consisted of CORE I7 CPU ran speed at 3.4 GHZ and 8 GB RAM.
Keywords: light Stemming, preprocessing, Information Retrieval, Arabic Language, stop-word removal, open source
Main Subjects
Information Technology and Computer Science
No. of Pages
83
Table of Contents
Table of contents.
Abstract.
Abstract in Arabic.
Chapter One : Introduction.
Chapter Two : Related work.
Chapter Three : Background.
Chapter Four : Methodology.
Chapter Five : Experimental results.
Chapter Six : Conclusions.
References.
American Psychological Association (APA)
al-Musaddar, Muhammad Yahya Ali. (2014). Improving Arabic light stemming in information retrieval systems. (Master's theses Theses and Dissertations Master). Islamic University, Palestine (Gaza Strip)
https://search.emarefa.net/detail/BIM-531724
Modern Language Association (MLA)
al-Musaddar, Muhammad Yahya Ali. Improving Arabic light stemming in information retrieval systems. (Master's theses Theses and Dissertations Master). Islamic University. (2014).
https://search.emarefa.net/detail/BIM-531724
American Medical Association (AMA)
al-Musaddar, Muhammad Yahya Ali. (2014). Improving Arabic light stemming in information retrieval systems. (Master's theses Theses and Dissertations Master). Islamic University, Palestine (Gaza Strip)
https://search.emarefa.net/detail/BIM-531724
Language
English
Data Type
Arab Theses
Record ID
BIM-531724
