A Survey of Challenges and Resolutions of Mining Question-Answer Pairs From Internet Forum

Internet forum is a web community that brings people in different geographical locations together. members of the forum exchange ideas and expertise and as a result generate huge amount of content on different topics on daily basis. a good percentage of human generated content of internet forums have been found to be question-answer (qa) pairs. these qa pairs are useful for automating question answering system. mining these qa pairs has become a hot issue in the research community. effective mining of the qa pairs is being hindered by a number of factors. lexical chasm that renders some information retrieval (ir) techniques less effective, casual language that creates noisy data; multiple authors that bring about unfocused topics are some of the issues that need to be addressed. in this paper, an extensive overview of the strategies and findings relevant to these three challenges are addressed. the survey revealed that researchers are adopting non-lexical features as against lexical to resolve the issue of data sparseness. noise level is mostly controlled using conventional dictionary rather than using domain-specific dictionary.