Tuesday, June 16, 2020

Text mining

.
According to Hotho et al. (2005) we can differ three different perspectives of text mining, namely text mining as information extraction, text mining as text data mining, and text mining as KDD (Knowledge Discovery in Databases) process.[1] 

Text mining is "the discovery by computer of new, previously unknown information, by automatically extracting information from different written resources."[2] 

Written resources can be websitesbooksemailsreviews, articles.

Text mining, also referred to as text data mining, roughly equivalent to text analytics, is the process of deriving high-quality information from text

High-quality information is typically derived through the devising of patterns and trends through means such as statistical pattern learning

Text mining usually involves the process of structuring the input text (usually parsing, along with the addition of some derived linguistic features and the removal of others, and subsequent insertion into a database), deriving patterns within the structured data, and finally evaluation and interpretation of the output. 

'High quality' in text mining usually refers to some combination of relevancenovelty, and interest. 

Typical text mining tasks include text categorizationtext clustering, concept/entity extraction, production of granular taxonomies, sentiment analysisdocument summarization, and entity relation modeling (i.e., learning relations between named entities).
Text analysis involves information retrievallexical analysis to study word frequency distributions, pattern recognitiontagging/annotationinformation extractiondata mining techniques including link and association analysis, visualization, and predictive analytics

The overarching goal is, essentially, to turn text into data for analysis, via application of natural language processing (NLP), different types of algorithms and analytical methods. 

An important phase of this process is the interpretation of the gathered information.
A typical application is to scan a set of documents written in a natural language and either model the document set for predictive classification purposes or populate a database or search index with the information extracted. 

The document is the basic element while starting with text mining. Here, we define a document as a unit of textual data, which normally exists in many types of collections.[3]
.
https://en.wikipedia.org/wiki/Text_mining

No comments: