Guides: Text Data Mining (TDM): Text Mining Tools

Text Preparation Tools

OpenRefine
An open source desktop application, formerly called Google Refine, for data cleanup and file format transformation.
Trifacta Wrangler
Trifacta Wrangler is a cloud-based data preparation tool that includes many automated cleaning functions. There is a free version available for individual use.
Talend Data Preparation
A free desktop software for individual use, available for both Windows and Mac. This preparation tool has many visual features and can auto-profile data.
Lexos
Lexos is a web-based tool designed for transforming, analyzing, and visualizing texts small to medium text collections, and is especially useful with ancient languages and languages that do not employ the Latin alphabet.

Text Analysis Tools

Voyant Tools
A set of web based tools that allow researchers to carry out a variety of text analysis functions.
HathiTrust Research Center (HRTC)
The HathiTrust Research Center enables computational analysis of the HathiTrust corpus. It is a collaborative research center launched jointly by Indiana University and the University of Illinois, along with HathiTrust, to help meet the technical challenges researchers face when dealing with massive amounts of digital text. It develops cutting-edge software tools and cyberinfrastructure to enable advanced computational access to the growing digital record of human knowledge.
HTRC Analytics
HTRC Analytics is the primary site for interacting with HTRC. It provides access to HTRC worksets and off-the-shelf algorithms to analyze them. It also contains a dashboard where researchers can create a secure computing environment, called a Data Capsule. McGill Login required.
AntConc
A freeware corpus analysis toolkit for concordancing and text analysis.
MALLET
MALLET is a Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.
CLAWS
This web tool provides part-of-speech (POS) tagging to up to 100,000 words of text.
Juxta
An open-source tool for comparing and collating multiple witnesses to a single textual work. Originally designed to aid scholars and editors examine the history of a text from manuscript to print versions, Juxta is a desktop application that offers a number of possibilities for humanities computing and textual scholarship.
TXM
TXM is free, open-source Unicode, XML & TEI compatible text/corpus analysis environment and graphical client.
TAPoR
TAPoR is a gateway to the tools used in text analysis and retrieval. It facilitates discovery as a curated list of tools for a variety of needs.
Recogito
Allows you to work on texts and images. It helps you identify and mark named entities such as places, people, and events as well as establish relationships between annotations. It prepares your data in a variety of formats so that it can be used with other tools (GEPHI, GIS software, etc.) or connect to other data on the Web. All without the need to learn code.
Google Books Ngram Viewer
When you enter phrases into the Google Books Ngram Viewer, it displays a graph showing how those phrases have occurred in a corpus of books over the selected years.

Text and Data Mining

Text and data mining refers to the processes by which "text or datasets are crawled by software that recognizes entities, relationships, and action." -- GALE, 2017. Text and data mining is an important, new area for academic researchers largely because the output of these processes can result in detecting patterns, trends and also drawing new conclusions.

McGill Library can facilitate access to text corpora for McGill researchers. Assistance can entail helping you locate textual data sources, negotiate access to textual collections for text mining, and, in some cases, purchase or license data. We can also help you find and use tools for managing and analyzing textual data.

Other guides

See the following related guides for:

Network Analysis & Data Visualization for Humanities and Social Sciences
Creating digital books and exhibits as well as interactive map and timelines: Digital and Multimedia Publishing guide
GIS software & tools: Maps and Geospatial Data guide
Statistical data, software, & visualisation: Numeric Data guide