These datasets consist primarily of text for tasks such as natural language processing, sentiment analysis, translation, and cluster analysis.

Reviews

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
Netflix Prize	Movie ratings on Netflix.		100,480,507 ratings that 480,189 users gave to 17,770 movies	Text, rating	Rating prediction	2006	^[5]	Netflix
Amazon reviews	US product reviews from Amazon.com.	None.	233.1 million	Text	Classification, sentiment analysis	2015 (2018)	^[6]^[7]	McAuley et al.
OpinRank Review Dataset	Reviews of cars and hotels from Edmunds.com and TripAdvisor respectively.	None.	42,230 / ~259,000 respectively	Text	Sentiment analysis, clustering	2011	^[8]^[9]	K. Ganesan et al.
MovieLens	22,000,000 ratings and 580,000 tags applied to 33,000 movies by 240,000 users.	None.	~ 22M	Text	Regression, clustering, classification	2016	^[10]	GroupLens Research
Yahoo! Music User Ratings of Musical Artists	Over 10M ratings of artists by Yahoo users.	None described.	~ 10M	Text	Clustering, regression	2004	^[11]^[12]	Yahoo!
Car Evaluation Data Set	Car properties and their overall acceptability.	Six categorical features given.	1728	Text	Classification	1997	^[13]^[14]	M. Bohanec
YouTube Comedy Slam Preference Dataset	User vote data for pairs of videos shown on YouTube. Users voted on funnier videos.	Video metadata given.	1,138,562	Text	Classification	2012	^[15]^[16]	Google
Skytrax User Reviews Dataset	User reviews of airlines, airports, seats, and lounges from Skytrax.	Ratings are fine-grain and include many aspects of airport experience.	41396	Text	Classification, regression	2015	^[17]	Q. Nguyen
Teaching Assistant Evaluation Dataset	Teaching assistant reviews.	Features of each instance such as class, class size, and instructor are given.	151	Text	Classification	1997	^[18]^[19]	W. Loh et al.
Vietnamese Students’ Feedback Corpus (UIT-VSFC)	Students’ Feedback.	Comments	16,000	Text	Classification	1997	^[20]	Nguyen et al.
Vietnamese Social Media Emotion Corpus (UIT-VSMEC)	Users’ Facebook Comments.	Comments	6,927	Text	Classification	1997	^[21]	Nguyen et al.
Vietnamese Open-domain Complaint Detection dataset (ViOCD)	Customer product reviews	Comments	5,485	Text	Classification	2021	^[22]	Nguyen et al.
ViHOS: Hate Speech Spans Detection for Vietnamese	Social Media Texts	Comments	Containing 26k spans on 11k comments	Text	Span Detection	2021	^[23]	Hoang et al.

Close

News articles

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
NYSK Dataset	English news articles about the case relating to allegations of sexual assault against the former IMF director Dominique Strauss-Kahn.	Filtered and presented in XML format.	10,421	XML, text	Sentiment analysis, topic extraction	2013	^[24]	Dermouche, M. et al.
The Reuters Corpus Volume 1	Large corpus of Reuters news stories in English.	Fine-grain categorization and topic codes.	810,000	Text	Classification, clustering, summarization	2002	^[25]	Reuters
The Reuters Corpus Volume 2	Large corpus of Reuters news stories in multiple languages.	Fine-grain categorization and topic codes.	487,000	Text	Classification, clustering, summarization	2005	^[26]	Reuters
Thomson Reuters Text Research Collection	Large corpus of news stories.	Details not described.	1,800,370	Text	Classification, clustering, summarization	2009	^[27]	T. Rose et al.
Saudi Newspapers Corpus	31,030 Arabic newspaper articles.	Metadata extracted.	31,030	JSON	Summarization, clustering	2015	^[28]	M. Alhagri
RE3D (Relationship and Entity Extraction Evaluation Dataset)	Entity and Relation marked data from various news and government sources. Sponsored by Dstl	Filtered, categorisation using Baleen types	not known	JSON	Classification, Entity and Relation recognition	2017	^[29]	Dstl
Examiner Spam Clickbait Catalogue	Clickbait, spam, crowd-sourced headlines from 2010 to 2015	Publish date and headlines	3,089,781	CSV	Clustering, Events, Sentiment	2016	^[30]	R. Kulkarni
ABC Australia News Corpus	Entire news corpus of ABC Australia from 2003 to 2019	Publish date and headlines	1,186,018	CSV	Clustering, Events, Sentiment	2020	^[31]	R. Kulkarni
Worldwide News – Aggregate of 20K Feeds	One week snapshot of all online headlines in 20+ languages	Publish time, URL and headlines	1,398,431	CSV	Clustering, Events, Language Detection	2018	^[32]	R. Kulkarni
Reuters News Wire Headline	11 Years of timestamped events published on the news-wire	Publish time, Headline Text	16,121,310	CSV	NLP, Computational Linguistics, Events	2018	^[33]	R. Kulkarni
The Irish Times Ireland News Corpus	24 Years of Ireland News from 1996 to 2019	Publish time, Headline Category and Text	1,484,340	CSV	NLP, Computational Linguistics, Events	2020	^[34]	R. Kulkarni
News Headlines Dataset for Sarcasm Detection	High quality dataset with Sarcastic and Non-sarcastic news headlines.	Clean, normalized text	26,709	JSON	NLP, Classification, Linguistics	2018	^[35]	Rishabh Misra

Close

Messages

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
Enron Corpus	Emails from employees at Enron organized into folders.	Attachments removed, invalid email addresses converted to user@enron.com or no_address@enron.com.	~ 500,000	Text	Network analysis, sentiment analysis	2004 (2015)	^[36]^[37]	Klimt, B. and Y. Yang
Ling-Spam Dataset	Corpus containing both legitimate and spam emails.	Four version of the corpus involving whether or not a lemmatiser or stop-list was enabled.	2,412 Ham 481 Spam	Text	Classification	2000	^[38]^[39]	Androutsopoulos, J. et al.
SMS Spam Collection Dataset	Collected SMS spam messages.	None.	5,574	Text	Classification	2011	^[40]^[41]	T. Almeida et al.
Twenty Newsgroups Dataset	Messages from 20 different newsgroups.	None.	20,000	Text	Natural language processing	1999	^[42]	T. Mitchell et al.
Spambase Dataset	Spam emails.	Many text features extracted.	4,601	Text	Spam detection, classification	1999	^[43]	M. Hopkins et al.

Close

Twitter and tweets

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
MovieTweetings	Movie rating dataset based on public and well-structured tweets		~710,000	Text	Classification, regression	2018	^[44]	S. Dooms
Twitter100k	Pairs of images and tweets		100,000	Text and Images	Cross-media retrieval	2017	^[45]^[46]	Y. Hu, et al.
Sentiment140	Tweet data from 2009 including original text, time stamp, user and sentiment.	Classified using distant supervision from presence of emoticon in tweet.	1,578,627	Tweets, comma, separated values	Sentiment analysis	2009	^[47]^[48]	A. Go et al.
ASU Twitter Dataset	Twitter network data, not actual tweets. Shows connections between a large number of users.	None.	11,316,811 users, 85,331,846 connections	Text	Clustering, graph analysis	2009	^[49]^[50]	R. Zafarani et al.
SNAP Social Circles: Twitter Database	Large Twitter network data.	Node features, circles, and ego networks.	1,768,149	Text	Clustering, graph analysis	2012	^[51]^[52]	J. McAuley et al.
Twitter Dataset for Arabic Sentiment Analysis	Arabic tweets.	Samples hand-labeled as positive or negative.	2000	Text	Classification	2014	^[53]^[54]	N. Abdulla
Buzz in Social Media Dataset	Data from Twitter and Tom's Hardware. This dataset focuses on specific buzz topics being discussed on those sites.	Data is windowed so that the user can attempt to predict the events leading up to social media buzz.	140,000	Text	Regression, Classification	2013	^[55]^[56]	F. Kawala et al.
Paraphrase and Semantic Similarity in Twitter (PIT)	This dataset focuses on whether tweets have (almost) same meaning/information or not. Manually labeled.	tokenization, part-of-speech and named entity tagging	18,762	Text	Regression, Classification	2015	^[57]^[58]	Xu et al.
Geoparse Twitter benchmark dataset	This dataset contains tweets during different news events in different countries. Manually labeled location mentions.	location annotations added to JSON metadata	6,386	Tweets, JSON	Classification, Information Extraction	2014	^[59]^[60]	S.E. Middleton et al.
Sarcasm, Perceived and Intended, by Reactive Supervision (SPIRS)	Intended and perceived sarcastic tweets along with their context collected using reactive supervision; an equal number of negative (non-sarcastic) samples		30,000	Tweet IDs, CSV	Classification	2020	^[61]^[62]	B. Shmueli et al.
Dutch Social media collection	This dataset contains COVID-19 tweets made by Dutch speakers or users from Netherlands. The data has been machine labeled	classified for sentiment, tweet text & user description translated to English. Industry mention are extracted	271,342	JSONL	Sentiment, multi-label classification, machine translation	2020	^[63]^[64]^[65]	Aaaksh Gupta, CoronaWhy
ReactionGIF dataset	A dataset of 30K tweets and their GIF reactions	Classified for sentiment, reaction, and emotion	30,000	Tweet IDs, JSONL	Classified for sentiment, reaction, and emotion	2021	^[66]^[67]	B. Shmueli et al.

Close

Dialogues

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
NPS Chat Corpus	Posts from age-specific online chat rooms.	Hand privacy masked, tagged for part of speech and dialogue-act.	~ 500,000	XML	NLP, programming, linguistics	2007	^[68]	Forsyth, E., Lin, J., & Martell, C.
Twitter Triple Corpus	A-B-A triples extracted from Twitter.		4,232	Text	NLP	2016	^[69]	Sordini, A. et al.
UseNet Corpus	UseNet forum postings.	Anonymized e-mails and URLs. Omitted documents with lengths <500 words or >500,000 words, or that were <90% English.	7 billion	Text		2011	^[70]	Shaoul, C., & Westbury C.
NUS SMS Corpus	SMS messages collected between two users, with timing analysis.		~ 10,000	XML	NLP	2011	^[71]	KAN, M
Reddit All Comments Corpus	All Reddit comments (as of 2015).		~ 1.7 billion	JSON	NLP, research	2015	^[72]	Stuck_In_the_Matrix
Ubuntu Dialogue Corpus	Dialogues extracted from Ubuntu chat stream on IRC.		930 thousand dialogues, 7.1 million utterances	CSV	Dialogue Systems Research	2015	^[73]	Lowe, R. et al.
Dialog State Tracking Challenge	The Dialog State Tracking Challenges 2 & 3 (DSTC2&3) were research challenge focused on improving the state of the art in tracking the state of spoken dialog systems.	Transcription of spoken dialogs with labelling	DSTC2 contains ~3.2k calls – DSTC3 contains ~2.3k calls	Json	Dialogue state tracking	2014	^[74]	Henderson, Matthew and Thomson, Blaise and Williams, Jason D

Close

Legal

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
FreeLaw	Filtered data from Court Listener, part of the FreeLaw project.	Cleaned and normalized text	4,940,710	Json	NLP, linguistics	2020	^[75]	T. Hoppe
Pile of Law	Corpus of legal and administrative data	Cleaned, normalized, and privatized	~50,000,000	Json	NLP, linguistics, sentiment	2022	^[76]^[77]	L. Zheng; N. Guha; B. Anderson; P. Henderson; D. Ho
Caselaw Access Project	All official, book-published state and federal United States case law — every volume or case designated as an official report of decisions by a court within the United States.	Cleaned and normalized text	~10,000	Json	NLP, linguistics	2022	^[78]	A. Aizman; S. Chapman; J. Cushman; K. Dulin; H. Eidolon; et al.

Close

Other text

More information Dataset Name, Brief description ...

Dataset Name	Brief description	Preprocessing	Instances	Format	Default Task	Created (updated)	Reference	Creator
Web of Science Dataset	Hierarchical Datasets for Text Classification	None.	46,985	Text	Classification, Categorization	2017	^[79]^[80]	K. Kowsari et al.
Legal Case Reports	Federal Court of Australia cases from 2006 to 2009.	None.	4,000	Text	Summarization, citation analysis	2012	^[81]^[82]	F. Galgani et al.
Blogger Authorship Corpus	Blog entries of 19,320 people from blogger.com.	Blogger self-provided gender, age, industry, and astrological sign.	681,288	Text	Sentiment analysis, summarization, classification	2006	^[83]^[84]	J. Schler et al.
Social Structure of Facebook Networks	Large dataset of the social structure of Facebook.	None.	100 colleges covered	Text	Network analysis, clustering	2012	^[85]^[86]	A. Traud et al.
Dataset for the Machine Comprehension of Text	Stories and associated questions for testing comprehension of text.	None.	660	Text	Natural language processing, machine comprehension	2013	^[87]^[88]	M. Richardson et al.
The Penn Treebank Project	Naturally occurring text annotated for linguistic structure.	Text is parsed into semantic trees.	~ 1M words	Text	Natural language processing, summarization	1995	^[89]^[90]	M. Marcus et al.
DEXTER Dataset	Task given is to determine, from features given, which articles are about corporate acquisitions.	Features extracted include word stems. Distractor features included.	2600	Text	Classification	2008	^[91]	Reuters
Google Books N-grams	N-grams from a very large corpus of books	None.	2.2 TB of text	Text	Classification, clustering, regression	2011	^[92]^[93]	Google
Personae Corpus	Collected for experiments in Authorship Attribution and Personality Prediction. Consists of 145 Dutch-language essays.	In addition to normal texts, syntactically annotated texts are given.	145	Text	Classification, regression	2008	^[94]^[95]	K. Luyckx et al.
PushShift	Archives of social media websites, including Reddit, Twitter, and Hackernews.	Text extracted and normalized from WARCs	~100,000,000 posts	Json	NLP, sentiment, linguistics	2022	^[96]^[97]	J. Baumgartner
SEC Filings	EDGAR \| Company Filings	Text extracted.		csv	NLP
CNAE-9 Dataset	Categorization task for free text descriptions of Brazilian companies.	Word frequency has been extracted.	1080	Text	Classification	2012	^[98]^[99]	P. Ciarelli et al.
Sentiment Labeled Sentences Dataset	3000 sentiment labeled sentences.	Sentiment of each sentence has been hand labeled as positive or negative.	3000	Text	Classification, sentiment analysis	2015	^[100]^[101]	D. Kotzias
BlogFeedback Dataset	Dataset to predict the number of comments a post will receive based on features of that post.	Many features of each post extracted.	60,021	Text	Regression	2014	^[102]^[103]	K. Buza
PubMed Central	PubMed® comprises more than 35 million citations for biomedical literature from MEDLINE, life science journals, and online books.	None	35 Million	Text	NLP
USPTO	The United States Patent and Trademark Office			Text	NLP
PhilPapers	Open access collection of philosophy publications			Text	NLP
Book Corpus	A popular large-scale text corpus.	None		Text	NLP	2015	^[104]	Zhu, Yukun, et al.
Stanford Natural Language Inference (SNLI) Corpus	Image captions matched with newly constructed sentences to form entailment, contradiction, or neutral pairs.	Entailment class labels, syntactic parsing by the Stanford PCFG parser	570,000	Text	Natural language inference/recognizing textual entailment	2015	^[105]	S. Bowman et al.
DSL Corpus Collection (DSLCC)	A multilingual collection of short excerpts of journalistic texts in similar languages and dialects.	None	294,000 phrases	Text	Discriminating between similar languages	2017	^[106]	Tan, Liling et al.
Urban Dictionary Dataset	Corpus of words, votes and definitions	User names anonymised	2,580,925	CSV	NLP, Machine comprehension	2016 May	^[107]	Anonymous
T-REx	Wikipedia abstracts aligned with Wikidata entities	Alignment of Wikidata triples with Wikipedia abstracts	11M aligned triples	JSON and NIF	NLP, Relation Extraction	2018	^[108]	H. Elsahar et al.
General Language Understanding Evaluation (GLUE)	Benchmark of nine tasks	Various	~1M sentences and sentence pairs		NLU	2018	^[109]^[110]^[111]	Wang et al.
Contract Understanding Atticus Dataset (CUAD) (formerly known as Atticus Open Contract Dataset (AOK))	Dataset of legal contracts with rich expert annotations		~13,000 labels	CSV and PDF	Natural language processing, QnA	2021		The Atticus Project
Vietnamese Image Captioning Dataset (UIT-ViIC)	Vietnamese Image Captioning Dataset		19,250 captions for 3,850 images	CSV and PDF	Natural language processing, Computer vision	2020	^[112]	Lam et al.
Vietnamese Names annotated with Genders (UIT-ViNames)	Vietnamese Names annotated with Genders		26,850 Vietnamese full names annotated with genders	CSV	Natural language processing	2020	^[113]	To et al.
Vietnamese Constructive and Toxic Speech Detection Dataset (UIT-ViCTSD)	Vietnamese Constructive and Toxic Speech Detection Dataset		10,000 Vietnamese users' comments on online newspapers on 10 domains	CSV	Natural Language Processing	2021	^[114]	Nguyen et al.
PG-19	A set of books extracted from the Project Gutenberg books library			Text	Natural Language Processing	2019		Jack W et al.
Deepmind Mathematics	Mathematical question and answer pairs.			Text	Natural Language Processing	2018	^[115]	D Saxton et al.
Anna's Archive	A comprehensive archive of published books and papers	None	100,356,641	Text, epub, PDF	Natural Language Processing	2024

Close