Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps (https://dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.). All language subsets have already been processed for recent dump… See the full description on the dataset page: https://huggingface.co/datasets/wikimedia/wikipedia.

🚀 Wikipedia Monthly Last updated: October 19, 2026, 06:34 UTC This repository provides monthly, multilingual dumps of Wikipedia, processed and prepared for easy use in NLP projects. 📊 Current Statistics Metric Current Export (October 2026) All Exports (Total) Languages 348 363 Articles 66.8M 333.7M Usage Load any language with a single line of code using 🤗 datasets. latest always refers to the most recent dump, while dated… See the full description on the dataset page: https://huggingface.co/datasets/omarkamali/wikipedia-monthly.

Wikipedia dataset containing cleaned articles of all languages. The datasets are built from the Wikipedia dump (https://dumps.wikimedia.org/) with one split per language. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.).

This dataset is a reading comprehension dataset based on Wikipedia articles coupled with LLM-generated questions and answers. Dataset Details Dataset Description All articles and answers come from Wikipedia articles, and all questions have been generated by Gemini-1.5-pro. All Wikipedia articles are from this Wikipedia dump, from which we sample randomly with seed 4242. There is a special case for Mandarin, as the Mandarin Wikipedia mixes Simplified Mandarin… See the full description on the dataset page: https://huggingface.co/datasets/alexandrainst/multi-wiki-qa.

Open Wikipedia (Markdown) Every Wikipedia article converted to clean Markdown, organized by language and updated from the latest Wikimedia dumps What is it? This dataset contains every article from every language edition of Wikipedia, converted from raw MediaWiki markup into clean, readable Markdown. Headings, bold, italic, code blocks, and internal links are all preserved as proper Markdown syntax, while templates, infoboxes, references, tables, categories, and… See the full description on the dataset page: https://huggingface.co/datasets/open-index/open-wikipedia-markdown.

Dataset Card for xP3x Dataset Summary xP3x (Crosslingual Public Pool of Prompts eXtended) is a collection of prompts & datasets across 277 languages & 16 NLP tasks. It contains all of xP3 + much more! It is used for training future contenders of mT0 & BLOOMZ at project Aya @Cohere Labs 🧡 Creation: The dataset can be recreated using instructions available here together with the file in this repository named xp3x_create.py. We provide this version to save… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/xP3x.

Dataset Card for Weblate Translations A dataset containing strings from projects hosted on Weblate and their translations into other languages. Please consider donating or contributing to Weblate if you find this dataset useful. To avoid rows with values like "None" and "N/A" being interpreted as missing values, pass the keep_default_na parameter like this: from datasets import load_dataset dataset = load_dataset("ayymen/Weblate-Translations", keep_default_na=False)… See the full description on the dataset page: https://huggingface.co/datasets/ayymen/Weblate-Translations.

Dataset Card for FLORES+ FLORES+ is an evaluation benchmark dataset for multilingual machine translation. Dataset Details Dataset Description FLORES+ is a multilingual machine translation benchmark released under CC BY-SA 4.0. This dataset was originally released by FAIR researchers at Meta under the name FLORES. Further information about these initial releases can be found in Dataset Sources below. The data is now being managed by OLDI, the Open… See the full description on the dataset page: https://huggingface.co/datasets/openlanguagedata/flores_plus.

Dataset Card for Flores 200 Dataset Summary ⚠️ This repository is no longer being updated ⚠️ A newer version of the FLORES dataset managed by the Open Language Data Initiative is available at https://huggingface.co/datasets/openlanguagedata/flores_plus. FLORES is a benchmark dataset for machine translation between English and low-resource languages. The creation of FLORES-200 doubles the existing language coverage of FLORES-101. Given the nature of the new… See the full description on the dataset page: https://huggingface.co/datasets/facebook/flores.