flâneur

docx-corpus: 736K classified Word documents. Open DOCX dataset.

docxcorp.us · saved by 1 readers

Real .docx files from the public web, validated, deduplicated, and labeled by type, topic, and language. Built by SuperDoc. docx-corpus is the largest open corpus of classified Word documents on the public web. It contains 736,000+ real .docx files collected from Common Crawl, validated, deduplicated, and labeled by document type and topic. It is the first large-scale research dataset for DOCX, the world's most-used document creation format, which has historically been absent from document AI work built on scanned images and PDFs. Each document has a content hash, file size, detected language, and a type and topic label from a fine-tuned XLM-RoBERTa text classifier. The corpus spans 46+ languages and uses a 10-type, 9-topic taxonomy. Available as a HuggingFace dataset, a REST API at api.docxcorp.us, and downloadable manifest files. Built by SuperDoc. Source on GitHub. Dataset is ODC-BY; source code is MIT.

saved by