Trafilatura: Open-Source Web Text Extraction for LLM Datasets and Research
Extracting clean, structured text from web pages is a foundational task for LLM training datasets, research corpora, and content analysis …
Tags
Web Scraping
ScrapeGraphAI: LLM-Powered Web Scraping with Graph Logic
Traditional web scraping is fragile. A scraper built around CSS selectors and XPath expressions breaks the moment the target website updates its …
LLM Scraper: Extract Structured Data from Web Pages Using LLMs
Traditional web scraping relies on brittle CSS selectors and XPath expressions that break the moment a site updates its markup. LLM Scraper takes …
Douyin TikTok Download API: Open-Source Async Social Media Data Scraping Tool
Douyin TikTok Download API is an open-source, high-performance asynchronous tool for scraping and downloading content from four major Chinese and …