Web Scraping
- Open Source
Trafilatura: Open-Source Web Text Extraction for LLM Datasets and Research
Extracting clean, structured text from web pages is a foundational task for LLM training datasets, research corpora, and content analysis pipelines...
- AI
ScrapeGraphAI: LLM-Powered Web Scraping with Graph Logic
Traditional web scraping is fragile. A scraper built around CSS selectors and XPath expressions breaks the moment the target website updates its HTML...
- Open Source
LLM Scraper: Extract Structured Data from Web Pages Using LLMs
Traditional web scraping relies on brittle CSS selectors and XPath expressions that break the moment a site updates its markup. LLM Scraper takes a...
- Open Source
Douyin TikTok Download API: Open-Source Async Social Media Data Scraping Tool
Douyin TikTok Download API is an open-source, high-performance asynchronous tool for scraping and downloading content from four major Chinese and...