Python Web Scraper Toolkit — 3 Ready-to-Use Scraping Scripts
★ INCLUDED:
1. amazon_review_scraper.py — Amazon reviews: rating, title, author, body, verified-buyer. Automatic page pagination.
2. reddit_comment_scraper.py — Reddit thread comments without OAuth. Parses branches recursively, sorts by score.
3. hn_comments_scraper.py — Hacker News comments via public Firebase API. Recursive collection of all replies.
★ DEPENDENCIES: requests + beautifulsoup4 (only for the Amazon script)
★ USAGE: python script_name.py URL [--output file.json]. All scripts save results to JSON.
★ ETHICS: respect rate-limits, pause between requests. Public content only. Purpose: research and analysis.
📦 ZIP → 3 .py scripts + README.txt | Python 3.8+ | requests + beautifulsoup4 | Amazon + Reddit + HN scrapers