WORDPRESS SITES DATABASE PARSER IN PYTHON SOURCE CODE
Full source code: crawls a seed list (URLs, sitemap.xml, or links from pages), detects WordPress and its version, collects outreach contacts (e-mail, phone, socials), language and topic — then exports a ready-to-sell database to Excel or CSV.
Why it matters: a "WordPress sites database" is the top-selling dataset on this marketplace (3576 RUB, 844 sales). This parser builds such databases for any niche — cheaper than a single ready-made dump.
WHAT´S INSIDE:
• wp_cli.py — CLI: --seeds, --sitemap, snowball --depth, --workers, --proxy, --demo
• wp_core.py — all logic: CMS detection, contacts, language, filters, export
• test_wp_core.py — 79 self-tests, one command
• fixtures/demo_sites.json — sample sites for offline verification
• requirements.txt, README, GUIDE.pdf
WHAT IT DETECTS:
• WordPress via REST marker (rel="
https://api.w.org/"), X-Pingback, meta generator — with version, e.g. 6.4.2
• Non-WordPress CMS: Joomla, Drupal, Bitrix, OpenCart, PrestaShop, Magento, Tilda, MODX, Wix, Squarespace
• E-mails from page text, mailto: links and public RDAP/Whois — junk filtered out
• Phones: 8 XXX and +7 XXX normalized to +7XXXXXXXXXX, federal 9XX to +79XXXXXXXXX
• 14 social networks: Telegram, VK, WhatsApp, Viber, OK, YouTube, Instagram, Facebook, X, LinkedIn, TikTok, Dzen, RuTube
• Page language and region
WHAT IT DOES:
• Parses sitemap.xml, including sitemap-index of dozens of files
• Snowball crawling: discover new sites via links on found pages
• Polite: request delay, robots.txt, queue cap, retries with backoff
• Filters: WordPress only, with e-mail, by language/region, by topic keywords (word = 1 point, phrase = 3)
• Exports XLSX ("Database" sheet with filters + "Summary" sheet) and CSV (Excel/Google Sheets friendly)
WHO IT´S FOR:
SEO specialists and link builders, PBN owners, agencies building outreach lists. Anyone who needs relevant sites with real contacts.
FORMAT: .py sources (CLI + core + tests) + fixtures + PDF guide. Instant file after payment.
REQUIREMENTS: Python 3.9+. Tests run offline on built-in fixtures.
INPUT-OUTPUT: list of URLs or a sitemap → Excel/CSV database: host, CMS, version, e-mail, phone, socials, language, topic score.
VERIFICATION: python test_wp_core.py → 79 passed, 0 failed. Offline demo: python wp_cli.py --demo --out demo.xlsx → 8 sites, 5 WordPress, 4 with e-mail.
LICENSE: unlimited use in your own projects, selling collected databases is allowed. Reselling the code is prohibited.
MORE FROM THE STORE:
⟶ Avito Ads Parser: search, prices, monitoring — e-market.su /6174776
⟶ Wildberries + Ozon competitor parser: prices and stock in Excel — e-market.su /6155438
⟶ e-market.su Seller Profit PRO: Excel calculator — e-market.su /6164461
SEE ALSO:
• Telegram Channel Parser: a database of channels and contacts — e-market.su /6197795