CITYSCRAPER
Advanced Multi-Site Aggregator Engine
One engine. One mission. Nationwide yard sale data.
CITYSCRAPER TERMINAL
// DATA PIPELINES
// ENGINE CAPABILITIES
Real-Time Scraping
Automated collection every 4 hours across all pipelines
Supabase Storage
PostgreSQL-backed with full-text search and geo queries
Multi-Site Push
One scrape feeds YardShoppers.com automatically
API-Key Protected
Every endpoint locked behind authentication
Live Dashboard
Monitor scrape health, data volume, and push status
Error Recovery
Auto-retry with exponential backoff on failures