All projects

Crexi Commercial Real Estate Scraper

Cloudflare bypass + Next.js __NEXT_DATA__ extraction + API chaining to pull full Crexi CRE details.

The challenge

Crexi sits behind Cloudflare Turnstile - naive requests calls get 403s.

The solution

Three-layer Python pipeline: cloudflare_utils.py solves Cloudflare via Playwright; crexi_search.py extracts assets from window.__NEXT_DATA__.props on the map-results page; crexi_properties.py drills into each asset for full details. crexi_pipeline.py orchestrates, crexi_api_probe.py was used in discovery.

Results

Cloudflare

Bypass

Detail API

Enrichment

Map-bounded

Coverage