Sitebunny Webcrawler

APIs

• dev: htts://api.crawler.42maru.com/dev/docs
• prod: htts://api.crawler.42maru.com/v1/docs
• prod.lb: http://34.64.96.117:8000/docs
• prod.gcp01: http://34.64.150.25:8000/docs
• prod.gcp02: http://34.64.162.175:8000/docs

Scrapyd servers

• dev: http://192.168.0.245:6800
• prod: http://34.64.116.62:6800
• prod.gcp01: http://34.64.212.236:6800
• prod.gcp02: http://34.64.38.137:6800

Monitorings

• Uptime Kuma: http://uptime.42maru.com/status/sitebunny
• Grafana: http://qa.grafana.42maru.com/d/5Bh5MGiSz/sitebunny-website-crawling-status?orgId=1

QA42

• dev: http://sitebunny-qa42-admin-dev.42maru.com/
• prod: http://sitebunny-qa42-admin.42maru.com/