Sitebunny Webcrawler
APIs
dev:
htts://api.crawler.42maru.com/dev/docs
prod:
htts://api.crawler.42maru.com/v1/docs
prod.lb:
http://34.64.96.117:8000/docs
prod.gcp01:
http://34.64.150.25:8000/docs
prod.gcp02:
http://34.64.162.175:8000/docs
Scrapyd servers
dev:
http://192.168.0.245:6800
prod:
http://34.64.116.62:6800
prod.gcp01:
http://34.64.212.236:6800
prod.gcp02:
http://34.64.38.137:6800
Monitorings
Uptime Kuma:
http://uptime.42maru.com/status/sitebunny
Grafana:
http://qa.grafana.42maru.com/d/5Bh5MGiSz/sitebunny-website-crawling-status?orgId=1
QA42
dev:
http://sitebunny-qa42-admin-dev.42maru.com/
prod:
http://sitebunny-qa42-admin.42maru.com/