Hi all,
We've just configured a simple rate limiter on the Cloud VPS web proxy
that limits traffic from a single IP address to 100 requests/second. The
limit is designed to be high enough that it shouldn't affect most normal
workflows while also being low enough to properly block excess traffic.
This is in response to some misbehaving crawlers that were causing
instability in the proxy service. We applied a similar rate limit to
Toolforge earlier this year.
Please be in touch if this is causing issues for your project.
Thanks!
-- Taavi
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information:
https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…