On Tue, 18 Mar 2008, Jonathan Rochkind wrote:

> Wait, now ALL of your clients calls are coming from one single IP?
> Surely that will trigger Googles detectors, if the NAT did. Keep us
> updated though.

I don't know what Peter's exact implementation is, but they might relax
the limits when they see an 'X-Forwarded-For' header, or something else to
suggest it's coming through a proxy.  It used to be pretty common when
writing rate limiting code to use X-Forwarded-For in place of HTTP_ADDR so
you didn't accidentally ban groups behind proxies.  (of course, I don't
know if the X-Forwarded-For value is something that's not routable (in
10/8), or the NAT IP, so it might still look like 1 IP address behind a
proxy)

Also, by using a caching proxy (if the responses are cachable), the total
number of requests going to Google might be reduced.

I would assume they'd need to have some consideration for proxies, as I
remember the days when AOL's proxy servers channeled all requests through
less than a dozen unique IP addresses.  (or at least, those were the only
ones hitting my servers)

-Joe