[x]We're back! After a failure of the drives in our database server, all data has been restored from last night's backup. The last 24 hours or so of submissions will likely need to be re-made but everything else should be okay. Please let me now if you notice anything not working as it should though. Thanks! -Petie


Users browsing this thread: 1 Guest(s)
Rebuilding Process Information Thread
#24
(01-07-2014, 03:50 PM)Raz Wrote: I wrote a scraper but the IP address I was using got banned pretty quickly, even if I randomized the IP/interval between requests Google looks for patterns in the search requests and will block too many similar requests with a CAPTCHA. The funny thing is, the biggest web crawler in the world doesn't let you crawl their servers. Huh.

Good ol' Google. It would be nice if people could just ask them to pass along the cached pages in a handy archive file but I doubt they'd even notice such a request, much less respond to it.
Thanked by:


Messages In This Thread
Rebuilding Process Information Thread - by Dazz - 01-07-2014, 11:44 AM
RE: Rebuilding Process Information Thread - by Phaze - 01-07-2014, 08:55 PM

Forum Jump: