Comments on: Time to crawl back! Download Google Groups using a crawler

By: asphalto

asphalto — Thu, 24 Mar 2011 10:17:24 +0000

Hello
the xml script doesn’t works anymore… It causes an internal server error 500 on google server.
May could be a protection system? In this case, how can I to delay requests?

thanks for your support

By: Nils Kaiser

Nils Kaiser — Thu, 09 Dec 2010 09:56:57 +0000

Check out http://pastebin.com/Xe6f4s9s, is the format ok there?

By: visitor

visitor — Thu, 09 Dec 2010 09:38:27 +0000

could you instead provide a link to the script, or put it in a paste bin somewhere. copying the above loses the correct format. thanks

By: DECHERF

DECHERF — Mon, 01 Dec 2008 16:03:28 +0000

Good afternoon Sir,

I am a student and I would like to know if you have ever used this data-extracting tool with Java classes (not in command line). In fact, I am well using it in command line (with XML, X-Query) but I need to catch the stream extracted from Web-pages and I think it is not possible to catch the stream using a configuration script in XML like this, I use in command line. So I have tried since then to do it in Java using the packages of the project, but I haven’t succeed in it.
I would like to know if you had more informations on it.

Thanks to You

Best Regards