google scripts stopped working ?

PloP · Post by **PloP** » Sun Mar 31, 2002 12:11 pm

is it just me being a n00b or have google blocked those http1.0 requests from bots in some clever way ?

(pluppa) DEBUG: Query built (http://www.google.com/search?q=freebsd&num=3)
(pluppa) DEBUG: Contacting website...
(pluppa) DEBUG: Got state (HTTP/1.0 403 Forbidden)
(pluppa) [SG] (#cn) PloP requested freebsd but got an error: Forbidden.

the ip on wich the bot is on isnt blocked i might add

PloP · Post by **PloP** » Sun Mar 31, 2002 12:12 pm

forgot to mention that i use supergoogle1.2 :/

[ This Message was edited by: PloP on 2002-04-01 15:00 ]

Jamman960 · Post by **Jamman960** » Sun Mar 31, 2002 10:46 pm

I'm also using the supergoogle script and I'm having the same prob. It appears that google have banned the "Tcl http client package"

I logged all packets sent and recieved when searching google through the bot and I did the same with my windows machine...

When you connect to a website your browser gives the server a client agent id the one used with the super google script is: "Tcl http client package..." and the one used in IE 6 and other versions is: "Mozilla/4.0 (compatible; MS IE 6.0; Windows 98)"

once google is told that the browser your using is "Tcl http client package..." it tells you to read the terms and conditions etc and refuses to do your search.

The agent ID is stored within the tcl libs so I guess unless we can change the id within those files and re-compile them we're stuffed

SniperAC · Post by **SniperAC** » Mon Apr 01, 2002 1:00 am

I took out the # in the main body of the script youll see it if you look it didnt give me the name of the site but it worked just the same

# putserv "PRIVMSG $channel :$query"

kills the looks but hey it works

PloP · Post by **PloP** » Mon Apr 01, 2002 8:07 am

uhm im in no way a l337 hax0r or anything i just tried this to see if it worked out:

i edited the http.tcl file in /usr/local/lib/tcl83 and search for 'agent' in the top of the file. i replaced the 'tcl http package.....somehting" with jamman's suggestion:
'"Mozilla/4.0 (compatible; MS IE 6.0; Windows 98)"' and now it works for me. dunno if it will work for others without destroying something in their setups, as i know very little about everything etc. etc.

PloP · Post by **PloP** » Mon Apr 01, 2002 8:09 am

gezuz im such a newbie to post stuff

its supposed to be /usr/local/libs/tcl83/http1.0/http.tcl
and that's on a bsd4.5 box

/me notices the 'edit' button way too late and runs for cover

[ This Message was edited by: PloP on 2002-04-01 05:13 ]

Bever · Post by **Bever** » Mon Apr 01, 2002 4:19 pm

Where do you get version 1.5? I'm using version 1.2 coming from Slennox's archive.

[ This Message was edited by: Bever on 2002-04-01 13:24 ]

Guest · Post by **Guest** » Tue Apr 02, 2002 2:18 am

Um, you don't need to edit the Http package if you want to change the default reply. The documentation at dev.scriptics.com tells this:

::http::config -useragent string
The value of the User-Agent header in the HTTP request. The default is "Tcl http client package 2.2."

So you'd go ::http::config -useragent "My own browser "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ALL YOUR BASE ARE BELONG TO US)"

brother · Post by **brother** » Tue Apr 09, 2002 9:24 pm

Indeed google.com changed something to there webserver so it will only reply to 'real' browsers that give legit useragent replies.

I have posted a 1.2fix version on this site but way too many bugs were present in that version, so i have asked slennox to take it down for now... you can apply the above hack to the supergoogle.tcl ofcourse to make a temporary fix, for now.

I have allready begun work on a 1.3 version and will continue this over the weekend, when i am happy with the result and it is tested on some different configurations i shall post it, should be done by beginning next week.

The 1.3 version will feature google groups search (as suggested by BarkerJr) and some bugfixes (such as the # sign-bug in a request). As I had little time last few months i could not look into it sooner; well i have some spare time at hand now so i should be able to deliver it on time.

Anyway, i am happy there are so many users allready; just a post to let you know i am not gonna let you people down.

Darude · Post by **Darude** » Fri Apr 12, 2002 4:26 pm

Found another working google tcl on http://eggnet.warpzone.org , since now it works perfectly for me...

Smartie · Post by **Smartie** » Mon Nov 11, 2002 2:15 pm

Is there now another script from brother ?
my script doesnt run on eggdrop 1.6.12 , FreeBsd 4.6 ,Tcl8.3.4 with http2.4

Xtreme2k2 · Post by **Xtreme2k2** » Fri Dec 13, 2002 11:50 pm

argh.. my script stopped working too :/ wonder why