UNOFFICIAL incith-google 2.1x (Nov30,2o12)

pobunjeni · Post by **pobunjeni** » Sat May 31, 2008 8:09 am

speechles can you add new feature that google recently implement, whois for domains

if you type whois bbc.com you will get

speechles · Post by **speechles** » Sat May 31, 2008 2:13 pm

pobunjeni wrote:speechles can you add new feature that google recently implement, whois for domains

if you type whois bbc.com you will get

<speechles> !g .com whois bbc.com
<sp33chy> 2,400 Results | Whois record for bbc.com (Created on Jul. 15, 1989 and Expires on Jul. 14, 2011) @ http://whois.domaintools.com/bbc.com | easyWhois: whois for bbc.com @ http://easywhois.com/index.php?domain=bbc.com | easyWhois: webanomics for bbcenglish.com @ http://easywhois.com/?mode=webanomics&d ... nglish.com | bbc.com - Who.is @ http://www.who.is/whois-com/ip-address/bbc.com/

<speechles> !g .com.au whois google.com
<sp33chy> 295,000 Results | Google.com - Google @ http://whois.domaintools.com/google.com | Googlemusic.com - Google Music @ http://whois.domaintools.com/googlemusic.com | Whois.Net @ http://www.whois.net/whois_new.cgi?d=google.com | CoolWhois.com - WHOIS search of googl @ http://www.coolwhois.com/d/google.com

As demonstrated, you can already do this. The problem that comes up is most of these "onebox" additions work only on the .com server (not a limitation of this script, a limitation of google, blame them). So if you've set your default to other than "com", simply reference it in your whois query and it will work "!g .com whois site.here"

MellowB · Post by **MellowB** » Tue Jun 03, 2008 11:44 pm

Could it be that the !torrent trigger has stopped working or is that just me/my bot?

Getting a

[05:42:57] <Cocco> [05:42] Tcl error [incith::google::public_message]: can't read "reply": no such variable

since today.

djevrek · Post by **djevrek** » Wed Jun 04, 2008 5:36 am

I don't know is this a problem with eggdrop or your script, but when i type !wiki .sr serbia or !wiki .sr@sr-el serbia i got bot give me this.

<Moonshine> !wiki .sr serbia
<Spremna> Србија | Република Србија је континентална држава која се налази у југоисточној Европи (на Балканском полуострву) и у средњој Европи (Панонској низији). У саставу Републике Србије су и две аутономне покрајине Војводина и
<Spremna> ÐšÐ¾ÑÐ¾Ð²Ð¾ Ð¸ ÐœÐµÑ‚Ð¾Ñ…Ð¸Ñ˜Ð°. Ð¡Ñ€Ð±Ð¸Ñ˜Ð° Ð½ÐµÐ¼Ð° ÑÑƒÐ²ÐµÑ€ÐµÐ½Ð¸Ñ‚ÐµÑ‚ Ð½Ð°Ð´ ÐšÐ¾ÑÐ¾Ð²Ð¾Ð¼ Ð¸ ÐœÐµÑ‚Ð¾Ñ…Ð¸Ñ˜Ð¾Ð¼ Ð¾Ð´ ÐÐÐ¢Ðž Ð±Ð¾Ð¼Ð±Ð°Ñ€Ð´Ð¾Ð²Ð°ÑšÐ° Ð¡Ð Ðˆ, Ð° Ð¿Ð¾ÐºÑ€Ð°Ñ˜Ð¸Ð½Ð° Ñ˜Ðµ Ð±Ð¸Ð»Ð° Ð¿Ð¾Ð´ Ð¿Ñ€Ð¾Ñ‚ÐµÐºÑ‚Ð¾Ñ€Ð°Ñ‚Ð¾Ð¼ Ð£Ñ˜ÐµÐ´Ð¸ÑšÐµÐ½Ð¸Ñ… Ð½Ð°Ñ†Ð¸Ñ˜Ð°. ÐšÐ¾ÑÐ¾Ð²ÑÐºÐ¸ ÐÐ»Ð±Ð°Ð½Ñ†Ð¸, ÐºÐ¾Ñ˜Ð¸ Ñ‡Ð¸Ð½Ðµ Ð°Ð¿Ñ @ http://sr.wikipedia.org/wiki/Serbia

Same errors with latin characters

<Moonshine> !wiki .sr@sr-el ubuntu
<Spremna> Ubuntu | Ubuntu je Linux distribucija koja je uglavnom namenjena korišćenju na desktop računarima. Baziran na distribuciji Debijan, Ubuntu najviše pažnje posvećuje lakoći korišćenja, slobodi od ikakvih ograničenja, redovnom objavljivanju novih izdanja i lakoći instalacije. Ubuntu sponzoriše privatna kompanija južnoafričkog biznismena Marka Šatlvorta, Kanonikal. Naziv distribucije potiče
<Spremna> od afriÄke ideologije ubuntu (otprilike - â€žhumanost prema drugimaâ€œ), mada su predloÅ¾ena i druga znaÄenja. Najnovije izdanje distribucije je verzija 7.10 (Gutsy Gibbon), koja je izdata 18. oktobra 2007. godine. Verzija 8.04 (Hardy Heron) bi po rasporedu trebalo da bude objavljena 19. aprila 2008. godine. Ubuntu teÅ @ http://sr.wikipedia.org/sr-el/Ubuntu

Great job with whois from google and this new stuff for sr wikipedia. THANKS!

speechles · Post by **speechles** » Wed Jun 04, 2008 10:33 pm

MellowB wrote:Could it be that the !torrent trigger has stopped working or is that just me/my bot?

Getting a
[05:42:57] <Cocco> [05:42] Tcl error [incith::google::public_message]: can't read "reply": no such variable
since today.

<speechles> !t legal torrents
<sp33chy> 500 torrents | 24 Jan 08/Books IKEA 2008 Catalog 372 Pages -LegalTorren (11.26 MB, 147s, 4p) @ http://mininova.org/get/1126452 | 06 Oct 07/Books How To Use Your Mind eBooK PDF -LegalTor (482.51 KB, 84s, 1p) @ http://mininova.org/get/925484 | 18 Dec 07/Books How To Use Your Mind eBooK PDF -LegalTor (482.51 KB, 67s, 1p) @ http://mininova.org/get/1050965 |
<sp33chy> www.mininova.org/search/legal+torrents/seeds

!torrent works again... YAY!!
Same functionality and behavior as before. Nothing added, nothing removed, simply corrected. Get it here or on the first page of this thread.

djevrek wrote:I don't know is this a problem with eggdrop or your script, but when i type !wiki .sr serbia or !wiki .sr@sr-el serbia i got bot give me this.

That seems like the eggy is only following encoding for the 1st line of it's reply (I assume the first line of it's replies are perfect). The secondary line is completely missing any encoding (it appears to be using eggdrops standard encoding instead of the regional encoding. This is mangling the text)... ;/
I'm not sure if this is a problem with the 'cutter' portion of this script (which is part of the original script, I did not write this part) that handles splitting long lines into formatted output for irc display. I'll investigate this issue shortly to see where it's coming from. The encode_string functionality should carry over for all lines given by the bot for each trigger. Not just the first line of it's reply, this is not normal behavior and thanks for the heads up about it..

Hellster · Post by **Hellster** » Tue Jun 10, 2008 11:45 pm

when using the latest script (also the previous version)

!google 57 kilograms to pounds << or variation thereof
i get this error message in DCC chat and get no results announced

[21:42] Tcl error [incith::google::public_message]: can't read "desc": no such variable

Hopefully only a minor fix ?
Thanx.

speechles · Post by **speechles** » Wed Jun 11, 2008 2:41 am

Hellster wrote:Hopefully only a minor fix ?
Thanx.

What is your google default country set to? Also, what country is the IP the bot accessing google located in? because see below...

<speechles> !google 57 kilograms to pounds
<sp33chy> 467,000 Results | 57 kilograms = 125.663489 pounds | [PDF] Kilograms to Pounds conversion c @ http://www.metric-conversions.org/conve ... -chart.pdf | Metrical / imperial system converter (cm @ http://www.womenrussia.com/extopfaq10.htm | Weight Conversion Tables, NP Central @ http://www.healthyinfo.com/reference/we ... vert.shtml
<speechles> !google .nl 57 kilograms to pounds
<sp33chy> 467.000 Resultaten | 57 kilograms = 125.663489 pounds | [PDF] Kilograms to Pounds conversion c @ http://www.metric-conversions.org/conve ... -chart.pdf | Metrical / imperial system converter (cm @ http://www.womenrussia.com/extopfaq10.htm | Weight Conversion Tables, NP Central @ http://www.healthyinfo.com/reference/we ... vert.shtml

It works just fine for me, using "com" as default, or switching to any google country. It works for me in the United States, and my friends in the UK and in Italy (of course, using their respective country defaults and servers)...

Hellster · Post by **Hellster** » Wed Jun 11, 2008 9:27 am

my bot is in the US also , and it's set to the default the script was made for which i would presume is .com

A friend just tried another conversion of !google 1000 g to oz , and also got no response. *shrugs*

Edit: I switched the script to another US based eggdrop bot and it works fine now , *shrugs*

speechles · Post by **speechles** » Wed Jun 11, 2008 8:59 pm

Hellster wrote:my bot is in the US also , and it's set to the default the script was made for which i would presume is .com

A friend just tried another conversion of !google 1000 g to oz , and also got no response. *shrugs*

This is because that particular google server ("com") in combination with that particular IP location creates "alien" templating (google uses outdated or foreign templates for that IP range) and the script cannot parse it. By "alien", I mean the html markups are not occuring in a pre-determined pattern in which it can extract info. If you could perhaps contact me on efnet, using the contact details at the bottom of the header of the script I could solve this and add this missing template. There are others who mysteriously have no google functionality and I suspect this is the same reason. It could be solved with your help. I can't solve it alone because I've never seen this problem demonstrated, either by myself or any of my friends using this script. Anyone who can demonstrate this flawed behavior feel free to contact me, and in doing so get to be a guinea pig of sorts helping me get the new template working (since I cannot test it this is where the help is needed).

Hellster wrote:Edit: I switched the script to another US based eggdrop bot and it works fine now , *shrugs*

Yep, that IP range gets a google server which uses templates the script knows about and can parse gracefully. When you see it working correctly it looks beautiful.

speechles · Post by **speechles** » Sat Jun 14, 2008 2:22 am

Google recently updated a few templates without letting anyone know (how dare them >:]) but, seriously, I've addressed the issue and now calculations, did_you_mean's, and all the fun stuff you have come to expect will now work as intended with !google requests. Enjoy

Get the new script here (1.9.8l) or the first post of this thread...

-------
Old post that was here before - left for legacy purposes.

Had some time to investigate more into the problems eggdrop has regarding utf-8 and latin1. The problem seems to stem from the fact eggdrop cannot distinguish at all between utf-8/iso8859-1. So forcing certain things to be detected as iso8859-1 and others as utf-8 makes some things (especially latin1 based character sets) that didn't display correctly before, now magically look perfect without strict use of the encode_strings (keep in mind for any display problems most times it can be solved using the encode_strings array). The side effect of this is no longer is http 2.4 sufficient. It now requires the use of the -urlencoding switch which is only included in versions of http 2.5 and up. Anyone using eggdrop 1.6.19 series is fine, as that is the version of http package included. Anyone using 1.6.18 or less can use this (http 2.5) and copy it to your '/eggdrop/lib/tcl*/' folder. There is no need to place it within a seperate folder. For windrop the same rules apply, you must copy the file I mentioned above to your '\windrop\lib\tcl*\' folder if using a version of windrop less than 1.6.19.

This is for the most part to correct the limitations of google translations and it's horrifying ordeal concerning utf-8 queries and latin1 character sets, things now hopefully cross translate better. Wiki(pedia/media) also make use of this to keep urlencoding recognized as utf-8, so the bot treats it as such which is required for wiki(pedia/media). This may cause problems with certain untested languages, if it does let me know, so far in my tests it doesn't cause a single one.

The encode_strings section has been filled in better so languages very difficult to display (such as russian, bulgarian, serbian, ukranian, romanian, herbew, turkish, japanese, korean among others) are for the most part already included, with nothing to configure in order to use them. This should make it easier for people to understand how to use the encode_strings and add more to it.

With that said, Get the new script here or find it on the first page of this thread.

Note: If you encouter any issues with this version, revert back to 1.9.8j (keeping http 2.5 is fine, it will work on the new and old script, its just 2.4 that only works on the old) and please let me know about it.

-------
Old post that was here before - left for legacy purposes.

New version 1.9.8j (YAY!!) - Corrects flawed !youtube behavior (youtube updated it's html templates), also corrects erroneous html cruft appearing in !groups results (all local and usenet groups should now appear without cruft of any sort)..
All functions and behaviors should function correctly 100% if you find anything odd, please note it here in this thread. Thanks

Get the new script Here or the first page of this thread.

-------
Old post that was here before - left for legacy purposes.
New version 1.9.8i, corrects minor problems with !google zipcode lookups and html cruft injected into !video results.

Note: Also included is debug code for the main google procedure. Each time !google is triggered the html the bot receives will be placed into a file called 'igdebug.txt' in your eggdrop root. It is now possible for users to link me to a copy of their igdebug.txt when the script fails to parse anything. Using the html provided in the igdebug.txt I can add the missing template...

dotslasher · Post by **dotslasher** » Sat Jun 28, 2008 8:39 am

I have tried your latest beta version (v 1.98l) and I'm getting errors with all triggers.

Code: Select all

Tcl error [incith::google::public_message]: Unknown option -urlencoding, must be: -accept, -proxyfilter, -proxyhost, -proxyport, -useragent

*edit*
just tested the "j" version of the script and that one works.

speechles · Post by **speechles** » Sat Jun 28, 2008 9:24 am

dotslasher wrote:I have tried your latest beta version (v 1.98l) and I'm getting errors with all triggers.
Code: Select all
Tcl error [incith::google::public_message]: Unknown option -urlencoding, must be: -accept, -proxyfilter, -proxyhost, -proxyport, -useragent
*edit*
just tested the "j" version of the script and that one works.

I made it over abundantly clear that version beyond "j" REQUIRE http v2.5. http 2.4 is no longer enough.

from my post above wrote:Had some time to investigate more into the problems eggdrop has regarding utf-8 and latin1. The problem seems to stem from the fact eggdrop cannot distinguish at all between utf-8/iso8859-1. So forcing certain things to be detected as iso8859-1 and others as utf-8 makes some things (especially latin1 based character sets) that didn't display correctly before, now magically look perfect without strict use of the encode_strings (keep in mind for any display problems most times it can be solved using the encode_strings array). The side effect of this is no longer is http 2.4 sufficient. It now requires the use of the -urlencoding switch which is only included in versions of http 2.5 and up. Anyone using eggdrop 1.6.19 series is fine, as that is the version of http package included. Anyone using 1.6.18 or less can use this (http 2.5) and copy it to your '/eggdrop/lib/tcl*/' folder. There is no need to place it within a seperate folder. For windrop the same rules apply, you must copy the file I mentioned above to your '\windrop\lib\tcl*\' folder if using a version of windrop less than 1.6.19.

Hopefully you can see the bold above, and update to the current version. "j" is broken, google calculations and other things will not work within it. The encoding mechanism is also broken. This is why -urlencoding is used, to correct these limitations... I can only lead a horse to water, I cannot make him drink.

dotslasher · Post by **dotslasher** » Sun Jun 29, 2008 5:09 am

I had downloaded http v2.5, I just forgot to put it in the proper directory

sorry

and no need to be such an ass about it. Like you never got something wrong.

Kiru · Post by **Kiru** » Sun Jun 29, 2008 8:28 am

thanks for the update speechles!

and he was quite nice about it imo, considering your inability to read dotslasher

MellowB · Post by **MellowB** » Mon Jun 30, 2008 12:49 am

Updated to the latest version now. Had some slight problems at first (everything that was unicode before suddenly wasnt) but got it working. But srsly have no clue why it then suddenly was working again. *shrugs*

Either way, somehow the bot still is unable to read unicode from the input I give it. This has been a problem with the older versions for me and still is with the current one. (at least this is a problem with Japanese, Korean and similar "complicated" charsets/languages)
So yeah, searching google or wikipedia with some Japanese word is not possible at all - it just searches with some gibberish.

Also the !trans trigger is not parsed in unicode either.
It usually seems to use the charset that the translated to pair is using, so if I get some translation to Korean for example I have to set my IRC client to Korean to be able to actually read what the bot gives me as output. Could you maybe do some workaround or whatever to get the output to the channel in UTF-8? There must be some way to force the translation page of google to Unicode, right? :S
I kinda hope so... :>

Anyway, so far, thanks for the updates and fixes again. It sure is highly appreciated as always. :]