UNOFFICIAL incith-google 2.1x (Nov30,2o12)

[speechles]

This thread is to minimize the impact my modifications are having in the regular incith-google support thread. This modification at inception was meant just for me to use in my normal gaming related irc channels. Over the course of time, it has turned into a monster. Mostly due to requests from friends asking for numerous sites to be 'plugged' into it. Eventually they asked for the script to use in their channels, and suggested to me that I put something here, which I did at first within the main incith-google thread. Since this now has taken on a life of it's own it's time to do like others have suggested and spawn a new thread for it. So here it is, my attempt to cover every possible suggestion and all within the incith-google engine.

Code: Select all

# Basic usage guide:                                            #
#   .chanset #channel +google                                   #
#   !google [.google.country.code] [define:|spell:|movie:]      #
#      <search terms> <1+1> <1 cm in ft> <patent ##>            #
#      <weather city|zip> <??? airport>                         #
#   !images [.google.country.code] <search terms>               #
#   !groups [.google.country.code] <search terms>               #
#   !news [.google.country.code] <search terms>                 #
#   !local [.google.country.code] <what> near <where>           #
#   !book [.google.country.code] <search terms>                 #
#   !video [.google.country.code] <search terms>                #
#   !scholar [.google.country.code] <search terms>              #
#   !fight <word(s) one> vs <word(s) two>                       #
#   !youtube [.youtube.country.code] <search terms>             #
#   !translate region@region <text>                             #
#   !gamespot <search terms>                                    #
#   !gamefaqs <system> in <region>                              #
#   !blog [.google.country.code] <search terms>                 #
#   !ebay [.ebay.country.code] <search terms>                   #
#   !ebayfight <word(s) one> vs <word(s) two>                   #
#   !wikipedia [.wiki-country-code] <search terms>[#subtag]     #
#   !wikimedia [.www.wikisite.org[/wiki]] <search terms>[#subtag]
#   !locate <ip or hostmask>                                    #
#   !review <gamename> [@ <system>]                             #
#   !torrent <search terms>                                     #
#   !worst <system>                                             #
#   !best <system>                                              #
#   !dailymotion <search terms>                                 #
#   !ign <search terms>                                         #
#   !myspace <search terms>                                     #
#   !trends [.google.country.code] <YYYY-MM-DD>                 #

Enjoy.. and feel free to criticize my horrible tcl coding skills (I don't claim to be more than an amateur ) and complain when something doesn't work. But do it here rather than the official thread, thanks

http://ereader.kiczek.com/UNOFFICIAL-in ... -v1.95.tcl ( v1.9.5 - July 18th, 2oo7 ) - OLD (left for legacy purposes)
http://ereader.kiczek.com/incith-google-v1.98j.tcl ( v1.9.8j - June 19th, 2oo8 ) - Stable (missing features)
http://ereader.kiczek.com/incith-google.tcl ( v2.1x - Nov 30th, 2o12 ) - Present BETA (full featured)

google, wikipedia and ebay now use dynamic language selection and dynamic messaging. So searching in french, will give french results and french error messages. Works similar with any country's dialect. (eg. !google .fr something | !ebay .it pc | !wikipedia .de boot ). There are also settings within the config to control language selection (default language) if user omits it.

<speechles> !google .fr something
<sp33chy> 689 000 000 Résultats | Paroles You Give Me Something - James @ http://musique.ados.fr/James-Morrison-c ... 07583.html | Something. @ http://www.something.com/ | Something @ http://something.exprimetoi.net/ | Video James Morrison - You Give Me Some @ http://www.dailymotion.com/video/xjlku_ ... e-somethin
<speechles> !ebay .it pc
<sp33chy> 6988 Aste online | PC COMPUTER PENTIUM DUAL CORE 3.0GHZ+ASU, EUR 5,00(EUR6,00), Nuovo e Subito , 1m @ http://cgi.ebay.it/_W0QQItemZ260129871882 | PC CD ROM MEN OF VALOR, EUR 9,99(EUR9,00), Compralo Subito, 3m @ http://cgi.ebay.it/_W0QQItemZ180132487868 | KIT USB PER PC E NOTEBOOK HUB MOUSE LAN, EUR 20,00(EUR10,00), Nuovo e Subito , 5m @ http://cgi.ebay.it/_W0QQItemZ140132416039
<speechles> !wikipedia .de boot
<sp33chy> Boot | Ein Boot ist ein Fahrzeug, das nach dem archimedischen Prinzip auf dem Wasser, oder als U-Boot exakt ausbalanciert, (ebenfalls nach dem Archimedischen Prinzip ), in einer von der Besatzung exakt definierbaren Tiefe im Wasser schwimmt. Von Flößen unterscheiden sich Boote, wie auch Schiffe, durch den eigenen Antrieb. Während ein Floß lediglich durch die Strömung des @ http://de.wikipedia.org/wiki/Boot
<speechles> !news .es hilton
<sp33chy> 3.968 Resultados | Paris Hilton rompe el silencio y habla @ http://www.milenio.com/index.php/2007/06/27/85770/ | Larry King privilegia a Paris Hilton s @ http://www.prensalatina.com.mx/Article. ... anguage=ES | El otro castigo de Paris Hilton @ http://www.larioja.com/20070627/socieda ... 71726.html
<speechles> !wikipedia .nl asghdghasdghasdgh
<sp33chy> Uw zoekvraag heeft geen resultaten opgeleverd. Controleer of de woorden juist gespeld zijn.
<speechles> !ebay .de asdasjhasjdasjd
<sp33chy> 0 Artikel gefunden für asdasjhasjdasjd
<speechles> !news .com.br reirom
<sp33chy> Sua pesquisa - reirom - não encontrou nenhum documento correspondente.
<speechles> !local .fr tower near eiffel tower
<sp33chy> 1 740 Résultats | Best Of Tower @ 19, Boulevard Grenelle, 75015 Paris - 01 45 71 67 51 | White and Tower (SA) @ 10, Rue Civry, 75016 Paris - 01 40 71 07 19 | Bimbo Tower @ 5, Passage St Antoine, 75011 Paris - 01 49 29 76 70 | Tower International SARL @ 163, Route Bezons, 78420 Carrières sur Seine - 01 39 13 09 41
<speechles> !local .com.au marijuana near the forest
<sp33chy> Your search for marijuana near the forest did not match any locations.
<speechles> !local .com marijuana near the forest
<sp33chy> Did you mean: Forest City, NC; Forest, MS; Forest, VA; Forest City, IA; Forest, OH; Forest City, PA; Forest City, IL; Forest, IN; Forest City, MO; Forest, Uninc St Croix County, WI
<speechles> !local google tcl script that can scrape in damn near any language
<sp33chy> We could not understand the location any language
<speechles> !yt .de hello
<sp33chy> YouTube requires the .com switch at this time for returning .de results
<speechles> !yt funny
<sp33chy> 2,280,000 results | extreme funny (.....funny) @ http://youtube.com/watch?v=GuMMfgWhm3g | Chet Baker in Tokyo ' 87 - My Funny Va @ http://youtube.com/watch?v=dX-hMhMTjEg | Funny Commercials II (So many folks en @ http://youtube.com/watch?v=vvTU0rlhBVw | goodfellas Full "Funny Guy" Scene (DVD @ http://youtube.com/watch?v=twW_riHWz_4 | Melinda Doolittle - My Funny Valentine @
<sp33chy> http://youtube.com/watch?v=kNAxnwYDrAM
<speechles> !yt .it divertente
<sp33chy> YouTube Risultati | Grande Fratello Ungherese (troppo diver @ http://it.youtube.com/watch?v=lkSDmkvNYyQ | Divertente le papere del calcio 2 (Stu @ http://it.youtube.com/watch?v=MVskdlh_v1M | Acuto Doppiaggio divertente Film Rocky @ http://it.youtube.com/watch?v=VMghdDyGcpA | Tossico divertente (un incursione nost @ http://it.youtube.com/watch?v=z744jlPV8K8 | Caos a Cavallino ~ Divertente / Assurd @
<sp33chy> http://it.youtube.com/watch?v=83VCwp87c0k
<speechles> !yt .fr asdasuydauysduyasd
<sp33chy> Aucune vidéo ne correspond à "asdasuydauysduyasd".

EDiT: complete multi-language ability is now finished as you can see above and it looks damn sexy. All that is left is to add socket/timeout error detection to remaining procs. Then some code comparing to spot anything reused within the script to condense it. The basic optimizing game

EDiT2: wikipedia had problems displaying proper 'no results' message in some languages, have completely resolved the issue and added a new feature to the wikipedia parser, sub-tagging.. yay.. see an example below how this works:

<speechles> !w web scraping
<sp33chy> Web scraping | Web scraping generically describes any of various means to extract content from a website over HTTP for the purpose of transforming that content into another format suitable for use in another context. @ http://en.wikipedia.org/wiki/Web_scraping

<speechles> !w web scraping#toc
<sp33chy> Web scraping | ToC: Scraper sites; Legal issues; Technical measures to stop bots; Notes and references; See also @ http://en.wikipedia.org/wiki/Web_scraping#toc

<speechles> !w web scraping#legal
<sp33chy> Web scraping | Legal issues Scraping is against the Terms of Use of many commercial websites, and can lead to legal liability for those involved in authoring, distributing, and even using software which does so. The Digital Millennium Copyright Act in the USA and European Union Copyright Directive specifically address "Circumvention of Copyright Protection Schemes", which impact @
<sp33chy> http://en.wikipedia.org/wiki/Web_scraping#Legal_issues [1 Redirect(s)]

<speechles> !w web scraping#tech
<sp33chy> Web scraping | Technical measures to stop bots A web master can use various measures to stop or slow a bot. Some techniques include: Blocking an IP address. This will also block all browsing from that address.. If the application is well behaved, adding entries to robots.txt will be adhered to. You can stop Google and other well-behaved bots this way.. Sometimes bots declare who @
<sp33chy> http://en.wikipedia.org/wiki/Web_scrapi ... _stop_bots [1 Redirect(s)]

You can use this with any language as well, by using the country switch. This example is just to show the new #subtag feature. If you need it explained read thru the rest of this thread. Enjoy

[rix]

<speechles> !g starpump
<sp33chy> 30,000 results | Starpump Foorumid - Powered by XMB @ http://www.starpump.ee/ | Starpump Foorumid - Powered by XMB @ http://www.starpump.ee/viewthread.php | Welcome to starpump co @ http://www.starpump.com/ | Welcome to starpump co @ http://www.starpump.com/affinity01.html

<speechles> !g starpump
<sp33chy> 30,000 results
<sp33chy> Starpump Foorumid - Powered by XMB @ http://www.starpump.ee/
<sp33chy> Starpump Foorumid - Powered by XMB @ http://www.starpump.ee/viewthread.php
<sp33chy> Welcome to starpump co @ http://www.starpump.com/
<sp33chy> Welcome to starpump co @ http://www.starpump.com/affinity01.html

reget the script, there was a bug in it early on.. i've since corrected that with a better parser which fixes this problem.

Exactly the same after i had downloaded the file again. Luckily incith made an update and that version works.

[speechles]

HAW.. I mean, seriously, WTF?!
Do you honestly think I tried to fake those results?

Mainly.. How can it work just fine for me, my 2 italian friends and my british buddy, all in channels of our own running on our own bots (combination of windrop & eggdrops)???

So I think what actually happened is... perhaps you forgot to clean your web cache when you regot the script or you simply forgot which copy was which and your still using the old version. In any case, its the same script whether it be official or the unofficial, they are both incith.. so yeah

[rix]

Nope, i surely downloaded the new version, because i reconfigured it anwyay. I guess there's something in Tcl or Eggdrop version or smth...

And no, im not claiming you have faked anything.

[sdays]

Are you going to add "Yahoo" or "Youporn" soon?

[stalix]

youtube not work the rest nice

[speechles]

youtube not work the rest nice

youtube works again

<speechles> !yt fixed
<sp33chy> 26,800 videos | San Francisco Fixed Gear / Fatlace.com @ http://youtube.com/watch?v=H63FivObTLM | Macaframa SF Track Bike Promo (http://ww @ http://youtube.com/watch?v=F0AFpq6jFok | From The Programmer's Mouth: How The 200 @ http://youtube.com/watch?v=ky-YXvxYbck | The Balls are Inert.... FIXED (I feel @ http://youtube.com/watch?v=6cS18yG8DJI | Mash SF Trailer - Fixed Gear Movie ( h @
<sp33chy> http://youtube.com/watch?v=qaxAEXBBKfY

http://ereader.kiczek.com/UNOFFICIAL-in ... -v1.95.tcl

Adding youporn is out of the question, because i've tried adding these porno (pornotube for instance) sites before but they are always predominantly homosexual (YUCK!), but the yahoo suggestion is possible in the future...perhaps

in the meantime, added back support for iGN.

<speechles> !ign mario
<sp33chy> Mario (PC Game by Chaos Software) @ http://pc.ign.com/objects/003/003378.html | Super Mario Bros.: Mario's Movie Madness! (DVD) @ http://dvd.ign.com/objects/895/895402.html | Super Mario Bros. (DVD by Walt Disney Home Entertainment) @ http://dvd.ign.com/objects/794/794652.html
<speechles> !ign weeds dvd
<sp33chy> Weeds - Season One (DVD by Lionsgate IGN Score: @ http://dvd.ign.com/objects/829/829746.html | Weeds - Season Two (DVD by Paramount Home Entertainment) @ http://dvd.ign.com/objects/909/909100.html | Weeds - Season One (Blu-ray by Lionsgate) @ http://dvd.ign.com/objects/894/894623.html

edit: Fixed !review, Gamespot changed from relative path to full path in the href url's, so removed prepending site.
set query "http://www.gamespot.com/${ebcU}" -> set query "${ebcU}"

[sdays]

Oh and later on are ya gonna add "weather" soon?

[nsrafk]

This isnt a google scritp anymore It's and allround searchengine! ) Good job.

[agnostic]

I'm not a programmer so it might be very messy. Hopefully speechless can clear it up if he sees sense in this.

For v. 1.95, replace this at line 3967 - 3980

# check for !locate
foreach bind [split $incith::google::locate_binds " "] {
if {[string match -nocase $bind $trigger] == 1} {
# flood protection check
if {[flood $nick $uhand]} {
return
}
# call locate
foreach line [incith::google::parse_output [locate $search]] {
put_output $where $line
}
break
}
}

with

# check for !locate
set searchhost ""
if {[getchanhost [lindex $search 0] ] != ""} { scan [getchanhost [lindex $search 0]] %*\[^@\]@%s searchhost }
foreach bind [split $incith::google::locate_binds " "] {
if {[string match -nocase $bind $trigger] == 1} {
# flood protection check
if {[flood $nick $uhand]} {
return
}
# call locate

if {$searchhost != ""} {
foreach line [incith::google::parse_output [locate $searchhost]] {
put_output $where $line
}
break
} else {
foreach line [incith::google::parse_output [locate $search]] {
put_output $where $line
}
break
}
}
}

Now you can use !locate command for nicknames and not just ip addresses. This modification only allows looking up nicknames that are in the same channels the bot is in. Maybe someone can figure out how to make it global.

[testebr]

What is !top and !popular?

Never work here....

and !wikipedia dont work more.

[speechles]

What is !top and !popular?

Never work here....

and !wikipedia dont work more.

Actually, Wikipedia does work.. I was just unaware the bind for !wikipedia is absent...heheh.. notice?

Code: Select all

variable wiki_binds "w wiki"

about !top and !popular, those are gamerankings triggers and will read the top/popular games for whatever system you choose. The problem is the site is experiencing either a healthy dDoS or just major downtime...

Code: Select all

Currently: can't read "date": no such variable
Currently: while executing
Currently: "regsub {<nobr>} $date "" date"
Currently: (procedure "recent" line 126)
Currently: invoked from within
Currently: "recent $search"
Currently: (procedure "send_output" line 210)
Currently: invoked from within
Currently: "send_output "$input" "$chan" "$nick" "$uhand""
Currently: (procedure "incith::google::public_message" line 16)
Currently: invoked from within
Currently: "incith::google::public_message $_pubm1 $_pubm2 $_pubm3 $_pubm4 $_pubm5"

This is what you should see if you .set errorInfo right after using either of those triggers. Keep in mind, this is simple to fix, not really an error as much as the proc cannot get any html to parse since the query timed out. It's normal for it to go nuts with errors because it cannot generate its needed variables. There is already a catch error on the fetch_html which reports to any proc the problem, but only !google, !ebay, !wikipedia and a few others detect it presently. I fully intend to add timeout and socket error detection to all the procs eventually, just so they report the problem as output rather than falling thru into code and generating tcl errors, in the meantime, just ignore it... heh

@agnostic; The ability to use !locate on nicknames too is a great idea. I was wanting to do this but was unaware how to implement it with my shallow grasp of tcl. So thanks for the code and implementation as well

edit: added myspace video search, check my first post. Did some cleanup to the google proc making it cleaner for multi-language results without missing any of the lookups. Also finally completed !local and it's looking rather smart at the moment, as you can see below:

<speechles> !local trees near the forest
<sp33chy> Did you mean: Forest City, NC; Forest, MS; Forest, VA; Forest City, IA; Forest, OH; Forest City, PA; Forest City, IL; Forest, IN; Forest City, MO; Forest, Uninc St Croix County, WI
<speechles> !local .fr ahgsdahsdhjasd near ahsdjhsajhashj
<sp33chy> Nous n'avons pas pu interpréter l'adresse indiquée : ahsdjhsajhashj.
<speechles> !local .com.au kangaroo near sedney
<sp33chy> Did you mean: kangaroo near Sydney, NSW
<speechles> !local .com.au kangaroo near sydney
<sp33chy> 1,612 results | Kangaroo Migration @ 300 George St, Sydney, NSW 2000 - (02) 9221 6206 | Kangaroo Bakpak @ 665 South Dowling St, Surry Hills, NSW 2010 - (02) 9319 5915 | Kangaroo Move @ Abbotsford, NSW 2046 - (02) 9712 8846 | Kangaroo Trading @ 7 Grosvenor Pl, Brookvale, NSW 2100 - 1300 133 889

finally I have !local looking how I imagined it, looking intelligent

[speechles]

Some individuals may have problems with the # huge section of comments # at the top of this script crashing their bots somehow. I've uploaded the copy I presently use to the same url, here. I was trying to clean up those comments and make that section readable. If you have this issue it's safe to just remove those comments, starting the script with these lines:

package require http 2.4
setudef flag google
...rest of script continues...

[speechles]

Just a note that I've fixed the broken myspace, and added a new one for people to try out.. Google Trends..

Get the script in my first post, and let me know if this gives results particular to your region. I'm using the country switch and I'm only getting USA trends as you can see. Maybe this is because it's a new google feature and simply just has USA added so far, or maybe its IP location based on where the query originates and country switch is thereby made irrelevant.

Here is what i get regardless of the country (and yes, its dynamically using the correct google site before you even ask):

<speechles> !trends 2007-06-29
<sp33chy> Hot Trends (USA) | 1 virtual dissection | 2 papworth method | 3 richard jeni | 4 jodie sweetin | 5 taste of minnesota | 6 irshad manji | 7 hansen s disease | 8 iphone sales | 9 rita ragone | 10 iphone lines | 11 nancy daus benoit | 12 jazz singer reeves | 13 musician known as the sound | 14 jenna bush | 15 pink taco | 16 2007 nba draft grades | 17 ernie bushmiller | 18 indian lenti
<sp33chy> dish | 19 political columnist thomas | 20 jupiter island

<speechles> !trends .fr 2007-06-29
<sp33chy> Hot Trends (USA) | 1 virtual dissection | 2 papworth method | 3 richard jeni | 4 jodie sweetin | 5 taste of minnesota | 6 irshad manji | 7 hansen s disease | 8 iphone sales | 9 rita ragone | 10 iphone lines | 11 nancy daus benoit | 12 jazz singer reeves | 13 musician known as the sound | 14 jenna bush | 15 pink taco | 16 2007 nba draft grades | 17 ernie bushmiller | 18 indian lenti
<sp33chy> dish | 19 political columnist thomas | 20 jupiter island

<speechles> !trends .de 0001-12-25
<sp33chy> GoogleTrends requires use of YYYY-MM-DD format, your range chosen was invalid.

<speechles> !trends .com.au 2006-12-25
<sp33chy> There is no data on date - Dec 25, 2006. Please select a different date.

<speechles> !trends .de 2007-05-15
<sp33chy> Hot Trends (USA) | 1 jerry falwell | 2 i who have nothing | 3 liberty university | 4 thomas road baptist church | 5 kardashian | 6 andrea elmer | 7 zeta graff | 8 academy of country music awards | 9 heavy water | 10 acm awards | 11 moral majority | 12 robert thompson | 13 tony awards | 14 tony nominations | 15 opie and anthony suspended | 16 razr 2 | 17 indian bean tree | 18 little
<sp33chy> big town | 19 maxim hot 100 | 20 ivanhoe author

So.. Please check this for me if your from a country other than USA and post what your bot gives you for !trends results. Thanks.

edit: noticed that ebay now allows buy-it-now to remain even with bids... so I've adjusted it to take this into account now (before if someone bid it cancelled the ability to buy-it-now). you can see a sample of this in action below:

<speechles> !e .fr iphone
<sp33chy> 22 Enchères | 3 PIECES OF SILICONE SKIN CASE FOR APPLE, 2,00 EUR/3,00 EUR(5,00EUR), 0 Enchères/Achat immédiat, 13h 24m @ http://cgi.ebay.fr/_W0QQItemZ280128533582 | 3 PIECES OF SILICONE SKIN CASE FOR APPLE, 2,00 EUR/3,00 EUR(5,00EUR), 0 Enchères/Achat immédiat, 14h 15m @ http://cgi.ebay.fr/_W0QQItemZ280128549261 | Twin sim 2GSM comme iphone écran tactile, 90,00 EUR(9,90EUR), 0 Enchères, 1j 04h 50m @
<sp33chy> http://cgi.ebay.fr/_W0QQItemZ190125162033

<speechles> !e apple iphone in hand
<sp33chy> 399 Auctions | Apple iPhone AT&T Brand New In Hand 8gb, $680.00($19.99), 24 Bids, 19h 56m @ http://cgi.ebay.com/_W0QQItemZ330141335422 | New Apple 8G IPhone 2nd in line. Have ph, $710.00/$1,300.00($35.00), 3 Bids/Buy It Now, 15h 49m @ http://cgi.ebay.com/_W0QQItemZ190127630261 | Apple iPhone in hand! - BIN $900, $900.00/$900.00($20.00), 0 Bids/Buy It Now, 17h 12m @ http://cgi.ebay.com/_W0QQItemZ220126536887

It's these small attentions to detail that I hope people appreciate

[testebr]

[21:10:43] <me> !trends .com.br 2007-07-01
[21:10:46] <Bot> Hot Trends (USA) | 1 cristie kerr | 2 natalie gulbis | 3 morgan pressel | 4 dianaconcert.vh1.com | 5 george gipp | 6 saving silverman | 7 mike hargrove | 8 knute rockne | 9 chris drury | 10 the girl next door soundtrack | 11 daniel briere | 12 how i married my high school crush | 13 christy kerr | 14 scott gomez | 15 all star game | 16 wanna be made | 17 concert for diana vh1 | 18
[21:10:47] <Bot> alessandro scarlatti | 19 maggie lawson | 20 2007 mlb all stars

Only USA results?