Re: tlug: Linux Agents/Robots ??

[simon@example.com (Simon Cozens)]

Subba Rao (lists.tlug):
>Are there any command line search agents/bots/crawlers for Linux? I want
>to search a few engines at the same time for some key topics.

OK, that doesn't need a bot or crawler, does it? Just something to
grab a URL from the command line; look into wget or lynx -dump

If you have Perl handy, perl -MCPAN -e 'install WWW::Search' then do
this: (completely untested)

#!/usr/bin/perl -w
use WWW::Search
my $query = "@example.com";
for (qw(AltaVista MetaCrawler NetFind Excite HotBot Crawler Metapedia Gopher
LookSmart Snap Monster NorthernLight MSIndexServer HotFiles Dejanews Yahoo GoTo
SFgate Deja HeadHunter Verity Livelink Dice AltaVista Lycos WebCrawler Google 
Search97 PLweb OpenDirectory FolioViews Magellan Infoseek Fireball)) {
   my($search) = new WWW::Search($_);
   $search->native_query(WWW::Search::escape_query($query));
   my($result);
   print $result->url, "\n" while ($result = $search->next_result()) 
}

-- 
Entropy isn't what it used to be.
--------------------------------------------------------------------
Next Technical Meeting: March 11 (Sat) 13:00 Temple University Japan
* Topic: "What's new in Perl 5.6"
Guest speaker: Simon Cozens (TLUG Perl guru)
Next Nomikai Meeting: April 20 (Thu) Linux Conference 2000 Spring Ed.
--------------------------------------------------------------------
more info: http://www.tlug.gr.jp        Sponsor: Global Online Japan