Flutterby™! : Search engine, anyone?

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

Search engine, anyone?

2001-03-14 03:46:37+00 by Dan Lyke 1 comments

Any Perl hackers want to help with an open source search engine? After looking around at a few of the extant offerings I decided to brush off my old code and tune it up (I'll be deploying on Flutterby soon). Right now the index files take up as much space as the original documents, and on the non PostgreSQL version I still need to set up a better way to handle modifying files (and the PostgreSQL[Wiki] version is completely profligate with disk space), but it does phrases(!), "-" and "+" for exclude and require, and is written in Perl and can use DB_File so that you can deploy it on your favorite cheap web host. (And previous experience says that I can probably get 75% out of the indexes if I care, it's just that disk space is soooo[Wiki] cheap that it hardly seems worth it.)

[ related topics: Free Software ]

comments in ascending chronological order (reverse):

#Comment made: 2001-03-14 04:33:00+00 by: John Anderson [edit history]

Can't really offer to help at the moment, due to several other timesinks in my life, but I thought I'd point out that the April 2001 Dr. Dobbs has an article which details how the author strung together modules from CPAN to develop a site-indexing-based search engine. Haven't read the entire article yet, just the first couple paragraphs, and the RDBMS used is MySQL, but it might be worth a look.