Forums Index > Mewsoft > Official Announcements > Searchawy Dmoz Crawler Plugin Released
mewsoft First Post Posted on: 06-04-09 06:57 PM
Searchawy Dmoz Crawler Plugin Released

Greatings from Mewsoft,

Today Mars 13, 2005 we released the Mewsoft Searchawy Dmoz Crawler Plugin.

The demo for this Plugin is here (new window will open):

http://www.mewsoft.com/cgi-bin/dir/admin.cgi?action=WebSpiders

This plugin allows you to spider all links direct from any number of  www.dmoz.org search engine categories or search results pages to your search engine database. This helps you to fill your search engine databse from the www.dmoz.org with correct and manually review sites by dmoz editors. You can crawle any number of categories or search results pages at once.

This means that, you browse normal the dmoz.org directory to the category page you want to get its links to your database and the Crawler will grap all the links information as you see it with all the details to your database.

This crawler also will work for you when you search the www.dmoz.org directory for specific keywords or phrases. For instance, if you want to get the sites about "web design", you enter this phrase in the www.dmoz.org search box and wait for dmoz search result to return, imagine these links now you can grab it to your database.

All links spidered will be added to your system Pending submissions to approve it.

This is a single file module Dmoz.pm that you place it with your Searchawy cgi files in the same cgi-bin/dir directory.

The cost for this plugin is $50 only. The order link is:

https://www.regsoft.net/regsoft/vieworderpage.php3?productid=72815

Thank you


Mewsoft Support
www.mewsoft.com