Webboard: Index all post in the forum or website category?

[b***@mnogosearch.org]

Author: Alexander Barkov

I want to index all the sites, about "template"
Indexing posting in the forum categories and categories on the website
current indexer setup like this, but I'm confused a lot of link wikipedia and amazon are indexed by crawl
Realm http://*.com/*
Realm http://*.org/*
Realm http://*.net/*
Realm http://*.info/*
Tag template
Server http://www.templatesite.com/
Server http://www.template.com/
Server http://www.alltemplate.com/
I tried to use IndexIf *template* but this is bad, only categories that can index (not post) and all search results contained the phrase "template" in the title
I do not use maxhops, because I want to index as many sites that found by the crawl, only post about template
I tried using this setup, Realm http://*.com/*template* but I'm not sure that's true because I saw just delete the url of the database that is not defined by Server

Is my understanding correct:
you want to find all pages on the Internet that contain
the word "template"?

I'm afraid mnoGoSearch crawler is not very suitable for that
purposes. There are about 190 million active sites in the world,
according to the latest surveys. Every site has usually several
documents (some sites have hundreds and thousands documents).
It will take forever to crawl all these volumes of data.


Reply: <http://www.mnogosearch.org/board/message.php?id=21525>