Print Page - Site Indexing

Title: Site Indexing
Post by: elite_thut on February 05, 2007, 11:40:02 PM

Hi,
I wanted to know if there was any mod or a way to ensure that some of our page (for example the articles) are indexed (by googleBot for example) and that others(like the forums) aren't...

Thanks

Title: Re: Site Indexing
Post by: eldacar on February 06, 2007, 07:09:41 AM

You can use a robots.txt file to restrict what the spiders will view and index.

Title: Re: Site Indexing
Post by: elite_thut on February 06, 2007, 11:49:36 PM

But I've heard that SMF blocks bots...is this true? And if yes, TinyPortal too?

If the answer is no...well everything is perfect.

Title: Re: Site Indexing
Post by: akulion on February 07, 2007, 12:12:56 AM

no its not true, smf nor tp block bots

TinyPortal

Development => International => Topic started by: elite_thut on February 05, 2007, 11:40:02 PM