Text only | Text with Images

TinyPortal

General => Chit chat => Topic started by: AVainberg on April 16, 2006, 02:29:03 AM

Title: Google spider
Post by: AVainberg on April 16, 2006, 02:29:03 AM
It looks like I have some problems convincing Google spider to crawl my site. All my TP site is under directory smf. My entry page is an empty index page that points to smf. So far it looks like Google is stuck on the first page smf/index.php.
I placed a sitemap on my home directory but this is not helping me so far.

It could be that I have to use .httpacess and this idea with the empty redirect home page is a NO NO for google spider.

On the other side Girafabot is having a field day on my site, to my happines.
Title: Re: Google spider
Post by: G6Cad on April 16, 2006, 08:26:28 AM
If you read back in the mods authors thread on SMF forums, I think you will get all the answers you want on that. :)
Title: Re: Google spider
Post by: AVainberg on April 16, 2006, 04:00:59 PM
Thank you G6. I investigated this issue.
First it looks like my home page blocked the Google spider and second all the new sites are in Google sandbox.
Title: Re: Google spider
Post by: Obi-wan on April 24, 2006, 01:25:00 AM
Glad to hear it.  I was going to reply that we've got more than enuff spiders on our forum and we'd be happy to send a few your way!!

:2funny:
Title: Re: Google spider
Post by: stormlrd on April 24, 2006, 01:49:07 AM
Quote from: Obi-wan on April 24, 2006, 01:25:00 AM
Glad to hear it.  I was going to reply that we've got more than enuff spiders on our forum and we'd be happy to send a few your way!!

:2funny:

LMAO i still like the ones that try to post the best hehe, the other day msn was trying to register for goodness sake haha
Title: Re: Google spider
Post by: crappyday on April 24, 2006, 01:57:43 AM
My forum is mostly closed off and that's about all the spiders do is register for a new account or try to retrieve password, silly bots :)
Text only | Text with Images