By the way I made another small (but significant) change last night. I had the site set up some months back to not let any search-engine spiders crawl/index the site because of a massive problem I was having with sometimes several dozen spiders coming on the site simultaneously from the Chinese search engine Baidu. But what I realized later on was that other search sites like Google and Bing, which in fact are desirable, were not indexing the site and thus 500Eboard was not showing up in search results.
So I tweaked the robots.txt document in the root of the site and removed the restrictions on non-Baidu spiders, to permit indexing and encourage search-engine listings for this site. I've already seen some "good" spiders indexing things, so I know we're on the right track. Now it's just a matter of time to get the site caught up with the proper spiders.
Anyway, just thought I'd let y'all know about that small but notable tweak.
Cheers,
Gerry
So I tweaked the robots.txt document in the root of the site and removed the restrictions on non-Baidu spiders, to permit indexing and encourage search-engine listings for this site. I've already seen some "good" spiders indexing things, so I know we're on the right track. Now it's just a matter of time to get the site caught up with the proper spiders.
Anyway, just thought I'd let y'all know about that small but notable tweak.
Cheers,
Gerry