★ Dav Posted May 19, 2007 Report Posted May 19, 2007 9 guests, 8 members, 0 anonymous membersDav, Google.com, Falcoknight, the_accountant, Rowen, Top_Gun, Yahoo.com, SeVeR, Suicide_Run, No_Remorse, MSN.com Hopefully this will mean more people downloading the game SSCC Desert Storm OwnerSSforum Admin
★ Maverick Posted May 20, 2007 Report Posted May 20, 2007 hm indeed Well as long they don't hog the bandwidth I don't think they are much of a problem Check out your zone population statistics at stats.sshq.net! MaverickSubspace Statistics AdministratorRetired SSCU Trench Wars Super ModeratorTWCore Coordinator Administrator
★ Dav Posted May 20, 2007 Author Report Posted May 20, 2007 i was just getting at the high search engine activity means (hopefully) more people will find us. I'm sure they take up next to no bandwidth doing their thing. SSCC Desert Storm OwnerSSforum Admin
rootbear75 Posted May 20, 2007 Report Posted May 20, 2007 i think half of those guests are also robots from other search engines. http://i157.photobucket.com/albums/t54/badgersocks/FHTG/FHTG%20-%20redone%20shizniz/tgmember11.pngrootbear75> here is me nude <spoiler tag: Pervert... how many of you actually clicked this?>Samapico> I actually clicked the spoiler before reading what it was Corey> I clicked it cause i read what sama said first. darkreb0rn> I clicked it because I wanted to see you naked... rootbear75> O.o __________________________________2:IdleRPG> Mr Snuffleluphagus walked face-first into a tree. This terrible calamity has slowed them 0 days, 00:01:22 from level 18.2:rootbear75> for fucks sake...
🜲 PoLiX Posted May 20, 2007 Report Posted May 20, 2007 Nah. If you saw the Robots list I have entered... yeah, haha. It is a cleaned up version of the "ULTIMATE ROBOTS LIST" but still, it has most of em. Googlebot hits us the most. In 10mins we had 86 hits from it yesterday, 4 from yahoo, and 1 from msn. I had to disable the logs, cause last time there was almost 500000 from Googlebot alone. SSForum.net - September 01, 2002 - Rowen (SSDownloads.Com), PoLiX (SSCentral.Com), and Cyberise (Subspace.Net)
Audry Posted May 20, 2007 Report Posted May 20, 2007 GO GOOGLEBOT GO! http://i104.photobucket.com/albums/m195/AudreyND/audryinwg6.png
Gravitron Posted May 20, 2007 Report Posted May 20, 2007 That's silly.All they do is archive the page 20 times a minute, leech bandwidth and eat system resources.At least the google one seems to pay attention to robot.text and follow guidelines so it doesn't rape your page with updating its cache (although it WILL rape the server unless told not to, so fix your bot.txt properly).Aside google, the only other bot you're going to want to allow access is web.archive.org, any other bot should be IP banned from AXS, website-wide. "The true measure of a man is how he treat someone who can do him absolutely no good."- Samuel Johnson
★ candygirl Posted May 21, 2007 Report Posted May 21, 2007 Hope it works. SFSS Forum adminOwner and sysop of SSCC Star Wars Empirehttp://sfss.org/images/sflit.jpgCandygirl QUOTE(AceSpades Who ever keeps quoting me needs to stop. Otherwise I'm gonna get my friend Mr. Stabby out.QUOTE(Courage is resistance to fear and mastery of fear-not absence of fear.-Mark Twain
★ Maverick Posted May 21, 2007 Report Posted May 21, 2007 Aside google, the only other bot you're going to want to allow access is web.archive.org, any other bot should be IP banned from AXS, website-wide.Erm, but wouldn't SSForum then be found by any other search website apart from google? Check out your zone population statistics at stats.sshq.net! MaverickSubspace Statistics AdministratorRetired SSCU Trench Wars Super ModeratorTWCore Coordinator Administrator
Gravitron Posted May 21, 2007 Report Posted May 21, 2007 I'm speaking from resources standpoint, you don't want more than these two bots to crawl/cache/refresh/b-w leech your site.All the other engines are deploying dataminers to crawl on google, so basically once you're listed on google by their bot, you're listed on everyone. "The true measure of a man is how he treat someone who can do him absolutely no good."- Samuel Johnson
★ Rowen Posted May 23, 2007 Report Posted May 23, 2007 It's normal. SSForum.net (http://www.subspace.co) - September 01, 2002 - Rowen (SSDownloads.Com), PoLiX (SSCentral.Com), and Cyberise (Subspace.Net)<br /><br />May those in the halls slumber, while we prepare an unheard opening experience; when it is ready, we will enchant the atmosphere with one word: Rock.
Recommended Posts