'bots improve web searches & indexing but ruin the browsing experience for slow internet users or older websites that allow hotlinking.
They are here to stay, unless Neo fulfills the prophecy...
Yeah Bing has been pretty hardcore lately, suspect it's just refreshing all their links.. there's, what, 60,000 image links and 4000 gallery pages to reindex, but they're taking their sweet ass time.
And the gallery is pointless because it changes all the time. Ah well.
We can handle a lot more than 100-odd search engine bots.. the ~150 on plus and ~400 (simultaneous) users on porn are still probably not 10% of capacity.
Yet still I'm looking at new servers and more hardware..... Hmm
No email addresses are exposed on the site. And we use captcha to stop spamming.. let them crawl away. We have the resources to chew up time rather than them being on a 'useful' site.
Posted by: quasi [x] - (68.242.222.---)
Date: October 17, 2012 12:05PM
I saw the same thing as fossil earlier but looks OK now. For the last few weeks I've had frequent problems uploading photos, very slow (far slower than when I had dialup) or the page just up and disappears when I click to upload. No problems out of the ordinary on other sites; maybe there's a glitch in there somewhere.