Or at least, that’s what my access.log said.
Using this command via SSH:
tail -10000 access.log| awk '{print $1}' | sort | uniq -c |sort -n
to get the last 10,000 hits on this blog, I got this result (click for a better view):
The Yahoo crawler accessed this blog 1130 times for the last 45 minutes that this blog is up!
This is the reason why this blog went down again. Even if I have a dedicated server, Yahoo bot pounding this blog 1130 times every 45 minutes will bring this down. This blog is not ready for that kind of traffic.
So, what did I do? I blocked the Yahoo bot now on my .htaccess file. Hopefully, this will fix everything. I even put a crawl delay on my robots.txt for Yahoo bot and it seems that it is ignoring it. I’ll just unblock it next week when its insanity subsides.
may ssh access pla dreamhost ! d ka bumaba ranking mo sa Yahoo SERP sa pag block mo ng YahooBot? o bka nmn hacker yan ?
ang labo nito.. yahoo bot.. and bakit yahoo.net? and dapat YAHOO SLURP yan di ba un ang name ni Yahoo bot..
anyways.. it will lessen your ranking on yahoo
@Mojics… ang labo nya nga. pero yung Yahoo.net, sa yahoo din nakaregister. and they stopped crawling this blog now after i blocked them on my robots.txt. totally blinock ko na ang pasaway na bot. di bale nang walang Yahoo traffic, kesa naman lahat ng traffic, mawala. hehe. pero unblock ko rin sya after a month siguro.
Yun pala ang explanation kung bakit palaging down ang blog mo. Hehehe… 😆
Welcome ulit sa blogging world.
glad you are back master marghil!
baka po DOS attack, kase may mga kalaban po kayo sa SERPS. I’ve read the same on a ‘busby seo’ blog. Baka lang naman LOL
hmmm… your being targeted ah! hehehe… parang ung nangyari din sa bubsy SEO contest… i papacrawl ng mga spider ung site ng sumali para kumain ng maraming bandwith…
oooooooo! yahoo loves you so much 😀 hehehe.. oo nga baka may nag titrip lang ^__^ gusto ipa down ang blog u.. hehehe.. nyok 😉