For more information and special deals related to any of the issues on this page, place your cursor over the double-underlined links. All information supplied by Kontera.com. Kindly subscribe to my feeds via RSS reader or via e-mail if you want more updates.
Or at least, that’s what my access.log said.
Using this command via SSH:
tail -10000 access.log| awk '{print $1}' | sort | uniq -c |sort -n
to get the last 10,000 hits on this blog, I got this result (click for a better view):
The Yahoo crawler accessed this blog 1130 times for the last 45 minutes that this blog is up!
This is the reason why this blog went down again. Even if I have a dedicated server, Yahoo bot pounding this blog 1130 times every 45 minutes will bring this down. This blog is not ready for that kind of traffic.
So, what did I do? I blocked the Yahoo bot now on my .htaccess file. Hopefully, this will fix everything. I even put a crawl delay on my robots.txt for Yahoo bot and it seems that it is ignoring it. I’ll just unblock it next week when its insanity subsides.
Download your free Guerilla Bloggers' e-book here!
If you like this post, buy me a beer!
September 11th, 2008 at 8:50 am
may ssh access pla dreamhost ! d ka bumaba ranking mo sa Yahoo SERP sa pag block mo ng YahooBot? o bka nmn hacker yan ?
September 14th, 2008 at 1:36 pm
ang labo nito.. yahoo bot.. and bakit yahoo.net? and dapat YAHOO SLURP yan di ba un ang name ni Yahoo bot..
anyways.. it will lessen your ranking on yahoo
September 14th, 2008 at 3:42 pm
@Mojics… ang labo nya nga. pero yung Yahoo.net, sa yahoo din nakaregister. and they stopped crawling this blog now after i blocked them on my robots.txt. totally blinock ko na ang pasaway na bot. di bale nang walang Yahoo traffic, kesa naman lahat ng traffic, mawala. hehe. pero unblock ko rin sya after a month siguro.
September 14th, 2008 at 4:40 pm
Yun pala ang explanation kung bakit palaging down ang blog mo. Hehehe…
Welcome ulit sa blogging world.
September 14th, 2008 at 4:47 pm
glad you are back master marghil!
September 14th, 2008 at 6:47 pm
baka po DOS attack, kase may mga kalaban po kayo sa SERPS. I’ve read the same on a ‘busby seo’ blog. Baka lang naman LOL
September 15th, 2008 at 12:54 am
hmmm… your being targeted ah! hehehe… parang ung nangyari din sa bubsy SEO contest… i papacrawl ng mga spider ung site ng sumali para kumain ng maraming bandwith…
September 15th, 2008 at 1:43 am
oooooooo! yahoo loves you so much
hehehe.. oo nga baka may nag titrip lang ^__^ gusto ipa down ang blog u.. hehehe.. nyok 