Chitika - Turning Pageviews Into Profit
Powered by MaxBlogPress  

 


Yahoo Bot Is Pwning This Blog


For more information and special deals related to any of the issues on this page, place your cursor over the double-underlined links. All information supplied by Kontera.com. Kindly subscribe to my feeds via RSS reader or via e-mail if you want more updates.

Or at least, that’s what my access.log said.

Using this command via SSH:


tail -10000 access.log| awk '{print $1}' | sort | uniq -c |sort -n

to get the last 10,000 hits on this blog, I got this result (click for a better view):


Yahoo Bot Log

The Yahoo crawler accessed this blog 1130 times for the last 45 minutes that this blog is up!

This is the reason why this blog went down again. Even if I have a dedicated server, Yahoo bot pounding this blog 1130 times every 45 minutes will bring this down. This blog is not ready for that kind of traffic.

So, what did I do? I blocked the Yahoo bot now on my .htaccess file. Hopefully, this will fix everything. I even put a crawl delay on my robots.txt for Yahoo bot and it seems that it is ignoring it. I’ll just unblock it next week when its insanity subsides.

Download your free Guerilla Bloggers' e-book here!

If you like this post, buy me a beer!

Related Entries:

  • Yahoo! Mail and WebMessenger
  • It seems that Yahoo! is planning to give an unlimited e-mail storage for us. I always see that "The storage meter is going bye-bye" image on their e-m...

  • Yahoo Messenger Status Message Is Now Limited To 40 Characters?
  • Well, that is what I observed recently. I can't add a a status message that is longer than 40 characters. So, what happened? Is it intentional? I d...

  • The Top 7 Pinay Scandals In Yahoo!
  • Just check this Yahoo! search results for pinay scandals keyword. I can't believe we conquered the top 7! (Click the image for a larger view) W...

  • Down Offline And Online
  • You might be wondering what happened to me this past few days. No blog updates since Friday. Absent on Wordcamp despite the fact that I registered. Lo...

  • Beating Peteranswers.com on Yahoo.com
  • I was surprised today for a sudden increase in traffic on this blog. Actually, the number of visitors doubled. Checking my logs, I found out that the ...



8 Responses to “Yahoo Bot Is Pwning This Blog”

  1. gLENN Says:

    may ssh access pla dreamhost ! d ka bumaba ranking mo sa Yahoo SERP sa pag block mo ng YahooBot? o bka nmn hacker yan ?

  2. Mojics Says:

    ang labo nito.. yahoo bot.. and bakit yahoo.net? and dapat YAHOO SLURP yan di ba un ang name ni Yahoo bot..

    anyways.. it will lessen your ranking on yahoo

  3. marhgil Says:

    @Mojics… ang labo nya nga. pero yung Yahoo.net, sa yahoo din nakaregister. and they stopped crawling this blog now after i blocked them on my robots.txt. totally blinock ko na ang pasaway na bot. di bale nang walang Yahoo traffic, kesa naman lahat ng traffic, mawala. hehe. pero unblock ko rin sya after a month siguro.

  4. Kenneth Says:

    Yun pala ang explanation kung bakit palaging down ang blog mo. Hehehe… :lol:
    Welcome ulit sa blogging world.

  5. maggi Says:

    glad you are back master marghil!

  6. BM Says:

    baka po DOS attack, kase may mga kalaban po kayo sa SERPS. I’ve read the same on a ‘busby seo’ blog. Baka lang naman LOL

  7. juler Says:

    hmmm… your being targeted ah! hehehe… parang ung nangyari din sa bubsy SEO contest… i papacrawl ng mga spider ung site ng sumali para kumain ng maraming bandwith…

  8. Jehzeel Laurente Says:

    oooooooo! yahoo loves you so much :D hehehe.. oo nga baka may nag titrip lang ^__^ gusto ipa down ang blog u.. hehehe.. nyok ;)

Leave a Reply

*
To prove you're a person (not a spam script), type the security word shown in the picture.
Anti-Spam Image

By clicking the Submit Comment button, you hereby agree with my Comment Policy.






© Macuha.com | Make Money Online | Privacy Policy | WordPress | LoseMyMind | Doogle