14th Colony

Wed 19 November 2008

14thC: Membership has it's privileges - Register Free


Subscribe via email!

Get the latest 14th Colony content delivered to your inbox. Just enter your email address:

 Subscribe in a reader


Subscribe with Bloglines Add to Technorati Favorites



Search 14th Colony


Advertise on 14th Colony!


Spread your message!


An open letter to web hosts

Randall McCarley

by Randall McCarley
September 6th, 2007

Dear Web Hosting Company,

There is a major issue in your industry that you may not be aware of and I’d like to take a few moments to tell you about so that you can do a better job serving my peers.

I know you do a great job (at least 99.9% which is no small feat!) but lately even big, established web hosts have been failing us in one particular area: Digg traffic.

Digg traffic or the “Digg phenominon” is where a site that normally attracts a couple hundred to a few thousand visits in a day spikes to thousands of visits per minute. Of course this effect isn’t limited to Digg. There are other sources of large traffic jumps (like other social bookmarking sites and the news media) but the Digg phenomenon is probably the best known and most often referred to on message boards and blogs.

To the untrained (and automated) eye this may appear to be a DOS attack, but it isn’t. It’s real traffic from real people coming to our sites to see something cool, interesting or useful.

We work hard to make this happen and it really sucks when our host lets us down.

Of course we are aware that you have policies that we agreed to when we set up the account where you are justified to drop the site when big traffic spikes occur and in extreme cases suspending or terminating our long-standing business relationship. When these things happen we can’t help but wonder if you are missing the point: as website owners we count on you to stand up for us.

After all, we need you and the services you provide. As more stories of dropped sites when that magic moment hits spread across the internet, expect future customers to ask about how you handle these situations.

And you better believe that as website owners, promoters, SEOs, SEMs, designers and marketers we do talk about which web hosting companies can handle a couple days of boom traffic and which ones can’t. We are taking names and sharing them on forums, blogs and through email. These conversations are happening daily. And we are the people on the front lines. We are the decision makers and influencers. We need to know we can count on you not only when the worst happens, but the best.

Conversly, being able to take a Digg-pounding may result in some positive publicity for you.

What we are asking for is:

  • A clear policy on boom traffic
  • You to know the difference between the Digg phenomenon and a DOS attack
  • You to help us out when such an opportunity comes along

If you do these things and we can take advantage of these boom traffic situations it means our websites will be more successful and that we will need to upgrade our accounts (which means more money for you). If you won’t handle it we have to find hosts that can. You’ve been great to us so far, please see what you can do.

Sincerely,

Your web hosting clients

Next Article: Lessons of the Free Link Giveaway Previous Article: Is your website out of control? Redesign considerations

3 Comments to “An open letter to web hosts”

  1. Ezhil Says:

    did they reply back? :)

  2. Hirenseo Says:

    Randall,

    I found this article from my old bookmarks http://duggmirror.com/design/B....._The_Like/

    explain about Use of WP-Cache in Wordpress to relieve pressure from your MySQL server during high loads

    - Hiren

  3. rmccarley Says:

    @Ezhil - No, not yet…

    @Hirenseo - I know there are things that can be done on our end. I still don’t think that absolves the Web Hosts from doing what they are there to do: keep our sites up.

    The first time this site went popular it hit the Digg and del.icio.us home pages at the same time and was getting pounded by stumbleupon… and I had no idea any of it was happening because it was in the middle of the night and I was asleep!

    Thankfully my host took care of me. But I hear stories from people whose sites got suspended because the host thought the burst of traffic was a DOS attack. I’ve also heard of sites getting suspended because the host wasn’t prepared to use that much bandwidth. And the host later canceled that site’s contract!

    This is a two-sided issue. As website owners we are always looking for that big break and we count on all our vendors to back us up when it happens. We should be taking the time to investigate our hosts in advance to see what their policies are *just in case*.

    As our vendor providing a critical service our hosts should be fighting to keep our sites up. Investigating sudden bursts of traffic to ensure we aren’t in trouble (being attacked) instead of automatically shutting us down is a good start. Being able to load-balance quickly if needed is another good idea. Keeping up with what is going on is another one - how many times have the “victims” of a Digg had to contact their host to let them know the site was running slow or down? I’m saying there are solutions but the brunt of this issue really should be on the hosts to provide the excellent service they claim.

Leave a Reply