New York, U.S.A.          Okay                     11.3      11.5      11.8 
 Austin2, U.S.A.           Okay                     37.2      39.4      42.2 
 Austin, U.S.A.            Okay                     37.5      37.8      38.0 
 San Francisco, U.S.A.     Okay                     43.6      43.9      44.4 
 Vancouver, Canada         Okay                     91.8      92.2      92.8 
 Florida, U.S.A.           Okay                     41.9      42.5      43.1 
 Sydney, Australia         Okay                      3.4       4.3       5.7 
 Melbourne, Australia      Okay                     13.5      14.9      16.2 
 Hong Kong, China          Okay                    230.5     237.3     249.6 
 Porto Alegre, Brazil      Okay                    146.3     150.8     156.8 
 Shanghai, China           Packets lost (10%)      103.5     128.7     153.7 
 Santa Clara, U.S.A.       Okay                     58.4      58.8      59.5 
 Amsterdam2, Netherlands   Packets lost (100%)                               
 London, United Kingdom    Packets lost (100%)                               
 Cologne, Germany          Packets lost (100%)                               
 Amsterdam3, Netherlands   Packets lost (100%)                               
 Munchen, Germany          Packets lost (100%)                               
 Kraków, Poland            Packets lost (100%)                               
 Stockholm, Sweden         Packets lost (100%)                               
 Madrid, Spain             Packets lost (100%)                               
 Amsterdam, Netherlands    Packets lost (100%)                               
 Paris, France             Packets lost (100%)                               
 Copenhagen, Denmark       Packets lost (100%)                               
 Cagliari, Italy           Packets lost (100%)                               
 Singapore, Singapore      Packets lost (100%)                               
 Lille, France             Packets lost (100%)                             

— Last edited 12:17PM, Apr 30, 2008

Yep i’m getting the same problem, we hit the server sludge at about 12:55 pm GMT

Thanks for the reports folks, we’re looking into the problem right now.

I tried this around 10am this morning when i came in and it worked then.

What’s the time difference there? It was back up around 2pm GMT I think.

Dave: There was a second outage after my post. The CDN provider is running a full investigation in what happened. It looks like the outage happened in a large london data center and affected several large european sites.

They will now add a second european location as a additional physical redundancy to make sure this doesn’t happen again.

Don’t blame it on us Brits! :P

This is truly unbelievable! I was about to hit the Go Live button on my first shopify integration for a client!

Not only is it unbelievable but it is disgraceful!

Our site is currently without stylesheets or images again. I believe this to be one of the reasons why our sales have halved over the last week. I am currently making emergency plans to move our shop elsewhere.

Please turn the CDN off as it obviously doesn’t work!!

Matthew,

When you say again? I’m worried! How many times has this happened?

Our swift move (2 day integration) was to recover a previous shop situation for a site which is going to do massive sales over the next month or two.

This is very worrying!

I guess there’s actually nothing to stop me changing our theme though so that we host the stylesheets etc. I might have to do that now.

Cheers
Tom

Hi folks, Yes, unfortunately the European servers of our CDN provider are down right now. We’re working with them to resolve this problem as quickly as possible.

Tom, our site hasn’t functioned properly for a week now. This particular outage has now lasted more than 3 hours during our peak sales time of the day!

I have just hardcoded all of our stylesheets and images to static.jadedpixel.com and this will do until I move the shop elsewhere next week.

We disabled the CDN for the time beeing until we can guarantee that the uptime matches our customer’s expectations.

Can we have more information on when this will be resolved?

Is there no temporary workaround? – currently the front end of my site is completely offline. Are we talking hours or days until this is fixed?

can we have an update on when this will be resolved It has been over 12 hours now and my site is still offline.

I am starting to worry..

Beechy: the CDN is disabled, and has been since yesterday afternoon. If you site doesn’t render correctly, clear your browser cache and restart it. All Shopify sites currently have their assets served from our Toronto datacenter.

Paul thanks for the update

If there are servers down, shouldn’t the CDN be intelligent enough to pick a different server? Surely the architecture lends itself well to redundancy?

Their automatic failover ( IP Anycast ) failed on the same occasion. They set up more redundancy in Europe now to address the issue. They brought online a new box in the netherlands and another in a different London data center.

We are waiting for them to give us the go ahead with re-enabling the CDN. We want to wait a bit to make sure that everything is running smoothly. Expect the CDN to come back later this week.