Submit Your Article Forum Rules

Page 1 of 3 123 LastLast
Results 1 to 10 of 27

Thread: Volusion Servers Down Again

  1. #1
    WebProWorld MVP cw1865's Avatar
    Join Date
    Oct 2007
    Posts
    882

    Volusion Servers Down Again

    As many posters on this forum are probably aware, I have been a long time booster of Volusion. If you visit their website you will note that the offer includes a 99.99% uptime guarantee.

    What precisely is this uptime guarantee? When I decided to go with volusion, this was one of features that I found appealing. Personally, I thought of it as an indication of service, ie. on a yearly basis there are 8,760 hours *.9999 = 8759.124 meaning that in any given year I could expect 52 1/2 minutes of downtime.

    Over the first couple of year, I must note that I did not notice any significant downtime at all; however in the last 6 months, Volusion has experienced four serious outages. The first outage occured in 9/09 and apparently was the result of a critical piece of the system architecure, a second outage occured for the exact same reason approximately 3 weeks later.

    "Hello Craig,

    Early yesterday, one of our blade server chassis lost connectivity to our Storage Area Network. This resulted in many of our customers experiencing downtime or errors on their storefronts.

    Upon identification of the issue, we immediately brought HP on-site. After extensive troubleshooting, HP engineers diagnosed the issue as a failed mid-plane within the chassis. The engineers replaced the mid-plane, and all connections were restored.

    This is the second HP mid-plane that has failed in the past 30 days. While the chances of two failures of a similar nature are very remote, HP was able to confirm this to be the case. Based on the serial numbers of the two failed components, we have reason to believe that both came from a bad batch. We are researching this further with the help of HP’s labs, as well as performing a full audit on all of our HP equipment.

    We recognize the impact that yesterday’s outage may have had on your business. We are working diligently with HP to prevent a recurrence of this issue in the future.

    If you have any further questions or concerns, please do not hesitate to contact us. Thank you for choosing Volusion!

    Tells us how we're doing: Volusion Customer Service

    Raymond Black
    Volusion Support
    800-646-3517"

    Both failures resulted in thousands of dollars of lost sales and as a result, at that juncture I called them on the 'guarantee' - Volusion responded to this with a 'chump' credit:

    "Hello,

    Per the Service Level Warranty in our agreement (section 2C, Volusion Terms ), you are entitled to a partial refund of this month's service charge for website downtime.

    We promise 99.99% uptime in a given billing cycle. When downtime beyond 0.01% occurs (approximately 5 minutes), we issue 5% of your monthly fee for each additional 30 minutes of downtime. Downtime is calculated from the time your issue is recorded in our trouble ticket system until it is resolved. Note that not all performance interruptions qualify for downtime.

    A credit has been issued in the amount of $19.99. Please allow several business days for it to post to your bank records.

    We assure you we are dedicated to preventing future downtime.


    Best regards,


    Volusion Customer Care" [emphasis supplied]

    By the time I received the above notification, the system was operating within normal parameters and while I felt that I should've received a larger credit, I wasn't really in the mood to dispute the credit.

    Approximately two-three weeks ago, we had yet another outage, this time apparently the result of a denial of service attack on the system, which was apparently resolved fairly quickly and which seemed to have only a minor impact on my sales figures for the day. In light of the fact that volusion itself appeared to be a victim and in light of the fact that any credit issued wouldn't be worth the trouble of even sending an e-mail, I decided not to bother them with respect to the 'uptime guarantee'

    Finally, that brings us to today where a portion of Volusion's server's went down (according to them) which affected only 250 of their customers. Unfortunately I was one of the two hundred fifty and as I write this I have, yet again lost significant sales revenue.

    While a portion of this post is merely to gripe at a 'lost day' there is also a general point fo be made:
    1. Before making a hosting decision, try to understand precisely the meaning of any given uptime guarantee.
    2. Whenever possible, try to research the host's uptime reliability - obviously without any experience dealing with a new company this can be difficult.
    3. For webmasters dealing with more than one domain, consider diversifying your server risk by using more than one company so that a failure will only hit a portion of your websites. As a result previous failures with Volusion, instead of putting 'all my eggs in one basket' - I have begun utilizing different systems for my new 2010 websites.
    4. At this juncture, I am no longer comfortable recommending Volusion until their server reliability improves.
    Craig Walenta on Google+

  2. #2
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    7,999

    Re: Volusion Servers Down Again

    I have left two hosters silently and remain with four. Based on my personal experience:

    1. Those who writes most are ofte the least reliable.
    2. I take such guarantees with a grain of salt.
    3. If I had a site where I sold physical goods above a certain quantity, I would have at least two geographically balanced servers. Read more in Professional PHP 6 chapter 23.

      Quote Originally Posted by kgun View Post
      No other plugin. Not even the Google toolbar, that I have on my laptop.

      No I remeber an incidence some days ago. Search:

      pdofactory phpm

      Be carefull with the second and / or third hit, the PDF document link of the the book Professional PHP 6, I gave an example of in my document. When I clicked that link via FF, Acrobat Reader crashed hard. Tried it again and the same happened on my Xp computer. I had no problems though with the link on my Vista laptop.
      Source: http://www.webproworld.com/browsers/...tml#post499400

      I have not put the PDF version of that book on the internet. So the best may be to buy the book like I have done.

  3. #3
    Member
    Join Date
    Sep 2005
    Posts
    39

    Re: Volusion Servers Down Again

    Any piece of hardware is going to ultimately fail. I am not familiar with Volusion, but depending on how many clients and how much revenue they have, they should be able to invest in a fail over backup. At the least, if the main box goes down, box 2 picks up the requests. They should even have off-site fail over. A different city and different data center acting as backup.

    Looking at their website.. they are offering "Lowest Prices Ever." Low pricing has a flip side.

    Hope you get it figured out.

    Jer

  4. #4
    Junior Member
    Join Date
    Mar 2010
    Posts
    2

    Re: Volusion Servers Down Again

    Volusion's recent and frequent outages have been very hard on our business. I expect to see a formal plan from Volusion outlining what they are going to do to repair their tarnished reputation. I too would not recommend Volusion for new customers based on their recent performance. Volusion is a money-making machine and they can afford to do better. Once you host with them, you are practically stuck there. That kind of power comes with tremendous responsibility, which Volusion is currently shirking.

  5. #5
    WebProWorld MVP cw1865's Avatar
    Join Date
    Oct 2007
    Posts
    882

    Re: Volusion Servers Down Again

    Interesting that you should comment at this precise moment because as I received notification of your reply, their servers are down, yet again - Sunday, March 7th, 2010...."We are aware that some customers are experiencing interruptions with storefront functionality. We recognize the urgency of this issue and are dedicated to delivering a fast resolution. Engineers have been notified and are working to resolve. We will update this page as we learn more details."

    All I can say is that I hope its a short one...
    Craig Walenta on Google+

  6. #6
    Junior Member
    Join Date
    Mar 2010
    Posts
    2

    Re: Volusion Servers Down Again

    The systems issue is binary; you have fail-over (high availability) or you don't. 99.99% uptime implies redundant hardware, mirroring, etc. That's not happening. So there's no redudancy on the back end. Last week I lost several transactions after the database crash. This week, it could be anything. Not having near real-time failover is something Volusion must address before they can be trusted with new store-fronts. Existing customers can't move off the platform easily; new customers can and should be warned.

  7. #7
    WebProWorld MVP cw1865's Avatar
    Join Date
    Oct 2007
    Posts
    882

    Re: Volusion Servers Down Again

    Quote Originally Posted by anthonyk View Post
    Last week I lost several transactions after the database crash.
    We can commiserate together. I had a hangover effect from it too.

    Quote Originally Posted by anthonyk View Post
    This week, it could be anything.
    Knock on wood before saying that please, but you're right, on any given day now I have to wonder, am I in business or should I just go for a ride and hang out at Starbucks or something.

    Quote Originally Posted by anthonyk View Post
    Not having near real-time failover is something Volusion must address before they can be trusted with new store-fronts.
    Absolutely, I'm not giving them anything new.

    Quote Originally Posted by anthonyk View Post
    Existing customers can't move off the platform easily;
    So true, to a certain extent we get locked in.

    Quote Originally Posted by anthonyk View Post
    new customers can and should be warned.
    Absolutely, they obviously can't handle the customers they do have.
    Craig Walenta on Google+

  8. #8
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    7,999

    Re: Volusion Servers Down Again

    Quote Originally Posted by anthonyk View Post
    Once you host with them, you are practically stuck there. That kind of power comes with tremendous responsibility, which Volusion is currently shirking.
    My bolding.

    That is not correct:

    1. Handle the name servers from your registrar and not your hoster.
    2. Use relative paths in your site structure and store the code on your computer.
    3. Take regular (cron job) backups of your database. Store the backups on your computer.
    4. Then change hoster like this:
      - Upload the code and the database to the new hoster.
      - When everything is OK there (a mirror), change the DNS to point to the new
      hosters name servers.
    5. Then everything is changed when the new name servers are effective without a noticeable effect.
    6. If this is new to you, test it with a test site.
    7. Ideally use geographic balancing at two hosters. More on that in chapter 23 of the book I mentioned in my first post.
    8. You can leave your original hoster silently, deleting the code there when everything is OK with the new hoster.
    9. I have personally done this two times.
    10. It worked seamless and efficient.

  9. #9
    Junior Member
    Join Date
    Mar 2010
    Posts
    1

    Re: Volusion Servers Down Again

    Hi Guys this is my first post on Webproworld, I have been in touch with Volusion since first thing this morning. I actually contacted them for something else and while I was on live chat there servers went down. This is becoming very frustrating for us we actually have three sites with them. Here is a copy of the live chat basically I guess they suspect another "Denial of Service Attack" any advice on how we can avoid these server outages?
    Thanks
    Steve


    Hello, and thank you for choosing Volusion! A representative will be with you shortly.
    steve: how do we stop customers from being allowed to change the shipping rate. We just ad a customer change it to zero $ after we shipped and charged him for shipping, I did not think this would be an option for the customer? Also can they do the same with the actual product price if so how can we stop this.
    There are 14 people in queue ahead of you. Thank you for your patience.
    There are 14 people in queue ahead of you. Thank you for your patience.
    There are 14 people in queue ahead of you. Thank you for your patience.
    There are 11 people in queue ahead of you. Thank you for your patience.
    There are 11 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 7 people in queue ahead of you. Thank you for your patience.
    There are 6 people in queue ahead of you. Thank you for your patience.
    There are 6 people in queue ahead of you. Thank you for your patience.
    There are 5 people in queue ahead of you. Thank you for your patience.
    There are 5 people in queue ahead of you. Thank you for your patience.
    There are 5 people in queue ahead of you. Thank you for your patience.
    There is 1 person in queue ahead of you. Thank you for your patience.
    There is 1 person in queue ahead of you. Thank you for your patience.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    You are next in queue. We will be with you in just a moment.
    Matt S: Hello and thank you for choosing Volusion! I'll be right there to assist you.
    Matt S:
    Matt S: Can you please provide the order ID # for which you had this occur?
    steve: let me get this
    Matt S: No problem at all.
    steve: Im trying to get it but is there a server issues I hope not we just had one a few days ago. Getting the connection has timed out error while trying to login to our admin panel
    steve: site is also down!!!
    Matt S: I apologize, there is currently an issue that our IT team is looking into. They havent provided any information as to an ETA or what is causing it, however, they are updating status.volusion as soon as they have it
    steve: What is happening with Volusions servers i came to you to get reliability, I moved from Network solutions because of the same issues this is now becoming a common issues and will for sure effect our page ranking and indexing with search engines if it keeps up. Last time even your site was down. I need the 100 or 99.9 percent up time you quote.
    steve: while you are trying to fix the servers how do we lock the customer from changing the shipping and product costs where is this option in the admin panel
    Matt S: I understand the impact this can have to an online store and assure you that our IT team knows this as well and it working on mitigating the issue
    Matt S: I cant say for sure as I cannot access your site, however, the only option within the admin area that would allow for this would be in Settings > Config Variables under Checkout Variables. The field is Config Enable Allow Order Edit. It is likely turned
    Matt S: on and allowing your customers to edit their orders after they place them
    steve: OK I'll check this once I can actually access my site again. Coming back to the server situation... I have two sites with you and a third almost complete. I survive as a business on ecommerce with no other source of income. I am really quite concerned by the recent history, I would like you to pass my comments on to a level 2 or 3 customer service person so that we can find a remedy, I am sure you don't want to loose a loyal and valued customers but the detrimental impact on our business is my to priority. Please get someone to call me on 519 854 1446
    Matt S: I actually am a level 2 representative, I'm just helping with the high volume we are experiencing. I assure you that your business is important to us
    steve: OK Matt that's great, you will find that I am very fare and understanding and have been successfully in business for the past 21 years. I realise that technical issues like this happen but what do I need to do to avoid this in the future? Sever issues are avoidable what changes have you made in recent months that have had such outages, are we on an overloaded shared server? I need you help and a solution so that we can have faith ion your service, at the moment my business is completely at your mercy so lets work together and find a solution.
    Matt S: (Thank you for your patience. The operator will be back with you shortly)
    Matt S: We are doing everything within our power to mitigate the issues that have been occurring. There hasnt been any information released yet, however, if it is what we expect, another Denial of Service attack, there is little that can be done to prevent it.
    Matt S: We are looking into not only mitigating the impact, but also prosecuting those responsible as it is a felony offense.
    Matt S: These attacks are basically submission of a large amount of data causing servers to overload and timeout. The only defense against this is to block IP addresses as they come in, which is why it is taken as such a serious offense.
    steve: I have not heard of this before so why does it specifically effect only some Volusion sites.. or is it effecting all Volusion sites at this time? please prosecute these guys and please understand i am completely on your side but as a small family run business I am concerned about the impact of this on my income. Is this effecting any other providers outside Volusion or has someone got a vice with volusion.
    Matt S: (Thank you for your patience. The operator will be back with you shortly)
    Matt S: It intermittently effects everyone who utilizes functionality provided by the servers, which at this point is a large number of our customer base. There have been numerous providers large and small that have been effected by this type of attack, it
    Matt S: simply depends on the person who does it. I do know that even google has been attacked I believe in May of last year and it took their service down for quite some time.
    Matt S: Was there anything else I could do for you this morning?
    steve: No I do understand the situation, but just please get my sites up and running as they should be 99.9 and also please make arrangements to credit me in some way for this downtime and the last few server outages for all three of my sites.
    steve: No I do understand the situation, but just please get my sites up and running as they should be 99.9 and also please make arrangements to credit me in some way for this downtime and the last few server outages for all three of my sites.
    steve: Please email me once the server issue has been fixed

  10. #10
    WebProWorld MVP cw1865's Avatar
    Join Date
    Oct 2007
    Posts
    882

    Re: Volusion Servers Down Again

    Quote Originally Posted by kgun View Post
    My bolding.

    That is not correct:

    1. Handle the name servers from your registrar and not your hoster.
    2. Use relative paths in your site structure and store the code on your computer.
    3. Take regular (cron job) backups of your database. Store the backups on your computer.
    4. Then change hoster like this:
      - Upload the code and the database to the new hoster.
      - When everything is OK there (a mirror), change the DNS to point to the new
      hosters name servers.
    5. Then everything is changed when the new name servers are effective without a noticeable effect.
    6. If this is new to you, test it with a test site.
    7. Ideally use geographic balancing at two hosters. More on that in chapter 23 of the book I mentioned in my first post.
    8. You can leave your original hoster silently, deleting the code there when everything is OK with the new hoster.
    9. I have personally done this two times.
    10. It worked seamless and efficient.
    Yes, the nameservers can be changed in a flash, the problem is that the data is ON volusion's servers, you can't just pick up and move. To plug the data from Volusion into anyone else's system (Doesn't matter if its OSCommerce, Magento, 3dCart, etc.), there is going to be a 'migration' headache.
    Craig Walenta on Google+

Page 1 of 3 123 LastLast

Similar Threads

  1. How to Rewrite URL Using Volusion??
    By w3d in forum eCommerce Discussion Forum
    Replies: 2
    Last Post: 11-26-2009, 12:19 PM
  2. Volusion eCommerce
    By Volusion in forum Introductions
    Replies: 3
    Last Post: 11-07-2007, 02:30 AM
  3. Our Conclusion? Try Volusion
    By WPW_Feedbot in forum eCommerce Discussion Forum
    Replies: 1
    Last Post: 10-30-2007, 05:58 PM
  4. Volusion
    By cw1865 in forum Google Discussion Forum
    Replies: 2
    Last Post: 10-13-2007, 12:16 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •