Yes, taking a look on your website would help.

If you're still here, could you pls provide us with:

1. Your website link
2. Your bounce rate - How many orders you get per a number of users visiting your site?

Other info may be also useful. If your stats are able to track the user actions on the site, try to see, which page are they leaving from? If it is the home page or the page they are entering the website (the "landing page") - then the problem may be in design/layout/accessibility and related features. If the user visits a few pages and then leaves, the problem may be found with other things - like prices, goods display issues, terms, etc.... That type of analysis may be extremely useful =)