If you have linked to one bad site that could also hurt you. You may want to make sure all the sites you have linked to have a
pr with Google.
I have not slept but three hours in the last two days so I hope this comes out ok.
If everyone links to you using the same text then Google could ban your site for that text only.
I would wait a little because Google is not finished yet before I started making a lot of changes but I would work on getting links to different pages on the site and for different key words.