I'd suggest being patient. It may take a while for it to disappear from the SERPs.
A bunch of our phrases dropped in google in late April but rebounded in May.
Keep pursuing good
SEO practices (link building, adding content, optimizing your site) and hopefully your SERPs will again improve.