Leave the redirects up. But do the redirects using the .htaccess file in stead of some code in the pages. It's most likely that those requests come from links pointing at the old pages and it would be a waste to lose the "link juice" from those links.
There are more sources of visitors than just the search engines,.
