The best I have seen is clipshare. Its a script that you install.. Its mainly for an entire site but with some customization you can integrate it with your existing site. Here is the link ClipShare : Video Sharing Script - Youtube Clone - Youtube Script It costs about 200 but it works very well. Converts all videos to flash for faster downloading, uses PHP and MySQL.

Hope that helps

Seth