If you have SSH access in the first place, you don't really need to muck around with port forwarding and mysqlfront, really...
1. Upload the CSV to the server, just like you would any HTML/JPG/XYZ file.
2. SSH in to the host, and use:
mysql -u YOURUSERNAME -p YOURDATABASE
You'll be prompted for your password.
Then you can use MySQL's LOAD DATA INFILE command with the path to your CSV file.
http://mysql.com will have more details about how to work this command.
You could even write some kind of shell script or a PHP script to do this automatically whenver you upload a new file to some special directory or something.
There may well be a tool out there to do what the original question asked.
I'd try to Google for:
csv2sql
and then for
"convert CSV to SQL INSERT"
If those don't turn up something, it probably doesn't exist, because everybody else found it easier to just use mysql built-in tools than make a special tool just for that.