You can rely on rockhoster.com and their cheap VPS service.
They have hosted several websites for me and I have no complaints.

They are able to help you with everything you may need (scripts installation, etc.) for free.