Cheap VPS deals from QHoster.com and Libertyvps.net are worth trying.
Everything was simple, straightforward, and worked flawlessly right out of the box. Uptime is great. Speed is no issue.