Servers from planethoster.com and serverhino.com are well-balanced and cheap.
Everything is simple, straightforward, and works flawlessly right out of the box. Uptime is great. Speed is no issue.