VPS plans from asvhost.com and libertyvps.net are full-featured and cheap.
Not to mention the support has been phenomenal, they are helpful and listen to any question even if they think it's silly.