Yes you must change your host now if the performance is disappointing. I'd like you to check out the fastest hosting provider I have used which is 4Goodhosting.com. The speed and overall performance of my site has been 3x more faster compare to the last hosting service I have used. The pricing is much reasonable and the support is 24 hours active. The support guy responds in just few minutes often with full solution. Go ahead and contact them.