Starbound Extreme framedrops makes game unplayable

I've tried everything, installed the mods to help fix the lag and make it optimized, used every version of the game (32 bit and 64) lowered settings but still it lags, like its 60 fps but once I start jumping around to the left or right it like freezes for 1 second or drops to 5 fps for 1 second.

Edit:
My specs are:
Intel HD 4400
I3 1.7ghz
4gb ram