Closed Ram Problem

So I was playing Starbound yesterday, and it started lagging horribly. Now, I was using the 64-bit edition because I have a good computer, but I decided to try the 32-bit edition to try and make it go faster. This did work, but there was still lag. Upon a little bit of investigation, I realized that the memory tab on Task Manager's graphs was completely filled. That means 32-bit Starbound was using nearly 10 gigabytes!

Now, I was using mods, but I was only using the Avali mod and its addons, so I don't think that would have too much of an effect: I can run Minecraft with 200+ mods with little to no problems. I don't know where this problem came from, nor do I really wanna look to find out. I just want to know how to put a maximum on the amount of RAM Starbound can use without having to limit Java 8 itself.

I don't think graphics/processing cards will have much to do with this so I'm not going to bother looking them up. If you need them to answer this, I will get them.

 

Well, I guess I'll just look on my own. It is a java-based game, isn't it? Or is it a version of C? If it's java that makes things a bit easier... It's C++, so never mind trying to lower universal RAM.

Thanks for the answer.