Well, the first thing you should do is take a look at your stance. If you’re standing too wide, you’ll have a tendency to overuse your arms and hands. If this is the case, shorten your stance so that your feet are more shoulder-width apart.
If your rake is loose, there is a way to fix it. You can go to your local bike store and ask them to tighten the bolts that hold the handlebars onto the frame of the bike. If you don’t have a bike store nearby, you can take the bike to a shop or do it yourself.