Let's definitely state right off the bat that you are normal, healthy and need not worry about any medical condition that might be causing you to be super wet. If anything, the opposite should give you cause for concern at your age.
If you have always been like this even before using contraceptive, I think you can safely assume that this is your 'normal'. You can try other contraceptives to see if different hormones might make you less wet but I can't help but wonder if there might be an effect on your libido as well as the two are closely related functions. If there are any drugs available to make you less wet, I suspect it would also have an effect on your sex drive but you could always ask your GP at the next check up.
Many women who are super dry would envy your situation but I can understand why you might find your excessive wetness annoying.
If you're already in the bedroom, then I don't think there's much to worry about. Your partner would no doubt be thrilled to think he's had this effect on you. Perhaps you could discreetly keep a small hand towel around so you can give yourself a quick dab from time to time.
You could also suggest a foreplay session in the bathtub or spa as being in water can actually dry you up before intercourse. Since you're already in water, it's not going to be an issue being wet anyway. For sexy sessions out in public that start getting you aroused, consider using mini panty liners to save any embarrassment.
I noted that your age is 23 so if there's any added consolation, your body will probably change as you get older and have children so you might find that your wetness will even out later on.