I need to get over my fear of touching fish.?

We got a boat and we went out on a Sunday and the first fish I caught I grabbed a towel and took the hook out with a needle nose pliers. I really need to be able to touch fish because I love fishing and I probably could enter tournaments but if I can't touch fish it would be embarrassing. I can touch minnows all day long but as soon as there is a fish on the line I set the hook perfectly, get it in, and then what? Reach for a towel to take it off. Any tricks to get my fear to just be gone.