Men's board shorts/swim trunks pattern

Hi all, I want to make my husband a new pair of board shorts, since he doesn't much like the ones in the shops. I'd prefer the sort that's more fitted, without elastic or cord at the waist, but all the patterns I could find in McCalls, Butterick, Simplicity and KwikSew had either elastic or cord waists. Can anyone recommend a good pattern, or alternatively is there any reason why I couldn't just use an ordinary pants pattern, maybe substituting velcro for the zip? Thanks, Liz