"You don't need shorts" is a quote from Michael Palin's Ripping Yarns episode, Golden Gordon.

We often use it in our house to mean "you don't need fancy robes and lots of special equipment to do ritual".