Should We Tell

We were getting ready to go swimming and Palmer was told to run and get on his swimming suit. A couple of minutes later he came running outside ready. The only problem was he couldn't find his swimsuit so he grabbed a pair of his brother's underwear. Should we tell the brother - I vote no.