LOTS of men wear hooded caftans.
Not a bad idea. Just think of the possible colors.