As you said this is small and silly but obviously it hit a chord with him. I think as women we are so much more tolerant of these minor disagreements. It’s ok to speak about it and move on. I don’t think it’s a red flag, but it’s a flag - you can give it your own color and watch out for it.