It's been the opposite with me. I've given people the benefit of the doubt despite the first impressions, keeping aside my instincts and then get a confirmation on my instincts were right. But in your case, while may be right about the unconscious bias, your instincts were only trying to protect you. And I think that's ok too. No harm done towards Ernest. If you ever meet him again, you have a chance to start over.