I always thought a downvote was just a silent "Booooooooooo!"
It's like how people in an information bubble post something and get encouraged by all of the people who think that same way, but the majority of people are actually against the idea.