Brazilian's are notoriously rude at sporting events. I remember at Pan Ams in 2007, they would cheer like crazy every time a gymnast from another country fell.
They really put many people off with that atmosphere. Those empty spaces are a shame also. What's the point at booing the superior teams. They will learn the lesson when Brazil gets eliminated next.