Listening to sex - Does it make you a pervert or just curious?

I remember back in college when hearing people have sex in the next room  also every weekend, it seem to be a turnon.  Now that I have gotten older I wnat to know what others feel about this situation, and what you do when that happens.