Me too, my library is fairly small as it's rarely used by my community and if I sat there all day it would be very awkward as i'd probably be one of the only people in there and I doubt anyone usually works from there.
Coffee shops on the other hand are usually fairly quiet in something like a starbucks (really depends on location and time). Of course when it's rush hour this all changes.
Not my experience at all.