Yes, muscle weighs more than fat that takes up the same area - it's denser. You don't lose muscle with poor eating habits - you lose it by not using it, so to speak. Do you do resistance training? I highly recommend it if you don't.
Man who say it cannot be done should not interrupt man doing it - Chinese Proverb
"Eat food, not too much, mostly plants." Michael Pollan