But it doesnt seem like you could burn more calories sleeping and resting than working out.
You certainly can burn more calories sleeping and resting than an hour of working out. And in most cases, you do ... you understand your body requires calories for resting, sitting or just sleeping, and since the balance of those hours are much longer than, say, an hour of light jogging, it will yield more.
You should figure out your base metabolic rate, which is usually a combo of your 5 hours of sleep and the other 19 hours of resting ... bear in mind this is a bare minimum. your body is burning calories all the time ... walking, standing, driving, sitting, etc.
for me, i just have 7 hours of sleep, 8 hours of desk work and 8 hours of sitting in my exercise journal ... real basic numbers ... and only add specific activity, not walking, not driving, etc. the number it yields is less than i probably actually burn, but i am conservative that way.