I got rid of my scale. No joke! I'm going by how my clothes fit. I weigh myself no more than once every week or two weeks, at the gym at work. (I don't work out there, at least not so far -- I'm a total couch potato! I just go in to use their scale.)
Drop-kick that lousy scale, if it's making you miserable. You don't owe it anything! IMHO, scale weight isn't nearly as important as other measurements, like body fat composition, blood pressure, or waist measurement.
Hope this helps -- best of luck to you!