You're right - you can only do so much, so don't be too hard on yourself! Losing some ground here and there is bound to happen, but as long as you identify it and make the necessary adjustments, you'll be fine! Keep on trucking!
Someone who is busier than you is working out right now.
There will come a day when you can no longer do this. Today is not that day.