I find that I can have more carbs when I add exercise.
Congratulations on being so close to goal.
I never suggest this for people in Induction or early in OWL, but have you tried the low-carb breads? That might work better for you, and I can't tell much difference between those and whole-grain normal bread.