Looks like you've got essentially a 100+ x 100+ lot so that is better than a ton of suburbia lots. And your side setbacks are marginal. You can do definitely grow your current footprint (in width) to page left and even depth towards page bottom. Only thing is if you ever want to be put in a pool, you need to be mindful of the orientation and how much rear depth you eat up because you cannot put a pool within that utility easement taking up the final 12' of depth on the backside of your lot.
For all intents and purposes, easiest way to look at this: your driveway comes in off that side street like it's currently shown, and your house grows 20' in width to page left. And you also have room for a certain portion of the front of the house to grow 10 or 12' towards the front setback. You still have wiggle to deepen it even if you plan on putting in a pool at some point. All in all, a nice & spacious one story house is very doable.
For all intents and purposes, easiest way to look at this: your driveway comes in off that side street like it's currently shown, and your house grows 20' in width to page left. And you also have room for a certain portion of the front of the house to grow 10 or 12' towards the front setback. You still have wiggle to deepen it even if you plan on putting in a pool at some point. All in all, a nice & spacious one story house is very doable.