I use clips and straps too for all my riding (or most--I have one single-track mtb with spd pedals).
For the kind of riding you're talking about where you need comfort and walkability I like the lower end Shimano spd touring shoes. For some reason, Shimano does a good job of this. These are good because the soles tend to be flexier and better for walking and I have used them for commuter days when I'm walking in them all day and they feel like a regular casual shoe for that. They are probably not stiff enough for hard-core spd click-in use but that's ok since I'm not clicking in. Meantime, they are plenty stiff for use with ordinary quill pedal use so you don't feel the pedal edge, they are slimmer, less bulky and easier in and out of toe clips than most casual shoes, and the low-end Shimano shoes are plain colors that blend in as casual shoes and don't make people ask why you're wearing cycling shoes.
I choose from among the cheapest or lightest or least objectionable of these:
Since they are not expensive, they also have the advantage of being expendable and comfortable for the long walk out if you have an unfixable issue on the trail somewhere. Trail riding can destroy cycling shoes if you have to walk much and it's nice not to destroy expensive shoes. Inexpensiveness might also mean you could buy two pair to satisfy your different sized feet.
I'm not sure how Shimano is on fitting wide feet (mine aren't wide) but the flexy low-end spd shoe idea might work in general. This is because there are only a few of us left still using clips and straps and having a thin but stiff sole on a non-bulky shoe is an advantage for that. A lot of people have moved effectively to flat pedals with no retention where these features don't matter, but for clips and straps they still do.
Most of my road riding is done with slot cleats for pull-back and pull-up, but for trails and mixed surfaces you mention, I don't mind going without the cleat.
--Mitch