My family has a house just outside of town so I don't really know about lodging other than relative locations.
As for food my personal preferences, in no particular order, the bunnery (on Cache St. It's sort of hidden), Norah's fish Creek inn (hwy 22 in Wilson), the mangy moose (Teton village), dornans (in moose wy) I haven't been there but I've heard a place called The Bird is really good. Its off 191 just south of town. There is also a covered wagon dinner show thing with Bar T 5. They take you out to the place you eat in a covered wagon and if I remember correctly Indians come charging out "to attack" the wagons. I haven't been since I was about 6 or 7 but I lost my **** when that happened. And then grab a waffle at Corbets cabin on the top of Rendezvous Peak.
Hiking the best and closest to town will be anything in the Grand Teton National Park. There's one hike I want to do but don't think I'll be able to when I'm up there next week but it's the wind cave trail. It's accessible from Driggs Idaho.
https://www.theoutbound.com/wyoming/hiking/hike-darby-canyon-to-the-wind-caveSwimming not too sure. I think some of the lakes in GTNP allow swimming, and I've heard of and seen videos of people tubing Flat Creek that goes right through town. Also there's granite hot springs southeast of town about an hr drive