Also depending the time of year you are right by Del Mar a race track. It's currently the fair until July 6, but horse racing starts 7/17.
Del Mar has a lot of good restaurants and environments..
Jake's Del Mar
Monarch (highly recommend for views and dinner)
Tamarind (very good and right below monarch)
Steak 48 if you want to drop some serious coin on a steak house
Just me personally but I would avoid actual downtown La Jolla. It's a lot seals and seal aroma. Plenty to do and see here just my own opinion.
Other cool things I like to do personally:
San Diego Zoo…we have passes and still like going multiple times a year
Padres game if they're in town. Petco park is an amazing stadium
USS Midway for some history
Beach day it. The water temps are around 68 right now and will continue to get warmer. Water has been amazing lately.
There's also a bunch of good golf courses I'm sure you can sneak some extra rounds in if that's the goal…these are all within 35 minutes of each other of TP if you avoid rush hour in the evening:
Encinitas Ranch (great course)
RB Inn
The Crossings (Carlsbad)
Goat Hill in Oceanside (very tough..)
Enjoy the weather!