Sorry for horrible pictures but the bugs are very tiny. They are coming from the cracks in the wood floor in the kitchen. The one I have noticed are under my toddlers chair so there is an abundance of crumbs and food debris.

I'm mostly wondering are these tiny ants or should I be worried about termites?

Probably a sugar ant based on location to food

Yup my daughter makes a mess and noticed them everywhere on her crumbs this morning, ty!

Feed them some Terro ant bait gel. No need to use the whole thing, just dab some out and place it where they're coming in. They'll swarm it, then take it back to the queen. Works well on sugar ants.