bmks270 said:
jamey said:
Interesting take, that China is trying to flood market with cheap (not better) AI to kill the US AI industry
It's pretty obvious this is their current strategy.
Their models require more tokens for similar output and their chips are way less efficient at producing tokens than the export controlled Nvidia chips (~2x worse than Blackwell, ~20x worse than Vera Rubin). China doesn't have the capacity to dump on U.S. AI model makers currently, because they don't have the capacity. They can skim lower value queries from AI labs, but the demand is currently saturating capacity. That leaves the higher value demand for the U.S. labs and China skimming the lower value queries.
They may be able to do it in the future, but it's not a near term reality from what I can tell. The competitive advantage is at the hardware layer, not the model layer is the takeaway, because the techniques to cut token usage/improve outputs are readily replicable.
In the future AI model makers instead of utilizing consistent models across queries will start routing queries more aggressively based upon actual need. Instead of consumers selecting models to query you'll ask a broad "Claude" for your output and it will route it to a quantized version of models to get a similar quality output from a lesser demanding model.
AI is going to get way more efficient on a token production basis and way more efficient on a token consumption basis over time.
Demand is still going to saturate every bit of computation, which is why Mark Cuban is almost certainly wrong about data center overbuild. It's like saying computer demand in the 90's was soon to be saturated, but even more wrong.
.