Mr President Elect said:
Between this thread and the one on "tired of ai" it's obvious there are a lot of people oblivious to the tidal wave that is forming slightly out of sight. Most of us programmers are aware and slightly terrified.
This is the difference between theoretical scientists/researchers and practical ones.
You can spend your entire academic career coming up with new theories to explain physics, chemistry, biology, thermodynamics, etc. You can get research money to do this (and it's relatively cheap to execute) and you can generate tons of papers. A lot of academic research moved in this direction the last 20-30 years...all you needed was a computer. No expensive lab equipment and supplies.
But every theory, if ever to be put into real practice, has to be tested in the real world. In chemistry and biology, this means doing experiments in the lab. With respect to engineering, it means building small, demonstration or pilot scale plants/equipment.
There will ALWAYS be differences between what is predicted (whether it be by humans, AI, or some combination of both) and what occurs in real life. You still need humans working in the lab, testing equipment, and building plants (all things AI can assist with, but not completely replace).
Another valid distinction in the advancement of science and engineering is the difference between incremental improvements vs brand new discoveries.
Arguably, most of what we call new developments in science and engineering are just improvements on things we already know. I would expect AI to be helpful with this.
But what about the brand new discoveries that come along, often by accident. I work in the chemicals space, so let's take polyethylene as an example. It's a chemical that's revolutionized the world, but it was discovered completely by accident. Nothing like it had ever been made before. No one knew what it was or what it was good for. It had to be identified, analyzed, have the properties tested, and used in various test applications before anyone really understood its usefulness.
AI inherently depends (at least to an extent) on information that already exists, which means it shouldn't necessarily be able to generate something (ie, a chemical compound) that's never been identified before. In the fields of chemistry and biology, this seems like a real limitation. Alternatively, it will use information it has to predict things that are impossible to replicate in the real world (this is already a known limitation of AI models in this space).