Language models powering bots like ChatGPT have no conception of the physical world. Will the next leap forward come from teaching AI sensory common sense?
"In Deepak Pathak’s telling, nobody is building human-level artificial intelligence with language alone. You could train a large language model on billions of descriptions of gravity, but it would never conceptualize it, since it has never experienced the real world. Train it with every physics textbook on earth, and it still can’t visualize what happens when you drop a ball from your hand. With this natural limitation, it hallucinates. "
----
Actually, this is the same problem that human patients face with doctors they go to. How do you explain numb feet, pain from a kidney stone or sciatica pain to a doctor who has never experienced such pains/problems before? If they are unable to understand your problem, how can they/it help?
It's quite the problem to figure out how to describe a physical feeling in words only and I contend, likely impossible to do so.
Wow: “AI going straight to language is like giving answers to a test without teaching the course.”
Ty king
Great story!
"In Deepak Pathak’s telling, nobody is building human-level artificial intelligence with language alone. You could train a large language model on billions of descriptions of gravity, but it would never conceptualize it, since it has never experienced the real world. Train it with every physics textbook on earth, and it still can’t visualize what happens when you drop a ball from your hand. With this natural limitation, it hallucinates. "
----
Actually, this is the same problem that human patients face with doctors they go to. How do you explain numb feet, pain from a kidney stone or sciatica pain to a doctor who has never experienced such pains/problems before? If they are unable to understand your problem, how can they/it help?
It's quite the problem to figure out how to describe a physical feeling in words only and I contend, likely impossible to do so.
Is Skild AI using Nvidia Omniverse for its simulated robot training?