Note: The contents are so dense for me that it will take me 3-5 business days to comprehend it. and i still dont understand it completely.
resources:
or we can say lack of common sense in llms. common sense is collection of world models. These models enable quick learning of new skills, avoidance of dangerous mistakes in novel situations, and prediction of outcomes in unfamiliar scenarios.
Humans born with some innate knowledge for sure. If a new born is awake for 8 hours a day, in four months they have seen, learn and reason about 960 hours of data. And this data is a mix of pain, hunger, emotions etc. This is how humans learn. And as we grow, this knowledge gap and its complexity grew larger and larger between these AI systems and humans. Current AI is not capable of learning all this.