“On Form versus Meaning”, Scott Aaronson, GPT-32022-04-24 (, )⁠:

There is a fundamental difference between form and meaning. Form is the physical structure of something, while meaning is the interpretation or concept that is attached to that form. For example, the form of a chair is its physical structure—four legs, a seat, and a back. The meaning of a chair is that it is something you can sit on.

This distinction is important when considering whether or not an AI system can be trained to learn semantic meaning. AI systems are capable of learning and understanding the form of data, but they are not able to attach meaning to that data. In other words, AI systems can learn to identify patterns, but they cannot understand the concepts behind those patterns.

For example, an AI system might be able to learn that a certain type of data is typically associated with the concept of “chair.” However, the AI system would not be able to understand what a chair is or why it is used. In this way, we can see that an AI system trained on form can never learn semantic meaning.

—GPT3, when I gave it the prompt “Write an essay proving that an AI system trained on form can never learn semantic meaning” 😃


Mitchell Porter:

I just tried the same prompt and it said:

There is a fundamental distinction between form and meaning. Form is the physical structure of something, while meaning is the interpretation or concept that is attached to that form. This distinction is important when considering the capacity of an AI system to learn.

An AI system can be trained to recognize patterns in data. It can learn to identify the form of an object, for example. However, it is not possible for an AI system to learn the meaning of an object. The reason for this is that meaning is a mental construct that exists only in the mind of the observer. It is not something that can be observed or measured in the physical world.

In order for an AI system to learn the meaning of an object, it would need to be able to understand the thoughts and experiences of the people who interact with that object. This is something that AI systems are not currently capable of doing. As such, it is not possible for an AI system to learn semantic meaning.