On the Understanding
There is a lot of discussion lately about the AGI. It seems like it really is generaly inteligent. But two main problems with AGI remain:
- It can not understand
- It can not create any new knowledge
I will show you that those two things are closely related. They are described by Arthur Schopenhauer who wrote extensively about faculty of Understanding. I will also try to explain you how Understanding differs from abstract Reasoning.
What is Understanding?
Shortly, Understanding is a knowledge of cause and effect.
Understanding is the same in all animals and in all men; it has everywhere the same simple form; knowledge of causality, transition from effect to cause, and from cause to effect, nothing more; - Arthur Schopenhauer
Difference between Understanding and Reasoning
Schopenhauer makes clear distintion between Understanding and Reasoning. Understanding is the thing we share with our brothers animals. It was created with the development of first sense so we could create perceptions from raw senses. It consists of inferring unknown causes for the given effect where effect is our sense activation and cause is some external object. This is called direct Understanding, common to simple animals, whether indirect Understanding is more advanced and is common for humans where we try to infer causal relations between external object themselves(science). This process creates our whole perception by inferring causes for a given effect with the help of Time and Space.
Later we developed Reason - ability to make abstract concepts out of perception. Although imperfect because it consists of removing all that is non-essential it allowed us to store it with word for the future and pass it to others via language. That ability to think in abstractions separated us from animals - and because of that we have what animals don’t - things like language, laughter, live in the past and future etc.
Perception > Conception
You may think that pure logical Reasoning is better than Understanding because it is more “human” but Schopenhauer is strongly against this. He thought that only knowledge of perception, of immediate Understanding of causal relation of things is real knowledge and that other knowledge of abstract reasoning is secondary and derivative of the first one.
The great value of conceptions lies in the fact that by means of them the original material of knowledge is more easily handled,surveyed, and arranged. But although many kinds of logical and dialectical operations are possible with them, yet no entirely original and new knowledge will result from these; that is to say, no knowledge whose material neither lay already in perception nor was drawn from self-consciousness.
Cofee test by Steve Wozniak
Every simpleton has Reason, give him the premisses, and he will draw the conclusion; whereas primary, consequently intuitive, knowledge is supplied by the Understanding: herein lies the difference. The pith of every great discovery, of every plan having universal historical importance, is accordingly the product of a happy moment in which, by a favourable coincidence of outer and inner circumstances, some complicated causal series, some hidden causes of phenomena which had been seen thousands of times before, or some obscure, untrodden paths, suddenly reveal themselves to the intellect.
Lets talk about famous Coffee test from Steve Wozniak.
What Steve Wozniak is missing here is the fact that you learned how to make a coffee by actually doing it is the only new knowledge here. It happened in real world by you actually pressing a button and seeing an effect. You then inferred a cause to coffee pouring in a cup as a button being pressed before that. This is transition from known effect to unknown cause and it is has nothing to do with abstract reasoning but it is intuitive and every animal have it in a degree. It is learning by doing knowlege.
Transition from effect to it’s cause or Science:
(known) effect -> (unknown) cause
You can then generalize or scale this knowledge by embeding it in in abstract model that can “extend the range if it’s applicability” so it can be applied to “novel situations”. For example this knowledge can be applied to similar coffee machines in a state. It can be also passed to others via abstract manual. But this is application of EXISTING knowledge to novel situations and no new knowledge is created here. If we are lucky, novel situations are almost the same and we can apply this knowledge with high certainty.
Ask yourself did you learn programming by reading books about it or by actually doing it? Did you learn to assembly ikea funiture by reading abstract manual or by doing it? Information stored in abstract manual or books is of abstract nature and it serves to pass to others the STATE which will produce desired effect. It serves to guide you how to set that state so that desired effect will follow after you sucessfully set the last precondition in state. But there is no substitute for you actually doing it. Only then you can call that knowedge yours. Abstractions don’t allow this, they are just manual for setting state which will necessary produce effect after you set last precondition manually. This is the knowledge of causal Understanding, the only real knowledge, because it passed through your senses, was picked up by Understanding which performed causal inference on raw data from senses.
Transition from known cause to desired effect or Engineering/tinkering.
(known) cause -> (desired) effect
But often time situation is not the same and there is no other way other then via trial and error engineering or as it is called today - tinkering.
Every one of these great discoveries is therefore, just like perception, an operation of the understanding, an immediate intuition, and as such the work of an instant, an apperçu, a flash of insight. They are not the result of a process of abstract reasoning, which only serves to make the immediate knowledge of the understanding permanent for thought by bringing it under abstract concepts, i.e., it makes knowledge distinct, it puts us in a position to impart it and explain it to others.
This is how animal and human brain works at lower levels - it constantly makes a guess about which object caused sensation (sight, touch etc) on our body, but our brain does this at very high speed and we are not aware of this. This is especially true with the sense of sight which is the most fastest. Because of that Understanding sometimes makes mistakes which are called illusions, that is why we developed more senses so they can correct each other, and finally to some extend Reason have an ability to correct mistake by training. This is all the work of Understanding and end result is perception or knowledge about the world.
The scientists do the same thing but very slowly and they try to infer cause and effect between external objects themselves not on our body directly. But between Understanding at high level and that at low level there is a whole gradation on how Understanding manifest itself.
The keenness of the understanding in apprehending the causal relations of objects which are known indirectly, does not find its only application in the sphere of natural science (though all the discoveries in that sphere are due to it), but it also appears in practical life. It is then called good sense or prudence, as in its other application it is better called acuteness, penetration, sagacity. More exactly, good sense or prudence signifies exclusively understanding at the command of the will. But the limits of these conceptions must not be too sharply defined, for it is always that one function of the understanding by means of which all animals perceive objects in space, which, in its keenest form, appears now in the phenomena of nature, correctly inferring the unknown causes from the given effects, and providing the material from which the reason frames general rules as laws of nature; now inventing complicated and ingenious machines by adapting known causes to desired effects; now in the sphere of motives, seeing through and frustrating intrigues and machinations, or fitly disposing the motives and the men who are susceptible to them, setting them in motion, as machines are moved by levers and wheels, and directing them at will to the accomplishment of its ends. Deficiency of understanding is called stupidity. It is just dulness in applying the law of causality, incapacity for the immediate apprehension of the concatenations of causes and effects, motives and actions. A stupid person has no insight into the connection of natural phenomena, either when they follow their own course, or when they are intentionally combined, i.e., are applied to machinery. Such a man readily believes in magic and miracles. A stupid man does not observe that persons, who apparently act independently of each other, are really in collusion; he is therefore easily mystified, and outwitted; he does not discern the hidden motives of proffered advice or expressions of opinion, &c. But it is always just one thing that he lacks —keenness, rapidity, ease in applying the law of causality, i.e., power of understanding.
It is important to notice that this description of how Understanding works - by inferring unknown causes to given effect - is generaly accepted truth in today’s neuroscience - it is called by different names of “uncouncous inference” or “predictive coding”. It was influenced by Helmholtz who itself just copied Schopenhauer philosophy of perception and Understanding, particulary Schopenahuer’s book - On Vision and Colors.