Understanding

$$\gdef \sam #1 {\mathrm{softargmax}(#1)}$$ $$\gdef \vect #1 {\boldsymbol{#1}} $$ $$\gdef \matr #1 {\boldsymbol{#1}} $$ $$\gdef \E {\mathbb{E}} $$ $$\gdef \V {\mathbb{V}} $$ $$\gdef \R {\mathbb{R}} $$ $$\gdef \N {\mathbb{N}} $$ $$\gdef \relu #1 {\texttt{ReLU}(#1)} $$ $$\gdef \D {\,\mathrm{d}} $$ $$\gdef \deriv #1 #2 {\frac{\D #1}{\D #2}}$$ $$\gdef \pd #1 #2 {\frac{\partial #1}{\partial #2}}$$ $$\gdef \set #1 {\left\lbrace #1 \right\rbrace} $$

As we mentioned in here, the elementary courses usually offer shallow understanding of concepts, ideas, topics, etc., which we will refer to as objects. They are concerned mostly about practice and implementation. This is because they have the appropriate goal: to generate workers, or people to apply their knowledge in designing products.

More advanced courses offer a deeper understanding of such objects, by developing more in mathematics and theory. This effect emphasizes the importance of understanding, and that it is a continuous concept, within several levels. These courses aim also for the same practicality as the elementary courses, but are more inclined to research.

Our course is similar in this regard. It is also about deep understanding of objects, but with less emphasis on practicality. It is also for research, but a more fundamental one. More theoretical and even philosophical, though eventually for the purpose of practical AI.

Shallow learning often presents objects as separate and expresses usually only one facet of the object. Deep learning, on the other hand, exhibits the inter-relation among different objects, that are often presumed unconnected. Subsequently, these objects can be abstracted to a higher level of perception, i.e., by constructing a stronger and clearer cognitive model of the object. Additionally, it reveals many facets of this object, thus expanding the overall perception of it. It allows us to see “the bigger picture”.

Unfortunately, shallow courses are very mechanistic and technical. It is merely (or mostly) about introducing some tool to work with. This may lead to frustration and bewilderment, since meaning is missing, or the purpose of it all. Deep courses provide this meaning. They sometimes show how very different objects are related, or even how they were developed/discovered, and the philosophy behind these objects. This generates excitement and great motivation, and exhibits the beauty of the things we learn. For example, the symmetry or the harmony of things.

These are the principles that guide us through in designing and developing this course. More about the philosophy of this course can be found here.