This is the first part of an advanced course on approximation theory of deep neural networks. In this part, we will familiarise ourselves with deep neural networks and the associated the approximation problem. We will discuss a wide range of classical results and review, on a mostly intuitive level, the ideas behind these results.