Skip to content

Getting Ready Overview

Mathematics for Machine Learning states its assumption plainly in the foreword: the reader should have “mathematical knowledge commonly covered in high school mathematics and physics” — derivatives, integrals, and geometric vectors in two or three dimensions.

That is a fair assumption and a genuinely low bar. It is also, for most people picking the book up some years after school, not quite true any more. This chapter is not in the book. It exists because the gap between “I did calculus once” and “I can read §5.6” is a few hours of revision, and spending those hours here is much cheaper than stalling on page 141.

Nothing in this chapter is new mathematics. If you are fluent, skip it entirely — the self-test below will tell you in three minutes.

diagram Diagram mermaid

Read the arrows as “you will need this there”. Nothing here is studied for its own sake.

Answer these honestly. The explanation after each one names the page that covers it.

pch.quizTag Three-minute self-test
  1. In a double sum where the inner index runs from one up to the outer index, can you simply swap the two summation signs?

    pch.quizShowAnswer

    B — Yes, but the limits have to be rewritten to describe the same triangular region — Correct answer: the limits must be rewritten. If that was not immediate, read Sums, Products, and Set Notation — index manipulation is used without comment in almost every later derivation.

  2. What is the exact condition for a function to have an inverse?

    pch.quizShowAnswer

    D — It is bijective — both injective and surjective — Correct answer: bijective. Chapter 2 turns this single sentence into matrix invertibility, so if it did not come instantly, read Functions, Limits, and Continuity.

  3. The derivative of the logistic sigmoid can be written in terms of the sigmoid itself. What is its maximum value?

    pch.quizShowAnswer

    B — One quarter — Correct answer: one quarter. That number is the vanishing-gradient problem in one line. If you could not derive it, read the Single-Variable Calculus Refresher.

  4. A real two-by-two rotation matrix has how many real eigenvalues, for a rotation angle that is not zero or a half turn?

    pch.quizShowAnswer

    C — None — both eigenvalues are complex — Correct answer: none. A rotation turns every direction, so no direction is merely scaled. If complex eigenvalues of a real matrix sound alarming, read Complex Numbers in One Page — it is genuinely one page.

  5. In NumPy, what does the asterisk operator do to two two-dimensional arrays of the same shape?

    pch.quizShowAnswer

    B — Elementwise multiplication, silently, with no error — Correct answer: elementwise, silently. The at operator is matrix multiplication. If that distinction is not automatic, read NumPy for Mathematics — this is the most expensive typo in numerical Python.

  6. What does the condition number of a matrix predict?

    pch.quizShowAnswer

    B — Roughly how many decimal digits of accuracy you lose when solving with it — Correct answer: digit loss, about log base ten of kappa. It is also the quantity that sets how slowly gradient descent converges, in section 7.1. Covered in NumPy for Mathematics.

  7. What distinguishes a bold uppercase symbol from a bold lowercase one in this book's notation?

    pch.quizShowAnswer

    B — Bold uppercase is a matrix, bold lowercase is a vector — Correct answer: matrix versus vector. Reading shapes off the typeface catches errors in a derivation without doing any arithmetic. The full table is on Notation and Symbols.

Scoring, and it is not subtle. Every question you missed points at one page. Read those pages and skip the rest.

Seven out of seven means you are ready for Chapter 1, and the only page here still worth bookmarking is Notation and Symbols — not to learn, but to look things up in.

orderpagewhat it is fortime
502Notation and SymbolsThe book’s Table of Symbols, expanded, with the chapter each symbol first appears in. Reference, not reading.15 min, then lookups
503Sums, Products, and Set NotationSigma and Pi as loops; the rules for moving things in and out; swapping double sums; telescoping; sets and the indicator function.45 min
504Functions, Limits, and ContinuityDomain, codomain, image; injective, surjective, bijective; limits from both sides; why ReLU is continuous and not differentiable.40 min
505Single-Variable Calculus RefresherEvery derivative rule derived from the limit; the chain rule as backpropagation; the Hessian’s one-variable ancestor; integration and the Fundamental Theorem; Taylor series.70 min
506Complex Numbers in One PageThe plane, modulus and argument, Euler’s formula, conjugates — and the one place the module needs them: a rotation matrix with no real eigenvalues.25 min
507NumPy for MathematicsThe at operator versus the asterisk, broadcasting, axis, the linalg toolkit, and the four floating-point traps.45 min

About four hours if you read all six. Most readers need two or three of them.

  • Read a summation with dependent limits and know whether it can be swapped.
  • Say what makes a mapping invertible, in the words Chapter 2 will use.
  • Derive the chain rule, and explain why composing many layers makes gradients vanish or explode.
  • Recognise a complex eigenvalue as a rotation rather than as an error.
  • Verify any claim on any page of this module by writing five lines of NumPy — and know which floating-point traps could make a correct derivation print a wrong number.

Deliberately narrow. This chapter does not cover:

  • Linear algebra. That is Chapter 2, from the beginning, assuming nothing.
  • Multivariable calculus. Gradients, Jacobians and Hessians are Chapter 5’s whole subject; this chapter only does the one-variable versions they generalise.
  • Probability. Chapter 6 builds it from the sample space up.
  • Proof technique. The book proves things but does not require you to. Where a proof is the clearest explanation, this module gives it; where it is not, it gives the argument instead.

If you are unsure whether something is a prerequisite or a topic, the rule is simple: if the book teaches it, it is a topic and it has its own page later.

Once you have read a page, its recall card feeds this deck. Come back to it a day later, not immediately — retrieval works when it is slightly difficult.

63 due · 0/63 seen · 0 mature

Surjective

0 graded this session
  • This chapter is not in the book — it exists because the book assumes high-school mathematics and physics, and that assumption is usually a few years stale.
  • Notation and Symbols is a reference page, not a reading page: bookmark it and look things up.
  • The self-test maps missed questions to pages — read only the pages your misses point at.
  • Nothing here is studied for its own sake; every page names the later section that needs it.
  • What this chapter does not cover — linear algebra, multivariable calculus and probability are all taught from scratch in Chapters 2, 5 and 6.

Next: what the book means by “data”, “model” and “learning”, and why each of those words has more than one meaning — Introduction and Motivation.

pch.coffeeTagline

pch.coffeeCta

pch.feedbackHeading

pch.feedbackSubheading