Partial derivatives
A partial derivative measures a scalar function’s rate in one independent coordinate while all other coordinates are held constant.
On this page 9 sections
01Understand the idea#
A partial derivative measures how a several-input function responds when one input changes and all the others stay fixed. For a model with many weights, it isolates the local effect of one weight on the loss. The variable you differentiate with respect to determines what counts as constant.
A partial derivative changes one input coordinate. For , the highlighted path varies and keeps .
For , treat as a constant when differentiating in . The term has derivative zero.
For at , hold when finding the rate in . Symbolically, , so . For the rate in , hold fixed: , giving 7. The same function has different rates in different input directions.
. Find .
Show answer and explanation
Hold fixed: .
02For f(x,y)=x^2+3y, choosing y instead changes the calculation#
For , choosing instead changes the calculation. Now is constant, and has derivative 3.
Keep the inner derivative in the chain rule. For , hold fixed when finding . The inner derivative is 3.
. A learner writes . Repair it.
Show answer and explanation
The inner derivative in is 2.
03A partial derivative can itself depend on several coordinates#
A partial derivative can itself depend on several coordinates. For , first find , then evaluate at .
Cost . At , find with fixed.
Show answer and explanation
.
04A closer look#
A positive partial derivative means a small increase in that input raises the output locally, with the other inputs fixed. It is a local mathematical sensitivity, not by itself a causal claim about changing a measured feature in the real world.
Differentiate one coordinate; keep the others fixed.
- Compute a partial derivative with other coordinates held fixed.
Further questions
Does a fixed coordinate disappear from the answer?
Sources & further reading
- [1]OpenStax Calculus Volume 3, 4.3 Partial Derivatives ↗OpenStax · Book