Comment by tfluids (j-a-collins) on A Simple Introduction to Neural Networks · 2022-09-29T13:02:28.316Z · LW · GW

Just another quick question about this part: The first term is $\frac{\partial \ell }{\partial z_9}=\frac{\partial (y-z_9{)}^2}{\partial z_9}=2z_9$.

Shouldn't this be:  $\frac{\partial (y-z_9{)}^2}{\partial z_9}=-2(y-z_9)$?

You mentioned just after something about notation, but I wanted to understand a bit better in case I'm missing something

Comment by tfluids (j-a-collins) on A Simple Introduction to Neural Networks · 2022-09-17T13:56:12.581Z · LW · GW

Cool, thanks a lot. I assumed the notation was right.

Thanks for the post, by the way, really great work.

Comment by tfluids (j-a-collins) on A Simple Introduction to Neural Networks · 2022-09-17T13:39:35.833Z · LW · GW

Just wondering, you refer to the derivative here but the notation is for the partial derivative, which one is correct?