Comment by rishabh on What’s the backward-forward FLOP ratio for Neural Networks? · 2023-01-22T05:34:22.487Z · LW · GW

I think the FLOPS for a CNN filter would be (H' x W' x D) x ( 2 x K x K x C). For each pixel in the output feature map of size (H', W', D), we compute the dot product of a (K x K) kernel across C channels.