Neural network polytopes (Colab notebook)

post by Zach Furman (zfurman) · 2023-04-21T22:42:37.671Z · LW · GW · 0 comments

This is a link post for https://colab.research.google.com/github/zfurman56/polytopes/blob/main/Polytopes.ipynb

Contents

No comments

The polytope theory of neural networks [LW · GW] (also known as the "spline theory of deep learning") seeks to explain (ReLU) neural networks based on their piecewise linear regions. This gives a helpful intuition for how neural networks approximate functions, as well as a potential avenue for interpretability research. For anyone who wants to engage directly with the topic, I put together a small Colab notebook, with interactive 2D and 3D visuals.

0 comments

Comments sorted by top scores.