How many parameters do self-driving-car neural nets have?

post by Daniel Kokotajlo (daniel-kokotajlo) · 2021-08-06T11:24:59.471Z · LW · GW · No comments

This is a question post.

Contents

  Answers
    10 eg
    6 jbkjr
None
No comments

Take Teslas, for example. In particular, take the neural nets driving this car here. How many parameters do they have? I just need a ballpark estimate, within one order of magnitude would be great. If not for Tesla, then for Waymo or some such.

(My google-fu is failing me, though it does turn up the stat that Tesla's hardware is capable of 144 TOPS, which sounds like 1.44x10^14 operations per second.)

Answers

answer by eg · 2021-08-06T13:42:42.080Z · LW(p) · GW(p)

Take with grain of salt but maybe 119m?

Medium post from 2019 says "Tesla’s version, however, is 10 times larger than Inception. The number of parameters (weights) in Tesla’s neural network is five times bigger than Inception’s. I expect that Tesla will continue to push the envelope."

Wolfram says of Inception v3 "Number of layers: 311 | Parameter count: 23,885,392 | Trained size: 97 MB"

Not sure what version of Inception was being compared to Tesla though.

↑ comment by Daniel Kokotajlo (daniel-kokotajlo) · 2021-08-06T14:18:06.032Z · LW(p) · GW(p)

Thanks!

I wonder whether it would suddenly start working a lot better if they could e.g. make all their nets 1000x bigger...

answer by jbkjr · 2021-08-06T11:38:04.147Z · LW(p) · GW(p)

I think they do some sort of distillation type thing where they train massive models to label data or act as “overseers” for the much smaller models that actually are deployed in cars (as inference time has to be much better to make decisions in real time)… so I wouldn’t actually expect them to be that big in the actual cars. More details about this can be found in Karpathy’s recent CLVR talk, iirc, but not about parameter count/model size?

No comments

Comments sorted by top scores.