GPT-2: 6-Month Follow-Up

post by lifelonglearner · 2019-08-21T05:06:52.461Z · score: 31 (7 votes) · LW · GW · 1 comments

Linkpost for GPT-2 6 Month Follow-Up.

Some highlights:

1 comments

Comments sorted by top scores.

comment by Dr_Manhattan · 2019-08-21T12:41:46.516Z · score: 6 (3 votes) · LW(p) · GW(p)

Also notable: NVIDIA trained a half-order-of-magnitude larger model https://nv-adlr.github.io/MegatronLM?utm_campaign=NLP%20News&utm_medium=email&utm_source=Revue%20newsletter