GPT-3 + GAN

post by stick109 · 2020-10-17T07:58:42.839Z · score: 4 (3 votes) · LW · GW · No comments

This is a question post.

Contents

  Answers
    1 Aiyen
None
No comments

I am wondering if anyone tried to combine GPT-3 with GAN, basically trying to train network that would feed GPT-3 questions and then judge responses as correct/incorrect, thus providing GPT-3 opportunity to improve.

Does my question even make sense or I am far off base?

Answers

answer by Aiyen · 2020-10-19T23:00:49.135Z · score: 1 (1 votes) · LW(p) · GW(p)

That might work.  Maybe have the adversarial network try to distinguish GPT-3 text from human text?  That said, GPT-3 is already trying to predict humanlike text continuations, so there's a decent chance that having a separate GAN layer wouldn't help.  It's probably worth doing the experiment though; traditional GANs work by improving the discriminator as well as the desired categorizer, so there's a chance it could work here too. 

answer by Matej Ankele · 2020-10-17T18:40:50.554Z · score: 1 (1 votes) · LW(p) · GW(p)

What is artificial general intelligence?

No comments

Comments sorted by top scores.