How much do frontier LLMs code and browse while in training?
post by Joe Rogero · 2025-03-10T19:34:23.950Z · LW · GW · No commentsThis is a question post.
Contents
No comments
Under what circumstances are frontier AIs currently connected to the Internet during training and/or fine-tuning? Do any of the major players building "agents" like Operator do this? I'm aware that offline web hosting is a thing, just not sure if everyone's using it or if some just hook up to a browser and let fly. Specific examples would help tremendously.
Relatedly, when during training do models start writing and getting feedback on code? I'm guessing this is part of standard fine-tuning now for models like Llama, Gemini, Claude, and GPT? Can anyone point to some go-to papers describing the process?
Answers
No comments
Comments sorted by top scores.