mishka's Shortform
post by mishka · 2024-05-28T17:38:59.799Z · LW · GW · 9 commentsContents
9 comments
9 comments
Comments sorted by top scores.
comment by mishka · 2024-11-24T07:25:19.164Z · LW(p) · GW(p)
METR releases a report, Evaluating frontier AI R&D capabilities of language model agents against human experts: https://metr.org/blog/2024-11-22-evaluating-r-d-capabilities-of-llms/
Daniel Kokotajlo and Eli Lifland both feel that one should update towards shorter timelines remaining until the start of rapid acceleration via AIs doing AI research based on this report:
https://x.com/DKokotajlo67142/status/1860079440497377641
https://x.com/eli_lifland/status/1860087262849171797
Replies from: leon-lang, Amyr↑ comment by Leon Lang (leon-lang) · 2024-11-24T11:58:39.788Z · LW(p) · GW(p)
Somewhat pedantic correction: they don’t say “one should update”. They say they update (plus some caveats).
Replies from: mishka↑ comment by Cole Wyeth (Amyr) · 2024-11-24T22:31:53.684Z · LW(p) · GW(p)
I’d like to see the x-axis on this plot scaled by a couple OOMs on a task that doesn’t saturate: https://metr.org/assets/images/nov-2024-evaluating-llm-r-and-d/score_at_time_budget.png My hunch (and a timeline crux for me) is that human performance actually scales in a qualitatively different way with time, doesn’t just asymptote like LLM performance. And even the LLM scaling with time that we do see is an artifact of careful scaffolding. I am a little surprised to see good performance up to the 2 hour mark though. That’s longer than I expected. Edit: I guess only another doubling or two would be reasonable to expect.
Replies from: leon-lang
↑ comment by Leon Lang (leon-lang) · 2024-11-25T22:38:55.297Z · LW(p) · GW(p)
Yeah I think that's a valid viewpoint.
Another viewpoint that points in a different direction: A few years ago, LLMs could only do tasks that require humans ~minutes. Now they're at the ~hours point. So if this metric continues, eventually they'll do tasks requiring humans days, weeks, months, ...
I don't have good intuitions that would help me to decide which of those viewpoints is better for predicting the future.
Replies from: Amyr↑ comment by Cole Wyeth (Amyr) · 2024-11-25T23:33:32.172Z · LW(p) · GW(p)
One reason to prefer my position is that LLM's still seem to be bad at the kind of tasks that rely on using serial time effectively. For these ML research style tasks, scaling up to human performance over a couple of hours relied on taking the best of multiple calls, which seems like parallel time. That's not the same as leaving an agent running for a couple of hours and seeing it work out something it previously would have been incapable of guessing (or that really couldn't be guessed, but only discovered through interaction). I do struggle to think of tests like this that I'm confident an LLM would fail though. Probably it would have trouble winning a text based RPG? Or more practically speaking, could an LLM file my taxes without committing fraud? How well can LLM's play board games these days?
comment by mishka · 2024-11-14T08:05:51.308Z · LW(p) · GW(p)
Gwern was on Dwarkesh yesterday: https://www.dwarkeshpatel.com/p/gwern-branwen
We recorded this conversation in person. In order to protect Gwern’s anonymity, we created this avatar. This isn’t his voice. This isn’t his face. But these are his words.
comment by mishka · 2024-05-28T17:39:01.495Z · LW(p) · GW(p)
Two subtle aspects of the latest OpenAI announcement, https://openai.com/index/openai-board-forms-safety-and-security-committee/.
A first task of the Safety and Security Committee will be to evaluate and further develop OpenAI’s processes and safeguards over the next 90 days. At the conclusion of the 90 days, the Safety and Security Committee will share their recommendations with the full Board. Following the full Board’s review, OpenAI will publicly share an update on adopted recommendations in a manner that is consistent with safety and security.
So what they are saying is that just sharing adopted recommendations on safety and security might itself be hazardous. And so they'll share an update publicly, but that update would not necessarily disclose the full set of adopted recommendations.
OpenAI has recently begun training its next frontier model and we anticipate the resulting systems to bring us to the next level of capabilities on our path to AGI.
What remains unclear is whether this is a "roughly GPT-5-level model", or whether they already have a "GPT-5-level model" for their internal use and this is their first "post-GPT-5 model".
comment by mishka · 2024-10-15T04:30:39.968Z · LW(p) · GW(p)
Scott Alexander wrote a very interesting post covering the details of the political fight around SB 1047 a few days ago: https://www.astralcodexten.com/p/sb-1047-our-side-of-the-story
I've learned a lot of things new to me reading it (which is remarkable given how much material related to SB 1047 I have seen before)