Announcing Epoch's newly expanded Parameters, Compute and Data Trends in Machine Learning database

post by Robi Rahman (robirahman), Jaime Sevilla Molina (jaime-sevilla-molina), Tamay, Ege Erdil (ege-erdil), Pablo Villalobos (pvs), Ben Cottier (ben-cottier), Matthew Barnett (matthew-barnett) · 2023-10-25T02:55:07.440Z · LW · GW · 0 comments

This is a link post for https://epochai.org/blog/announcing-updated-pcd-database

Contents

No comments

The performance of machine learning models is closely related to their amount of training data, compute, and number of parameters. At Epoch, we’re investigating the key inputs that enable today’s AIs to reach new heights.

Our recently expanded Parameter, Compute and Data Trends database traces these details for hundreds of landmark ML systems and research papers.

In the past six months, we’ve added 240 new language models and 170 compute estimates. We will be maintaining this dataset, updating it with more historical information, and adding new significant releases.  It's a valuable resource for journalists, academics, policymakers, and anyone interested in understanding the trajectory of AI.

Explore the interactive visualization, check out the documentation,  and access the data for your own research at epochai.org/data/pcd.

0 comments

Comments sorted by top scores.