How are new AI models compared? What are AI “benchmarks” and why do they matter? Do you have a benchmark that you follo…
From @harpercarrollai on Instagram — 656.8K followers · See full profile →
How are new AI models compared? What are AI “benchmarks” and why do they matter? Do you have a benchmark that you follow? As always, please also leave your questions and requests in the comments! @stanford @meta @harpercarrollai If we haven’t met yet, hi!! I’m Harper - a computer scientist for AI turned AI/ML educator, with 10 years of experience studying/engineering AI & ML at @Stanford, @Meta building AI/ML systems, and then as Founding Engineer and then Head of AI/ML at a startup acquired…
Tags: AI Infra · Model Launch · Reel · ai benchmarks · ai model evaluation · gsm8k · humaneval · jetbrains dp ai arena · mmlu
Topics in this post
More from @harpercarrollai
- If you watch one video about AI, let it be this one. — Search “Terminal” in your Applications, and copy & paste the fol…
- Anthropic just announced it uncovered distillation attacks by Chinese AI labs. But what even *is* model distillation? L…
- Cool AI research update — one easy & actionable step to improve your AI workflow, plus learn more about how the models …
- Legendary AI educator Andrej Karpathy released microgpt.py today on GitHub — it’s a transformer (the groundbreaking neu…
- “Something big is happening” by Matt Shumer My two concerns w the article & a real-life story @harpercarrollai @stanfor…
- How does the world translate into math for AI algorithms? @stanford @meta @harpercarrollai Have you thought about how y…