Gemini Ultra and GPT-4 are the leading generative AI platforms worldwide, and they compare alike in the mathematical benchmarks. Gemini Ultra is slightly ahead of GPT-4, beating it in both mathematical benchmarks as well as the general MMLU benchmarking. The lead is not so significant as to consider GPT-4 a lackluster model.
Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024
Source notes: "GSM8K = Basic arithmetic manipulations (incl. Grade School math problems), MATH = Challenging math problems (incl. algebra, geometry, pre-calculus, and others)"
Source notes: "MMLU = Representation of questions in 57 subjects (incl. STEM, humanities, and others)"
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
Encord. (December 7, 2023). Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 [Graph]. In Statista. Retrieved November 22, 2024, from https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024." Chart. December 7, 2023. Statista. Accessed November 22, 2024. https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/
Encord. (2023). Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024. Statista. Statista Inc.. Accessed: November 22, 2024. https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of Math Benchmarks between Google's Gemini Ultra and Openai's Gpt-4 in 2024." Statista, Statista Inc., 7 Dec 2023, https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/
Encord, Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 Statista, https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/ (last visited November 22, 2024)
Comparison of math benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 [Graph], Encord, December 7, 2023. [Online]. Available: https://www.statista.com/statistics/1450845/math-benchmark-comparison-gemini-ultra-gpt-4/
