Gemini Ultra, developed by Google, has beaten OpenAI's GPT-4 in the MMMU benchmark. Only in business and science did GPT-4 perform better. The overall quality of the models is very similar, with Gemini only having a three point lead on its OpenAI developed competitor.
Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
CB Insights. (January 17, 2024). Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 [Graph]. In Statista. Retrieved January 23, 2025, from https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. "Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024." Chart. January 17, 2024. Statista. Accessed January 23, 2025. https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. (2024). Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024. Statista. Statista Inc.. Accessed: January 23, 2025. https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. "Comparison of Mmmu* Benchmark between Google's Gemini Ultra and Openai's Gpt-4v in 2024." Statista, Statista Inc., 17 Jan 2024, https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights, Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 Statista, https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed (last visited January 23, 2025)
Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 [Graph], CB Insights, January 17, 2024. [Online]. Available: https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
