Gemini Ultra, developed by Google, has beaten OpenAI's GPT-4 in the MMMU benchmark. Only in business and science did GPT-4 perform better. The overall quality of the models is very similar, with Gemini only having a three point lead on its OpenAI developed competitor.
Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
CB Insights. (January 17, 2024). Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 [Graph]. In Statista. Retrieved February 02, 2025, from https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. "Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024." Chart. January 17, 2024. Statista. Accessed February 02, 2025. https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. (2024). Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024. Statista. Statista Inc.. Accessed: February 02, 2025. https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights. "Comparison of Mmmu* Benchmark between Google's Gemini Ultra and Openai's Gpt-4v in 2024." Statista, Statista Inc., 17 Jan 2024, https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
CB Insights, Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 Statista, https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed (last visited February 02, 2025)
Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024 [Graph], CB Insights, January 17, 2024. [Online]. Available: https://www.statista.com/statistics/1446321/gemini-and-gpt-4-comparison/?__sso_cookie_checker=failed
