Inflection's upgraded Pi chatbot achieves near GPT-4 performance using just 40% of the training compute

Ben Wodecki, Jr. Editor

March 11, 2024

2 Min Read
Inflection AI logo on colorful background. Inflection unveiled its latest AI model, Inflection-2.5, set to power its Pi.ai chatbot
Inflection reports that Pi has six million monthly usersInflection AI

At a Glance

  • Inflection has unveiled the new Inflection-2.5 model set to power its Pi chatbot.
  • Inflection-2.5 uses less computing power than GPT-4 with improved coding and math capabilities.

Inflection has upgraded its Pi chatbot with a new underlying model that approaches GPT-4’s performance but uses only 40% of the compute for training.

Inflection-2.5 is designed to power natural language conversations that are empathetic and safe. Compared to the previous model, Inflection 2.5 boasts improved coding and mathematics abilities.

The new model enables Pi users to discuss a wider range of topics, including current events, drafting business plans and getting local restaurant recommendations.

Near GPT-4 levels of performance

Inflection 2.5 achieves more than 94% of the average performance of GPT-4 but was trained using just 40% of the FLOPs compared to the OpenAI AI model.

Inflection 2.5 achieves near GPT-4 level results on benchmarks including the popular MMLU, used to evaluate a model’s language understanding capabilities.

While it does not beat GPT-4, Inflection 2.5 surpasses Inflection-1 in terms of performance.

Benchmark test results of Inflection-1, Inflection-2.5 and GPT-4

Access Inflection 2.5

The new Inflection 2.5 model is an in-house system, meaning only Inflection has access. However, you can use it via the Pi chatbot.

Pi users can access the new model today via the pi.ai website, on iOS, Android and the new desktop app.

An Inflection blog post said the new model has had “a very significant impact on user sentiment, engagement and retention accelerating our organic user growth.”

Related:Inflection's Mammoth $1.5B Funding Set to Rattle OpenAI's Throne

Along with the new underlying model, Pi now also incorporates real-time web search capabilities, so users can access up-to-date information.

Inflection reports user numbers

Inflection is one of several AI startups looking to rival OpenAI. Google DeepMind CEO Demis Hassabis and former Meta CTO Mike Schroepfer are among Inflection’s previous backers.

Having raised $1.5 billion last July, the startup went on to release Inflection-2 in November, claiming it was “the second-best LLM in the world at the time.”

Announcing its latest model, Inflection reported that Pi has six million monthly users who have exchanged four billion messages with the chatbot.

Inflection said Pi has one million daily active users. The average Pi conversation lasts around 33 minutes with one in ten surpassing an hour each day.

Read more about:

ChatGPT / Generative AI

About the Author(s)

Ben Wodecki

Jr. Editor

Ben Wodecki is the Jr. Editor of AI Business, covering a wide range of AI content. Ben joined the team in March 2021 as assistant editor and was promoted to Jr. Editor. He has written for The New Statesman, Intellectual Property Magazine, and The Telegraph India, among others. He holds an MSc in Digital Journalism from Middlesex University.

Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!

You May Also Like