Inflection's Pi Chatbot Gets Major Upgrade in Challenge to OpenAI

Inflection has upgraded its Pi chatbot with a new underlying model that approaches GPT-4’s performance but uses only 40% of the compute for training.

Inflection-2.5 is designed to power natural language conversations that are empathetic and safe. Compared to the previous model, Inflection 2.5 boasts improved coding and mathematics abilities.

The new model enables Pi users to discuss a wider range of topics, including current events, drafting business plans and getting local restaurant recommendations.

Near GPT-4 levels of performance

Inflection 2.5 achieves more than 94% of the average performance of GPT-4 but was trained using just 40% of the FLOPs compared to the OpenAI AI model.

Inflection 2.5 achieves near GPT-4 level results on benchmarks including the popular MMLU, used to evaluate a model’s language understanding capabilities.

While it does not beat GPT-4, Inflection 2.5 surpasses Inflection-1 in terms of performance.

Benchmark test results of Inflection-1, Inflection-2.5 and GPT-4 | Credit: Inflection

Access Inflection 2.5

The new Inflection 2.5 model is an in-house system, meaning only Inflection has access. However, you can use it via the Pi chatbot.

Pi users can access the new model today via the pi.ai website, on iOS, Android and the new desktop app.

An Inflection blog post said the new model has had “a very significant impact on user sentiment, engagement and retention accelerating our organic user growth.”

Related:Inflection's Mammoth $1.5B Funding Set to Rattle OpenAI's Throne

Along with the new underlying model, Pi now also incorporates real-time web search capabilities, so users can access up-to-date information.

Inflection reports user numbers

Inflection is one of several AI startups looking to rival OpenAI. Google DeepMind CEO Demis Hassabis and former Meta CTO Mike Schroepfer are among Inflection’s previous backers.

Having raised $1.5 billion last July, the startup went on to release Inflection-2 in November, claiming it was “the second-best LLM in the world at the time.”

Announcing its latest model, Inflection reported that Pi has six million monthly users who have exchanged four billion messages with the chatbot.

Inflection said Pi has one million daily active users. The average Pi conversation lasts around 33 minutes with one in ten surpassing an hour each day.