Anthropic’s Claude Instant: A Smaller, Faster and Cheaper Language Model

Anthropic released Claude Instant 1.2, a smaller, faster and cheaper version of its Claude 2 large language model.

Deborah Yao, Editor

August 11, 2023

1 Min Read
Anthropic logo and illustration of a hand with a stopwatch
Anthropic

At a Glance

  • Anthropic's Claude Instant 1.2 is a smaller, faster and cheaper version of its Claude 2 large language model.
  • Claude Instant 1.2 outperforms version 1.1 in math, coding, reasoning and safety.
  • Like Claude 2, Claude Instant 1.2 has a context window of 100,000 tokens, translating to 75,000 words in each prompt.

Anthropic, an AI startup founded by former OpenAI engineers, has released the latest version of its Claude Instant language model.

A smaller and cheaper version of its Claude 2 large language model, Claude Instant 1.2 can be accessed through its API for businesses, the company said in a blog post.

Anthropic claims that Claude Instant is a “faster, lower-priced and yet still very capable model” that can handle tasks including dialogue, text analysis, summarization and document comprehension.

Claude Instant, which Anthropic said is best for low latency, high throughput cases, charges $1.63 per million tokens for prompts and $5.51 per million tokens for completion. The context window is 100,000 tokens, translating to about 75,000 words in each prompt.

In comparison, Claude 2 charges $11.02 per million tokens for prompts and $32.68 per million tokens for completion. The context window is the same. Anthropic said Claude 2 is best for tasks that need complex reasoning and “superior performance.”

Claude Instant: Performance metrics

The startup said Claude Instant 1.2 shows “significant gains” in math, coding, reasoning and safety compared to the earlier version. It also is able to generate “longer, more structured responses and follows formatting instructions better.”

Related:Meet Claude 2: Enhanced ChatGPT Rival from Google-backed Anthropic

The latest version also shows improvement in quote extraction, multilingual capabilities and question answering, the company said.

Here is a comparison between Claude Instant versions 1.1 and 1.2:

Anthropic also said Claude Instant 1.2 hallucinates less than the earlier version, and is more resistant to jailbreaks, or attempts to get the chatbot to forgo its guardrails.

Stay updated. Subscribe to the AI Business newsletter.

Read more about:

ChatGPT / Generative AI

About the Author

Deborah Yao

Editor

Deborah Yao runs the day-to-day operations of AI Business. She is a Stanford grad who has worked at Amazon, Wharton School and Associated Press.

Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!

You May Also Like