Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!
March 13, 2023
J2, as it’s known for short, will be integrated into AI21 Studio, the company’s NLP-as-a-service platform. It’s the latest generation of AI21’s models, replacing the 178 billion parameters Jurassic-1 which was slightly larger than OpenAI’s 175 billion parameters GPT-3.
J2 comes in a family of three models– Large, Grande and Jumbo – as well as instruction-tuned language versions of both Jumbo and Grande. However, the Israeli company has not stated the exact sizes of each model.
Despite the lack of parameter disclosure, however, AI21 said J2 records 30% faster performance than its predecessor and supports several non-English languages, including Spanish, French, German, Portuguese, Italian and Dutch.
AI21 built the model on training data that is current up to mid-2022. Comparatively, OpenAI only trained ChatGPT on data from up until 2021, although it has specific notations built in to reference major events like the ongoing war in Ukraine.
J2 now offers zero-shot instruction capabilities, allowing the model to be steered with natural language without the use of examples.
According to AI21, J2 “ranks significantly higher” than models up to 30 times larger when compared to the HELM benchmark for language models.
AI21 is giving free access to Jurassic-2 until May 1st, 2023. The company also announced that both Jurassic models will be available via a newly reduced pricing model, based on the total length of text – including input and output.
Alongside the launch of Jurassic-2, AI21 also unveiled a series of task-specific APIs designed for developers to improve models more easily for specific use cases.
Designed for commercial use, the APIs cover tasks including paraphrasing text, summarizing articles and correcting grammar.
Ben Wodecki is the Jr. Editor of AI Business, covering a wide range of AI content. Ben joined the team in March 2021 as assistant editor and was promoted to Jr. Editor. He has written for The New Statesman, Intellectual Property Magazine, and The Telegraph India, among others. He holds an MSc in Digital Journalism from Middlesex University.
You May Also Like
Generative AI Journeys with CDW UK's Chief TechnologistFeb 28, 2024
Qantm AI CEO on AI Strategy, Governance and Avoiding PitfallsFeb 14, 2024
Deloitte AI Institute Head: 5 Steps to Prepare Enterprises for an AI FutureJan 31, 2024
Athenahealth's Data Science Architect on Benefits of AI in Health CareJan 19, 2024