OpenAI’s Code Interpreter Lets ChatGPT Play Data Scientist

ChatGPT has long been able to generate code and code-like text, but could not execute code or programs – until now. OpenAI has unveiled Code Interpreter, which gives ChatGPT the ability to execute code.

While on the surface this seems like a tool that would mainly interest developers, Code Interpreter is enabling an important use case: the ability to do detailed data analytics and visualization without users writing a snippet of code.

“You are essentially posing questions directly to the data,” wrote solution architect Dennis Layton in Medium. “Moreover, it is capable of handling much larger datasets.”

“Why is this capability so important?” he asked. “It’s because it provides an easy to use way to combine the use of Large Language Models (LLM) like GPT with more traditional programming capabilities without the need to write programming code or set up an environment to run such code.”

Added Wharton associate professor Ethan Mollick in a blog post: “Code Interpreter is an impressive data scientist. … It is operating at a very advanced level, automating a lot of the complexity of quantitative analysis, and capable of very sophisticated approaches to data.”

On Twitter, Coalition's Research Vice President Tiago Henriques said Code interpreter is “insane for data analysis.” It could be used to analyze cybersecurity logs or create “quick” reports.

Related:Research: Can ChatGPT Do Data Science?

How it works

OpenAI is rolling out its in-house Code Interpreter tool as a plugin to subscribers of its premium offering, ChatGPT Plus.

Premium users can write and execute Python code. Users can also upload a file and ask ChatGPT to analyze data, create charts, edit files and perform math.

Here’s an example of Code Interpreter on ChatGPT Plus creating code for a simple word-guessing game based on the lyrics of "Never Gonna Give You Up" by Rick Astley.

Files uploaded to ChatGPT for use with Code Interpreter will only remain in one session. Exit a chat session and the file will be removed. Files up to 100MB in size can be uploaded to ChatGPT Plus.

ChatGPT isn’t equipped with an interactive terminal so it cannot run code that involves direct user input, meaning developers would have to take the generated output and run it in their local Python environment.

Data analysis example

Mollick said the addition of Code Interpreter helps address a number of problems in prior versions of ChatGPT.

“Specifically, it gives the AI a general-purpose toolbox to solve problems (by writing code in Python), a large memory to work with … and integrates that toolbox into the AI in ways that play to the strengths of large language models.”

As an example, Mollick uploaded two public domain datasets of superheroes and their powers. His prompt: “Here is some data on superhero powers. Look through it and tell me what you find.”

For a higher resolution image: https://www.oneusefulthing.org/p/what-ai-can-do-with-a-toolbox-getting

Next, Mollick asked ChatGPT to merge the data and clean it. ChatGPT corrects its own errors, but he said people should still check the results.

For a higher resolution image: https://www.oneusefulthing.org/p/what-ai-can-do-with-a-toolbox-getting

Then, Mollick asked ChatGPT to analyze the data. His prompt: “I am interested in doing some predictive modelling, where we can predict what powers a hero might have based on other factors. How should we approach this?”

In response, ChatGPT built a Random Forest classifier. However, Mollick disagrees with its decision to impute missing data by using the means for numerical data. “I would have dropped the data instead, but I could ask the AI to change its approach, or discuss alternate options.”

For a higher resolution image: https://www.oneusefulthing.org/p/what-ai-can-do-with-a-toolbox-getting