On Thursday, OpenAI announced that every one paying API prospects now have entry to the GPT-4 API. It additionally launched updates to chat-based fashions, introduced a shift from Completions API to the Chat Completions API, and outlined plans for deprecation of older fashions.
Typically thought-about its strongest API product, the GPT-4 API first launched in March however has been underneath closed testing till now. As an API, builders can use a particular interface to combine OpenAI’s massive language mannequin (LLM) into their very own merchandise for makes use of resembling summarization, coding help, evaluation, and composition. The mannequin runs remotely on OpenAI’s servers and gives output to different apps over the Web.
OpenAI says the GPT-4 API with 8K context is accessible to present builders who’ve a profitable fee historical past, with plans to open entry to new builders by the top of July. And in a transfer to distance itself from older GPT-3-style fashions, OpenAI has additionally opted to start retiring “Completions API” fashions in favor of newer Chat Completions API fashions. Since its March launch, OpenAI says that its Chat Completions API fashions now account for 97 % of OpenAI’s API GPT utilization.
This deprecation plan entails retiring fashions which might be a part of the Completions API in six months. Beginning January 4, 2024, these older fashions, which merely full a immediate as an alternative of participating in a chat-like dialog, might be replaced with newer variations, and builders utilizing a few of these fashions might be required to improve their integration manually. For now, the older fashions will stay obtainable however might be labeled as “legacy” merchandise. Here is a partial record of fashions that might be deprecated:
OpenAI will present drop-in replacements for these older fashions. For instance, OpenAI recommends that customers of the text-davinci-003 mannequin change to the gpt-3.5-turbo-instruct mannequin as an alternative. Equally, the ada-002, babbage-002, curie-002, and davinci-002 fashions will substitute earlier variations of every. Purposes utilizing a few of these GPT-3 fashions (resembling ada, babbage, curie, davinci) will “routinely be upgraded to the brand new fashions listed above on January 4, 2024,” in line with OpenAI.
OpenAI additionally introduced that “primarily based on the steadiness and readiness of those fashions for production-scale use,” they’re additionally making APIs for Whisper, DALL-E, and GPT-3.5 Turbo “usually obtainable.” And the corporate expects to proceed fine-tuning the fashions all year long.
Builders can discover extra particulars in OpenAI’s blog post for the announcement.