Prompt Caching in the API

OpenAI's API now offers automatic discounts on inputs that the model has recently seen. This new feature allows developers to save costs and improve the efficiency of their applications.

Summary written by Kernelia from the original article by OpenAI News. The story and its rights belong to its author.