OpenAI has privately announced a new developer product called Foundry, which enables customers to run OpenAI model inference at scale with dedicated capacity. It also reveals that DV (Davinci; likely GPT-4) will have up to 32k max context length in the public version. This is a huge improvement over the 8k window of GPT-3.5 which did not allow summaries of longer texts. (The google doc that contained the information was taken down by OpenAi, but a screenshot can be found on social media)
Leave a Reply