Ancestors

Written by Adriano on 2024-11-18 at 01:46

Has anyone else noticed ChatGPT is slipping? https://adriano.fyi/posts/chatgpt-is-slipping/

=> More informations about this toot | More toots from adriano@indieweb.social

Toot

Written by Diego Carrasco G. on 2024-11-19 at 22:25

@adriano I noticed strange behaviour on chatgpt modules when I used them through the API a few months ago, and I noted that they add some specific models when they change stuff. For example, some time ago there was only gpt-4o, but now there is gpt-4o, gpt-4o-2024-08-06, gpt-4o-2024-05-13, and so on. After some tests I realized that they behave differently, and if I use a specific model (one with a date) the responses are more stable. I don't know if you already checked that.

=> More informations about this toot | More toots from daco@mas.to

Descendants

Written by Adriano on 2024-11-20 at 02:40

@daco thanks for the followup! I did check which date stamped models are available, and I’ve since pegged my app to a date stamp, but if you see my update in the post, OpenAI fixed the problem some time over the weekend, and even the default models started passing the tests again.

=> More informations about this toot | More toots from adriano@indieweb.social