If not already, there will soon be a leaderboard for ChatGPT's o1 model. The winner will show a transcript that makes o1 think for the largest number of seconds.
So far, I've never topped a dozen seconds. A friend who is doing some intense LLM-related development showed me a transcript where o1 thought for almost a minute in one case.
The rate limits on the $20/month plan are brutal for o1. He's serious enough about what he's doing to have upgraded to the $200/month plan.
Ouch.
[#]chatgpt #o1
=> More informations about this toot | More toots from judell@social.coop
@judell Are you familiar with the lmsys Chatbot Arena? https://lmarena.ai/
=> More informations about this toot | More toots from joy@mastodon.social
@joy I wasn't. Thanks!
=> More informations about this toot | More toots from judell@social.coop
@judell There's also this Chatbot Arena resource on Hugging Face https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard
=> More informations about this toot | More toots from joy@mastodon.social This content has been proxied by September (ba2dc).Proxy Information
text/gemini