2y ago

Over just a few months, ChatGPT went from accurately answering a simple math problem 98% of the time to just 2%, study finds

fortune.com Over just a few months, ChatGPT went from accurately answering a simple math problem 98% of the time to just 2%, study finds

The chatbot gave wildly different answers to the same math problem, with one version of ChatGPT even refusing to show how it came to its conclusion.

Can we discuss how it's possible that the paid model (gpt4) got worse and the free one (gpt3.5) got better? Is it because the free one is being trained on a larger pool of users or what?

41 comments

GPT releases model tunes using a month-day versioning system.
For GPT-4 there are 2 releases
0314 - Original Release, good at math
0613 - Recent update, tagged to "GPT-4" in chat gpt and "gpt-4" in API calls.
If you want 0314 you need API access, Azure, or know someone sharing access.
It is entirely possible to use a version of GPT-4 that is very much like the version we used on opening day. just a little diy
I don't know why thier tune is bad for 0613. Altman has made some statements they dont say much,.