You might want to check up on the current controversy surrounding OpenAI’s math “achievements”.
I’m aware of the controversies, this benchmark isn’t about making new proofs on previously unsolved problems, it’s whether it can answer complex math problems, which it’s getting better at.
By my reckoning, the difference between Mythos and Opus is smaller than the difference between Opus and Sonnet. Same with the difference between GPT 5.5 to 5.6 is smaller than the difference between GPT 4 to GPT 5.
Do you have any benchmarks or data to back this “reckoning”
Do you have any benchmarks or data to back this “reckoning”
I work with LLMs daily. I read papers as they hit arxiv. Also daily. You clearly don’t.
I’m not interested in convincing anyone, which is why I’m speaking non-technically.
The benchmarks being cited aren’t as interesting as you appear to believe they are. You’ve not fully grasped the fact that solving pre-made problems where the solutions are known or knowable isn’t anywhere close to the same thing as asking truly novel research questions independent of a human prompt. For OpenAI to also be embroiled in allegations of plagiarism only serves to underscore the gap between the two concepts.
I’m aware of the controversies, this benchmark isn’t about making new proofs on previously unsolved problems, it’s whether it can answer complex math problems, which it’s getting better at.
Do you have any benchmarks or data to back this “reckoning”
I work with LLMs daily. I read papers as they hit arxiv. Also daily. You clearly don’t.
I’m not interested in convincing anyone, which is why I’m speaking non-technically.
The benchmarks being cited aren’t as interesting as you appear to believe they are. You’ve not fully grasped the fact that solving pre-made problems where the solutions are known or knowable isn’t anywhere close to the same thing as asking truly novel research questions independent of a human prompt. For OpenAI to also be embroiled in allegations of plagiarism only serves to underscore the gap between the two concepts.