OpenAI’s claimed breakthroughs raise concerns over restricted scrutiny

The Verge ·

OpenAI has announced three claimed advances in mathematics, computer science and physics, each connected to major open questions. Researchers say the findings could be significant, but many are frustrated by how the company controls access to the work and who gets to examine it.

The mathematics result claims to resolve the Kakeya conjecture in all dimensions; a Brown University professor said it appears well supported, while noting he had not checked its formal verification. OpenAI says its computer science finding disproves the exponential time hypothesis, while its physics work concerns quantum chromodynamics and Yang-Mills theory, but has not yet been released. The company is using different disclosure plans for each result, after criticism over hundreds of preprints it shared in October.

In short

  • OpenAI claims three major scientific advances.
  • The Kakeya conjecture result appears well supported to one professor.
  • Researchers welcome outside input but want broader access to findings.

Steelman: both sides, in good faith

The strongest fair case each way — we don't pick a winner.

The case for

OpenAI can argue that major, technically demanding results need careful review and that different fields call for different disclosure plans. Staged access may help researchers verify the work, protect unfinished research from premature claims and ensure that complex findings are presented responsibly.

The case against

Researchers can argue that extraordinary claims gain credibility through broad, independent scrutiny, not access controlled by the company making them. Selective or delayed disclosure makes it harder to check methods, reproduce results and assess whether the claims hold up, while concentrating influence over who can evaluate potentially important work.

Explained simply

OpenAI is a company that develops artificial intelligence systems and also conducts research in other fields. Mathematics, computer science and physics each have longstanding open problems: questions that researchers have not yet been able to settle.

The reported claims concern the Kakeya conjecture, a proposal about how small certain sets can be; the exponential time hypothesis, an idea about how quickly some computing problems can be solved; and Yang-Mills theory, which helps describe forces between particles. OpenAI says its results address these questions, though the physics work has not been released.

Independent scrutiny helps researchers assess whether a finding is correct and how it was reached. The debate centres on who can inspect OpenAI’s work and under what conditions, with different access plans for each claim drawing attention to how scientific results are shared and checked.

AI Business Companies Research Science Technology

Read the full article at the source →

Originally published by The Verge as “Researchers are getting tired of OpenAI gatekeeping its breakthroughs”.

Log in to join the discussion