Scientists should use AI as a tool, not an oracle - 0 views
-
dr tech on 14 Jun 24"A core selling point of machine learning is discovery without understanding, which is why errors are particularly common in machine-learning-based science. Three years ago, we compiled evidence revealing that an error called leakage - the machine learning version of teaching to the test - was pervasive, affecting hundreds of papers from 17 disciplines. Since then, we have been trying to understand the problem better and devise solutions. This post presents an update. In short, we think things will get worse before they get better, although there are glimmers of hope on the horizon."