I built a CLI that hashes your ML accuracy claims before the experiment runs

I built a CLI that hashes your ML accuracy claims before the experiment runs Last month, a customer told me our model's accuracy on their data was 71%, not the 94% we had shipped on the landing page. I went back to the eval notebook. The threshold was still 0.94. The test set was named the same th