Reliance on Metrics is a Fundamental Challenge for AI
https://arxiv.org/ftp/arxiv/papers/2002/2002.08512.pdf
Google’s Hybrid Approach to Research
https://storage.googleapis.com/pub-tools-public-publication-data/pdf/38149.pdf
Hidden Technical Debt in Machine Learning
D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Franc¸ois Crespo, Dan Dennison
https://papers.nips.cc/paper/2015/file/86df7dcfd896fcaf2674f757a2463eba-Paper.pdf
Only 3% of Companies Data Meet Basic Quality Standards
https://hbr.org/2017/09/only-3-of-companies-data-meets-basic-quality-standards
“Everyone wants to do the model work, not the data work”:
Data Cascades in High-Stakes AI
Nithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong, Praveen Paritosh, Lora
Aroyo