Estimating the Brittleness of AI: Safety Integrity Levels and the Need for Testing Out-Of-Distributi

相关文章推荐

俊逸的牛腩 · 放肆gl玄笺百度网盘 - 百度· 3 月前 ·

不羁的电影票 · 市发展改革委关于轨道交通机场专线定价机制解读 ...· 5 月前 ·

谦逊的针织衫 · 我爱上了邻居的美丽人妻，给我一段刻骨铭心的爱 ...· 8 月前 ·

踢足球的茶壶 · MV/动漫【无颜之月（颜のない月）.ED】- ...· 9 月前 ·

慷慨的黄豆 · 地狱之渊有第二部吗_头条· 1 年前 ·

Test, Evaluation, Verification, and Validation (TEVV) for Artificial Intelligence (AI) is a challenge that threatens to limit the economic and societal rewards that AI researchers have devoted themselves to producing. A central task of TEVV for AI is estimating brittleness, where brittleness implies that the system functions well within some bounds and poorly outside of those bounds. This paper argues that neither of those criteria are certain of Deep Neural Networks. First, highly touted AI successes (eg. image classification and speech recognition) are orders of magnitude more failure-prone than are typically certified in critical systems even within design bounds (perfectly in-distribution sampling). Second, performance falls off only gradually as inputs become further Out-Of-Distribution (OOD). Enhanced emphasis is needed on designing systems that are resilient despite failure-prone AI components as well as on evaluating and improving OOD performance in order to get AI to where it can clear the challenging hurdles of TEVV and certification. 中文翻译：

推荐文章

俊逸的牛腩 · 放肆gl玄笺百度网盘 - 百度

3 月前

不羁的电影票 · 市发展改革委关于轨道交通机场专线定价机制解读-政策解读-北京市发展和改革委员会

5 月前

谦逊的针织衫 · 我爱上了邻居的美丽人妻，给我一段刻骨铭心的爱情却又不能在一起|现代小说_网易订阅

8 月前

踢足球的茶壶 · MV/动漫【无颜之月（颜のない月）.ED】- Cruel Moon_哔哩哔哩_bilibili

9 月前

慷慨的黄豆 · 地狱之渊有第二部吗_头条

1 年前