Estimating the Brittleness of AI: Safety Integrity Levels and the Need for Testing Out-Of-Distributi

相关文章推荐

爱逃课的墨镜 · 在qwidget中放置了一个qpushbut ...· 3 天前 ·

聪明的冰棍 · python测试开发django-176.数 ...· 1 年前 ·

温暖的小马驹 · [Day 19] 從零開始學Python ...· 1 年前 ·

风流的松树 · vue动态样式绑定改变伪元素等特殊样式(cs ...· 1 年前 ·

爱跑步的春卷 · 对于AI绘画产品商业化落地的分析思考 | ...· 1 年前 ·

Test, Evaluation, Verification, and Validation (TEVV) for Artificial Intelligence (AI) is a challenge that threatens to limit the economic and societal rewards that AI researchers have devoted themselves to producing. A central task of TEVV for AI is estimating brittleness, where brittleness implies that the system functions well within some bounds and poorly outside of those bounds. This paper argues that neither of those criteria are certain of Deep Neural Networks. First, highly touted AI successes (eg. image classification and speech recognition) are orders of magnitude more failure-prone than are typically certified in critical systems even within design bounds (perfectly in-distribution sampling). Second, performance falls off only gradually as inputs become further Out-Of-Distribution (OOD). Enhanced emphasis is needed on designing systems that are resilient despite failure-prone AI components as well as on evaluating and improving OOD performance in order to get AI to where it can clear the challenging hurdles of TEVV and certification. 中文翻译：

推荐文章

爱逃课的墨镜 · 在qwidget中放置了一个qpushbutton，怎么把button垂直居中对齐 - CSDN文库

3 天前

聪明的冰棍 · python测试开发django-176.数据库迁移数据(manage.py dumpdata)-腾讯云开发者社区-腾讯云

1 年前

温暖的小马驹 · [Day 19] 從零開始學Python - 日期與時間：你知不知道，我等到花兒也謝了 - iT 邦幫忙::一起幫忙解決難題，拯救 IT 人的一天

1 年前

风流的松树 · vue动态样式绑定改变伪元素等特殊样式(css var函数) - 简书

1 年前

爱跑步的春卷 · 对于AI绘画产品商业化落地的分析思考 | 人人都是产品经理

1 年前