Estimating the Brittleness of AI: Safety Integrity Levels and the Need for Testing Out-Of-Distributi

相关文章推荐

傲视众生的白开水 · 地图可视化开发技巧：geojson转svg后 ...· 4 月前 ·

小胡子的匕首 · Unity发布exe程序的相关设置（隐藏选择 ...· 1 年前 ·

乐观的冰棍 · 什么是WebDAV_51CTO博客_webdav· 1 年前 ·

谈吐大方的毛衣 · 利用信息抽取技术搭建知识库 - 知乎· 1 年前 ·

时尚的砖头 · Android 自定义键盘的车牌输入框 - 简书· 1 年前 ·

Test, Evaluation, Verification, and Validation (TEVV) for Artificial Intelligence (AI) is a challenge that threatens to limit the economic and societal rewards that AI researchers have devoted themselves to producing. A central task of TEVV for AI is estimating brittleness, where brittleness implies that the system functions well within some bounds and poorly outside of those bounds. This paper argues that neither of those criteria are certain of Deep Neural Networks. First, highly touted AI successes (eg. image classification and speech recognition) are orders of magnitude more failure-prone than are typically certified in critical systems even within design bounds (perfectly in-distribution sampling). Second, performance falls off only gradually as inputs become further Out-Of-Distribution (OOD). Enhanced emphasis is needed on designing systems that are resilient despite failure-prone AI components as well as on evaluating and improving OOD performance in order to get AI to where it can clear the challenging hurdles of TEVV and certification. 中文翻译：

推荐文章

傲视众生的白开水 · 地图可视化开发技巧：geojson转svg后再转emf格式插入ppt实现编辑的解决方案_geojson生成svg-CSDN博客

4 月前

小胡子的匕首 · Unity发布exe程序的相关设置（隐藏选择分辨率弹窗、隐藏自带的启动动画）_unity 打包出来的exe点关闭弹窗_柚子味的小柠檬的博客-CSDN博客

1 年前

乐观的冰棍 · 什么是WebDAV_51CTO博客_webdav

1 年前

谈吐大方的毛衣 · 利用信息抽取技术搭建知识库 - 知乎

1 年前

时尚的砖头 · Android 自定义键盘的车牌输入框 - 简书

1 年前