robustness

Tag

Cards List
#robustness

Attacking machine learning with adversarial examples

OpenAI Blog ↗ · 2017-02-24 Cached

This article examines adversarial attacks on machine learning models and demonstrates why gradient masking—a defensive technique that attempts to deny attackers access to useful gradients—is fundamentally ineffective. The paper shows that attackers can circumvent gradient masking by training substitute models that mimic the defended model's behavior, making the defense strategy ultimately futile.

0 favorites 0 likes
#robustness

Adversarial attacks on neural network policies

OpenAI Blog ↗ · 2017-02-08 Cached

OpenAI researchers demonstrate that adversarial attacks, previously studied in computer vision, are also effective against neural network policies in reinforcement learning, showing significant performance degradation even with small imperceptible perturbations in white-box and black-box settings.

0 favorites 0 likes
#robustness

Concrete AI safety problems

OpenAI Blog ↗ · 2016-06-21 Cached

OpenAI, Berkeley, and Stanford researchers co-authored a foundational paper identifying five concrete safety problems in modern AI systems: safe exploration, robustness to distributional shift, avoiding negative side effects, preventing reward hacking, and scalable oversight.

0 favorites 0 likes
← Previous
← Back to home

Submit Feedback