Adversarial Training with Orthogonal Regularization
2020-10-05
Adversarial Training with Orthogonal Regularization
October 2020
We propose orthogonal regularization during adversarial training to improve robustness. By encouraging weight matrices to stay orthogonal, the model learns more stable and transferable representations under attack.