In this seminar I will talk about a provably stable architecture for Neural Ordinary Differential Equations (ODEs) which achieves non-trivial adversarial robustness under white-box adversarial attacks even when the network is trained naturally. For most existing defense methods withstanding strong white-box attacks, to improve robustness of neural networks, they need to be trained adversarially, hence have to strike a trade-off between natural accuracy and adversarial robustness. Inspired by dynamical system theory, we design a stabilized neural ODE network named SONet whose ODE blocks are skew-symmetric and proved to be input-output stable. With natural training, SONet can achieve comparable robustness with the state-of-art adversarial defense methods. In particular, under PGD-20 ($ell_infty=0.031$) attack on CIFAR-10 dataset, our method of natural training achieves 89.36% natural accuracy and 61.62% robust accuracy, while a counterpart architecture of ResNet trained with TRADES achieves natural and robust accuracy 85.28% and 23.06% respectively, in the same setting.
5月14日
4:00pm - 5:00pm
地點
https://hkust.zoom.us/j/98027512081
講者/表演者
Mr. Yifei HUANG
HKUST
主辦單位
Department of Mathematics
聯絡方法
mathseminar@ust.hk
付款詳情
對象
Alumni, Faculty and Staff, PG Students, UG Students
語言
英語
其他活動
7月14日
研討會, 演講, 講座
IAS / School of Science Joint Lecture - Boron Clusters
Abstract The study of carbon clusters led to the discoveries of fullerenes, carbon nanotubes, and graphene. Are there other elements that can form similar nanostructures? To answer this questio...
5月15日
研討會, 演講, 講座
IAS / School of Science Joint Lecture - Laser Spectroscopy of Computable Atoms and Molecules with Unprecedented Accuracy
Abstract Precision spectroscopy of the hydrogen atom, a fundamental two-body system, has been instrumental in shaping quantum mechanics. Today, advances in theory and experiment allow us to ext...