Artificial neural variability for deep learning: on overfitting, noise memorization, and catastrophic forgetting - Xie Z, He F, Fu S, Sato I, Tao D, Sugiyama M.

Deep learning is often criticized by two serious issues that rarely exist in natural nervous systems: overfitting and catastrophic forgetting. It can even memorize randomly labeled data, which has little knowledge behind the instance-label pairs. When a de...
Source: SafetyLit - Category: International Medicine & Public Health Tags: Engineering, Physics, Structural Soundness and Failure Source Type: news