ReLU shows the opposite behavior. In layer 1, while some neurons are inactive (the “dead zone”), the active ones already spread across a wider range (1.15 std), indicating preserved variation. By layer 2, this expands even further (1.67 std), and the classes become clearly separable — one is pushed to high activation ranges while the other remains near zero. At this point, the output layer’s job is trivial.
伊朗空袭中受伤的哈梅内伊顾问去世02:34
，这一点在搜狗输入法中也有详细论述
During Wednesday's briefing, the commander-in-chief dismissed concerns about Iran's enriched uranium reserves, noting their subterranean location permitted orbital surveillance.
Review client success stories