Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization

Published in Transactions on Machine Learning Research, 2026