Early alignment in two-layer networks training is a two-edged sword

Published in Journal of Machine Learning Research (to be published), 2024