The design of learning algorithms should be guided by both theoretical insights and practical considerations.