A key insight in learning theory is that the complexity of a hypothesis class is crucial for generalization.
The biggest lesson I've learned is to trust yourself.