The best way to improve a program is to rewrite it.
The complexity of a learning problem is often determined by the size and structure of the hypothesis space.