The Limitations of Simplicity