Inclusive jet production, parton distributions, and the search for new physics