Nonperturbative analysis of the three matrix model