Abstract
The effect of cochannel interference on the performance of digital mobile radio systems in a Nakagami-fading channel is studied. Closed-form expressions are derived for the average probability of error of both coherent and noncoherent (differentially coherent) binary frequency shift keying and phase-shift keying schemes in an interference-limited system. The analysis assumes an arbitrary number of independent and identically distributed Nakagami interferers. The effect of maximal ratio combining diversity is also examined.