Evaluation of Aircraft Pilot Team Performance

Publisher Website
Google Scholar
Abstract
Accurate assessment of team performance in complex, dynamic systems is difficult, particularly teamwork such as Crew Resource Management (CRM) in aircraft. Seventy pilots from two fleets were evaluated as two-person crews by a Maneuver Validation (MV), which focused on proficiency on separate maneuvers, and by a Line Operational Evaluation (LOE), which focused on the crew flying a simulated line flight. Instructor/Evaluator (I/E) pilots helped design LOE content and a structured evaluation worksheet. I/E reliability training resulted in high evaluator agreement (average rwg = .80) and acceptable inter-rater correlations (average r = .54). Path analysis supported the assessment flow from Observable Behaviors to Technical and CRM performance to Captain (PIC), First Officer (SIC), and Crew evaluations for each event set. Fleet evaluations were different on the LOE assessment, but equivalent on the MV assessment. Detailed analysis of assessments also indicated a different role of the SIC across fleets. One fleet assessed SIC more on CRM performance and weighted SIC performance more in evaluating Crew performance. The other fleet assessed SIC on technical performance and weighted SIC performance less in evaluating Crew performance.

This publication has 0 references indexed in Scilit: