FAA Office of Aerospace Medicine
Civil Aerospace Medical Institute

Report No: DOT/FAA/AM-14/10

Title and Subtitle: An Evaluation of the Utility of AT-SAT for the Placement of New Controllers by Option

Report Date: October 2014

Authors: Byrne CL, Broach D

Abstract: As a follow-up to the completion of the Concurrent Validation of the Air Traffic Selection and Training (AT-SAT) test for Tower Controller Hiring (CoVATCH) project, we investigated the utility and fairness of using AT-SAT scores to place Air Traffic Control Specialist (ATCS) applicants into terminal or en route facilities. Generally speaking, controller pay is higher at en route facilities than at most terminal facilities; placement by option thus affects the terms and conditions of employment and therefore is a selection decision within the scope of the Uniform Guidelines on Employee Selection Procedures (Equal Employment Opportunity Commission, 1978).

While results of statistical analyses indicated that AT-SAT could be considered a valid tool for use in placement, based on technical considerations only, it was concluded that it should not be used in that way due to lack of utility and potential for adverse impact. The analyses indicated that if AT-SAT were used for placement, while the field training success rate (the proportion of developmentals achieving Certified Professional Controller status at the first field facility) would increase in en route facilities, the success rate would decrease in terminal facilities.

Since more positions are available at terminal facilities, the overall success rate across both options would not change substantially and might actually decrease slightly. Furthermore, using AT-SAT to place new ATCSs into en route or terminal facilities might have adverse impact on blacks, Hispanics, and females. If the FAA were to use AT-SAT for placement, the risk of additional adverse impact and pay disparities should be evaluated against the marginal utility of placement in terms of changes in field training success rates. In sum, given the findings of both validation studies, the analyses conducted here, and the projected ratio of controllers that will likely be hired into each option, using AT-SAT scores to guide placement decisions is not recommended at this time.

Key Words: ATCS Selection, Placement, Aptitude Test

No. of Pages: 13