Read more

April 20, 2023
5 min read
Save

National Football League game official training in the virtual world: Fantasy or feasible?

You've successfully added to your alerts. You will receive an email when new content is published.

Click Here to Manage Email Alerts

We were unable to process your request. Please try again later. If you continue to have this issue please contact customerservice@slackinc.com.

The job of officiating in the professional arena is difficult and demanding. Sporting fans and players are generally unaware of the level of training required to become a competent and well-trained NFL game official.

All seven officials — the referee, the umpire, the down judge, the line judge, the field judge, the side judge and the back judge — are held to an incredibly high standard and have their respective responsibilities while on the field. After all, the NFL reports billions of dollars of revenue every year. Because of this, officials are expected to constantly be improving their work. During the offseason, there are two clinics that seek to develop the skills of NFL officials. The first clinic focuses on new rules and other administrative changes in the NFL, while the second clinic focuses on testing the knowledge of officials. During the regular season, officials study film from the games of that week. They review film with officiating supervisors in order to learn how to identify errors and perform root cause analysis. Extensive training of game officials allows the NFL to boast a 98.9% accuracy rating for calls made during games.

Point of view of a referee in virtual reality in Unreal Engine
1. Point of view of a referee in virtual reality in Unreal Engine. The purpose of these realistic VR settings is for officials to undergo various difficult plays multiple times and have the ability to make adjustments that may allow them to optimize various factors, including neuro-ophthalmic principles such as field of view and line of sight, to have the best chance of making the right call.

Source: Walt Anderson, Bret Ayers, Michael Carter, Andrew G. Lee, MD, Joshua Ong, MD, Ethan Waisberg, Nasif Zaman and Ashtyn Zapletal

Game officials must train to hone their predictive abilities and be able to know where the play is heading. An important part of this is being able to direct their sight toward where the play will develop next. Officials are able to accomplish this task by integrating learned game knowledge with real-time cognitive processing abilities. Our hope is that officials will be able to apply principles of neuro-ophthalmology in order to increase the accuracy and precision of their calls made on the field.

After initial collaboration between Andrew G. Lee, MD, a neuro-ophthalmologist in Houston, and Walt Anderson, senior vice president of officiating for the NFL, specific principles have been incorporated into a structured curriculum for NFL game officials. These neuro-ophthalmic principles include static and dynamic visual acuity; unobstructed line of sight and full visual field; saccadic prioritization and suppression; and smooth pursuit.

Our efforts to date involve aligning neuro-ophthalmic concepts with real-world videotapes of recorded NFL plays. This work with the NFL, while still in its infancy, has already proven to be both informative and an excellent starting point for future endeavors. Our initial on-field experience began in El Paso, Texas, at the NFL training camp for high school and college football officials. The above principles were directly taught by past and present NFL officials during a 2-day training session that culminated in real-world applications as the trainees officiated several high school football games with immediate feedback. Our role during this time was to experience how the neuro-ophthalmology principles were being practiced and used by the trainees. During another game official meeting in Plano, Texas, a complete lecture on the visuomotor system was provided to current NFL game officials. Pre- and post-lecture surveys during this time were used to determine the effectiveness of the lecture and interest in future content.

Our results overwhelmingly showed that viewers of the lecture thought the content was extremely applicable to NFL game officials and that there was marked interest in more teachings. These results were presented at the American Academy of Ophthalmology annual meeting in Chicago in 2022. As we have mainly worked in the qualitative sector, we are hoping in the near future to move into the quantitative sector and obtain hard data regarding how the teaching and understanding of neuro-ophthalmology principles can improve precision and accuracy in play calling and faster reaction times. One of the ways we will explore this avenue is through the use of virtual reality, something that has been used in the field of ophthalmology, and neuro-ophthalmology specifically, many times before.

The advent of extended reality (XR) technology has made strides in the world of ophthalmology, particularly in visual assessment, diagnosis and rehabilitation. This technology spans into various ophthalmic subspecialties including glaucoma, strabismus, retina, cornea and neuro-ophthalmology. Head-mounted visual assessment systems have been used to assess astronaut visual function as well as terrestrial applications including virtual reality-based visual assessments. Building upon this XR-based technology development, we developed some prototypes for a realistic NFL-like environment with the goal of improving NFL referee performance (Figure 1).

Given that officials currently train with footage and on-field training, XR allows for officials to train somewhere in the middle of this spectrum. A large benefit of this training is recreating difficult call scenarios in which officials can rerun the same scenario and make decisions based on neuro-ophthalmic principles (eg, field of view, line of sight) to move around in the virtual environment to make the best call.

We have developed an NFL-like environment in virtual reality using Unreal Engine. This environment can be experienced on the majority of commercially available VR headsets. This will allow referees the chance to gain experience in a simulated-game setting and watch difficult plays in virtual reality. Virtual reality allows the exact plays to be replayed, allowing the referee to self-identify reasons for missing a call. Several variables can be changed by a referee, including the direction of gaze and the location they are standing to improve their field of view. Our VR program has a variety of difficult-to-call plays, with the goal of challenging NFL referees and improving their skills. The difficulty of plays watched increases in a stepwise manner, allowing a referee to become better acclimatized to the virtual environment before being greatly challenged.

It is our hypothesis that implementation of this VR program will further improve play calling within the NFL, reducing the need for instant replay, which prolongs the televised broadcast and occasionally does not provide further clarification regarding close calls. A better appreciation for an NFL official’s training and preparation is a bonus.

We hope that our collaborative efforts with the NFL will continue to expand and that neuro-ophthalmic principles and practice might help NFL game officials to improve precision and accuracy of on-the-field calls that will improve the enjoyment and integrity of the game of professional football.