Control measures are the heart of your aviation safety management system’s (SMS) risk mitigation efforts. You may call your "control measures" either:
In this article, we'll use the term "control measures," but I am sure many of you call them "risk controls." Either term is permissible; however, I'm detecting a global preference in the aviation industry for the term "risk control." One can readily assume that these "control measures" are items (tangible or abstract) in your organization that prevent hazards from escalating beyond acceptable parameters.
Oversight agencies like the FAA understand that effective control measures help operators either:
This is why regulators and SMS auditors are always asking, “How do you monitor the effectiveness of risk controls or control measures?”
Aviation service providers need to have quick answers to this question.
In response to pressure from oversight agencies, different companies will have different ways of monitoring control measures. What matters is that you can demonstrate that your monitoring methods work.
But first, operators need to actually develop, implement, and document control measures within the scope of their aviation SMS' documented systems. This happens after
Control measures need to actively exist in the operational environment, and not simply exist “on paper.” This seems like a rather obvious point, but you might be surprised how often this issue arises. Are any of the control measures in your SMS only on paper?
There is a chance that you don't have any documented control measures in your aviation SMS documentation. Many operators don't have the data management capabilities to easily document, track, and regularly review their control measures. If this sounds familiar, don't be alarmed. There are a few low-cost, commercially available SMS databases that perform all of these functions within a single system.
To be perfectly blunt, managing control measures in a spreadsheet is like trying to travel by bike across the United States. Yes, it can be done, but very few have the time and energy to do it well. An SMS database is designed to handle this complex, recurring task.
Assuming that you have controls active in the operational environment, we often see three different types of monitoring activities. We recommend adopting each as a part of your aviation SMS oversight strategy:
Demonstrating to oversight agencies that your SMS implementation provides you with the ability to monitor these three ways is impressive. Demonstrating that you actually follow through with this monitoring will earn you best-in-class SMS status.
Here are these three ways in more detail how to monitor the effectiveness of control measures in aviation SMS implementations.
Periodically monitoring the effectiveness of control measures involves an infrequent but thorough assessment of control measures. Periodic monitoring activities usually involve:
Now, aviation safety programs can have literally hundreds of control measures. It’s not feasible to evaluate each one. In a periodic review. Safety management needs to efficiently monitor the effectiveness of control measures. To do this, safety management should do the following before they begin their periodic review:
The above steps should significantly reduce the scope of review to only the most potentially inadequate control measures by allowing you to hone in on specific hazards and classifications. Moreover, the steps above indirectly “sign off” on the control measures that are working properly.
Scheduled monitoring happens more frequently than periodic monitoring, such as during hazard analysis and review. Not all safety issues require an in-depth hazard analysis. Generally, such operations are reserved for mid to high-risk issues.
When such issues are reported, management needs to undertake hazard analysis activities, such as:
These operations naturally incorporate risk control review into the analysis process, and should quickly point out inadequacies in the risk control, as well as identify which risk controls are meeting needs.
Situations for scheduled monitoring are:
Taking the above points into account, scheduled monitoring of control measure effectiveness should happen at least once per month.
Ongoing assessments of control measure effectiveness happen almost on a daily basis. This method is used to monitor the effectiveness of control measures through common interactions with the safety management system:
Ongoing monitoring should be a natural product of issue management. When issues are reported, safety management is tasked with identifying:
In short, issue management forces safety management to look directly at pertinent safety controls to evaluate whether or not they worked as desired. This is a natural way to monitor control measures whenever safety issues are reported.
Having an aviation safety database is indispensable in monitoring the effectiveness of proactive and reactive control measures. Aviation safety databases:
Not that control measure monitoring can’t happen without an aviation safety database, but it is significantly harder. Just ask SMS auditors which kinds of programs perform better on audit: those with safety databases, or those without.
Monitoring activities can be intimidating. See how SMS Pro uses SRM and SA processes to monitor control measures in these 3 short videos:
Last updated in January 2024.