Checklist to Quantify Resistance to Your Aviation SMS

How to Quantify Resistance to Your SMS Using This Article

Grab a spare pen and paper so you can write down some notes. What we are looking for is a total score. It works like this:

• Score is on a scale from 0 to 25
• Lower number is better, indicating less resistance
• Higher number is worse, indicating higher resistance
• Read through each section of this article, learning about each piece of resistance
• Perform the exercise in each section and notate your score
• Total the sum of your score in each section
• Divide your summed score by 25, to get your resistance score

For example, if after the exercises you have a total score of 7: 6/30 = 20% resistance.

It’s hard to distinguish what a “good” versus a “bad” score is, but anything under 25% means you are on the right track. In such a case, you might say that 3 out of 4 employees are on board with the SMS, leaving some room for improvement but indicating a good deal of support for your SMS.

Note also that resistance usually becomes more prominent in larger SMS, with many more employees to manage and promote the SMS with.

1 – Assess Departments for Silos

Silos are when certain divisions or departments refuse to share SMS-related information or responsibilities with others. Namely, this usually means:

• Departments will not report safety information and try to “handle it” outside formal channels;
• Departments will encourage employees not to use formal channels for reporting; or
• Departments may try and fix problems “off the books,” such as by not documenting corrective actions.

Silos are a form of resistance to your SMS, whereby department heads or employees would rather handle safety outside the SMS. This can arise for a number of reasons, such as department heads who are insecure about their job or feel a sense of competition with other departments for appearing to be safer.

How to quantify:

1. Make a list of each department, division, or other organizational feature in your company;
2. Investigate each department for signs of silos, as described above;
3. Then document your score, based on the following:
   1. 5 points if you have three or more identified silos
   2. 4 points if you have two identified silos
   3. 3 points if you identify one silo
   4. 2 points if no identified silos but some obvious resistance to SMS several departments
   5. 1 point if no identified silos but some obvious resistance to SMS several departments
   6. 0 point if no silos and no obvious resistance among department heads

Related Aviation Safety Manager Articles

• How Aviation Safety Managers Can Deal With Silo Mentality
• How to Tell If an Aviation Safety Manager Is Doing Their Job
• Hardest Challenges of Safety Managers in Modern Aviation SMS

2 – Rate Level of Support From Upper Management

Upper management support will set the paradigm for how employees accept your safety program. If upper management doesn’t support the SMS, your SMS is not maintainable.

Some signs of good upper management support are:

1. Adequate budget for SMS;
2. Accountable executive is aware of safety performance and concerns;
3. Accountable executive values the safety program;
4. Upper management does not promote “cutting safety corners” to save time/costs; and
5. Accountable executive is involved in important safety decisions.

Non-supportive upper management and accountable executive is a killer form of resistance to the SMS. If they don’t want the SMS, the safety program will crumble once the person pushing the SMS leaves. We’ve seen it happen over and over.

How to quantify:

1. Honestly consider how supportive management is, based on the points listed above
2. For each of the above points that your top manager(s) do NOT satisfy, increase your score by one point;
3. For example:
   1. if the top manager(s) do NOT satisfy ANY of the above points, you would mark down 5 points,
   2. if the top manager(s) DO satisfy ALL of the above points, you would mark down 0 points

Related Articles on Aviation Safety Performance

• Why Aviation Safety Managers Fail Without Dept Head Support in SMS
• Overcoming Department Heads Absence in Aviation SMS
• 4 Safety Charts for Department Heads Issue Management Performance

3 – Investigate How Well Employees Follow Policies/Procedures

Employees not following proscribed policies/procedures is one of the most blatant displays of resistance to your SMS.

Sometimes, this is because management has been lazy in creating good procedures or policies. Most often, it is because employees disregard the SMS in favor of doing it “their own way.”

The way to know if this is a problem in your SMS is simply to investigate how often “not following procedure/checklist/policy” is a root cause of your reported safety issues.

How to quantify:

1. Briefly investigate each reported issue from the past 6 months;
2. Tally how many issues’ root cause was an employee not following policy/procedure/checklist;
3. Then estimate your score on the 0 to 5 scale
   1. 0 means no or very few root causes
   2. 5 means it was a consistent root cause

In programs with good culture, they will probably see scores of 0 and 1. In programs with resistance, you are more likely to see scores of 3 and 4. Only programs that greatly struggle with resistance will see a score of 5.

4 – Estimate How Well Employees Report Issues

How well employees report issues is an excellent way to assess resistance to your SMS. Simply put, when employees are actively reporting mandatory and voluntary issues, it indicates low resistance among front-line employees.

How to quantify:

1. Review reported issues from past 6 months;
2. Consider how well-reported issues reflect:
   1. Mandatory issues, and
   2. Voluntary issues.
3. Give yourself a score on a scale of:
   1. 5 points if it’s clear that few employees are using the hazard reporting system to report issues, to
   2. 3 points if mandatory issues are clearly being reported but not many voluntary issues are being reported, to
   3. 0 points if you see an abundance of mandatory and voluntary issue types being reported

5 – Conduct Safety Survey

Lastly, conduct a safety survey and ask pointed questions about how many employees value your safety program.

Have answer options on a scale from 1 to 5, so that you can quantify a total score for each employee, and eventually generate an average survey score across your whole company.

How to quantify:

1. Conduct a safety survey across your organization, having answer types as indicated above;
2. Calculate average score across your organization;
3. Give yourself a score of:
   1. 0 if the average score is 80% or better
   2. 1 if the score is 70 - 80%
   3. 2 if the score is 60 - 70%
   4. 3 if the score is 50 - 60%
   5. 4 if the score is 40 - 50%
   6. 5 is score is below 40%

Related Aviation Safety Survey Articles

• 30 Good Questions for Safety Surveys in Aviation SMS
• Aviation SMS Surveys - Most Neglected Safety Promotion Tool
• How to Use Safety Surveys to Improve Safety Culture in Aviation SMS

Final Thought: Calculate Your Total Score

The last thing you need to do is simply calculate your total score, simply by dividing your score by 25 to get a percentage. A good way to look at this score is the percentage of your employees who are resistant to the SMS.

What a “good score” largely depends on what you find acceptable. For some organizations, a good percentage may be 20% or less, and for others 30% or less.

Last updated August 2024.