Key performance indicators (KPIs) are data metrics used to track performance in aviation safety management systems (SMS). This “performance” was not intended to measure only safety, but also quality and financial performance as well.
Understanding what is a key performance indicator is an essential component of being able to identify signs of good KPIs.
Here are the 4 most important things you need to understand about what KPIs are (ideally), and how KPIs are used in aviation SMS:
Understanding the above uses and purpose of KPIs is essential for recognizing good key performance indicators. Almost without question, companies botch their KPI list simply due to misunderstanding the purpose of KPIs.
Here are 5 Signs of good KPIs.
Leading indicators in aviation SMS are the underlying causes and forces that drive organizational safety performance. For example, the yearly turnover rate is a great leading indicator because new employees pose a much higher risk than veteran employees, and high turnover is symptomatic of other problems.
Some of the reasons leading indicators make great KPIs is that they tend to be:
A good list of key performance indicators will be leading indicator heavy, though having some lagging indicators will be necessary as well. You can easily distinguish a leading indicator from a lagging indicator because:
Another sign of a good KPIs is that the safety metric is relevant to more than one organizational level. For example, the KPI % of employees over 5 years in company is relevant to front-line employees, mid-management, and upper management.
One of the reasons KPIs should ideally address multiple organizational levels is that goals and objectives are for the most part company goals and objectives. Since KPIs are built on goals and objectives, they should follow the same pattern.
KPIs should be level-specific only when a particular safety goal is level-specific. Consider the company objective: "Safety management performance average on-time closure rate will be 90% or more." The KPI Percent on time safety issues' closure will mainly affect safety management, which is okay in this case because its parent objective is only for safety management and the accountable executive.
Safety KPIs are especially important to the accountable executive to monitor the performance of the SMS. These safety KPIs help accountable executives fulfill their responsibility to the SMS by:
Without question, this is the most common mistake in organizations. In the realm of key performance indicators, more is not better. When companies have too many KPIs, it indicates that:
On the other hand, a succinct list of KPIs usually indicates:
How to know if your list is too long? There is no one-size-fits-all approach. Smaller aviation service providers may have 7-10 key performance indicators. Larger operators may have double or triple that number (though not necessarily).
Your SMS' key performances indicator list is less of a “list” than it is an ongoing process. Company objectives will change over time, and KPIs will need to be updated by those changes. When we talk about “updating” KPIs, this means:
Updating KPIs is like spring cleaning – suddenly your old stuff looks much more useful and valuable than it actually is. It’s easy to develop a personal attachment to your KPI list. You depend on them. You may have spent considerable organizational effort developing and agreeing on these KPIs. They may have served you very well over the past few years. Some of the hard things about updating KPIs are:
In addition to immediately updating KPIs as goals/objectives are updated, a yearly or semi-annual “cut-throat” inspection of KPIs should be sufficient to keep KPI lists current. Moreover, it’s a very good idea to have a review log for each KPI, showing:
This is the kind of fantastic documentation that is impressive to SMS auditors and extremely helpful for new management to recover during management turnover. One of the best signs of good KPI management skills is that they have thorough documentation.
Effective KPI management requires superior data management capabilities that exceed simple spreadsheets and paper. KPIs don't magically appear out of the blue. Data must be gathered, sorted, stored, classified, and retrieved in a usable format. Using spreadsheets to manage KPIs is a recipe for disaster. You may get by with spreadsheets in a very small organization with fewer than 40 employees, but still, this will be a lot of work and this KPI management process is not sustainable.
You may have seen the reference to KPI dashboards early on. KPI dashboard data typically originates from an SMS database and definitely not spreadsheets. Using spreadsheets to manage KPIs is a sign that you don't know what you are doing. I'm a data management expert and I can confidently make that assertion.
KPI dashboards should be directly linked to operational safety data to provide management with actionable intelligence to facilitate effective decision-making processes. When aviation service providers have an SMS database that provides value to the entire organization versus only the safety department, then you will see additional benefits, including:
An incredibly good sign of good KPI management is the adoption of an integrated SMS database. We are not talking about point solutions that are "one-trick ponies," such as a safety reporting system or an auditing solution. An integrated database has the capability of managing all required SMS documentation requirements and not simply a small section of the SMS.
Having SMS data in a single, centralized database is the most sustainable option for effective KPI management. Auditors are impressed when they see the breadth and depth of your KPIs that may span across all four pillars of an aviation SMS. If you want to appear professional and look like you know what you are doing, then get an SMS database to manage your KPIs.
Several low-cost, commercially available SMS databases make KPI management exceptionally easy. I'm not wanting to imply that your KPIs will magically appear from the sky using an SMS database. Many preliminary activities and data management tasks need to be performed before KPI analysis and report generation begins, including:
Accountable executives need actionable and demonstrable KPI reports to fulfill their responsibilities to the SMS. KPI report data allows accountable executives to monitor SMS performance. If I were the accountable executive, I would prefer to find KPI reports when I needed them, i.e., that is, get KPI reports on demand.
When I refer to "on-demand," I'm not referring to this example:
I'm the accountable executive and want to monitor my SMS. I think I better call up the safety team and have them prepare some reports that we can discuss next week.
This example is not an "on-demand" report. How about this scenario:
I'm the accountable executive and want to monitor my SMS by logging into the SMS database and reviewing SMS performance KPIs in real time. "Real time" means that these are not canned reports, but are created on the fly using the most recent SMS data.
If I were the accountable executive, I would prefer to have a transparent SMS where I could inspect the performance of the aviation SMS whenever the thought occurs to me, regardless of whether I'm in:
An SMS database offers assurance to the accountable executive that SMS activities are not slipping. When you are making the business case to management for SMS budgets, make sure you include that your SMS database benefits the accountable executive. You will notice that there will be less resistance to your budget proposal.
Aviation key performance indicators are built upon company safety goals and objectives. When a performance indicator does not correspond directly to a safety goal or objective, that KPI needs to be updated.
Like parent goals/objectives, key performance indicators in aviation SMS should:
There should be no question about why a particular KPI metric is included in the list of KPIs. A great sign of a good key performance indicator is that anyone – such as a new manager – would have no trouble establishing:
One tip is to create a table with one column listing goals and/or objectives, and the other column writing down the corresponding KPI or KPIs. When an objective has no corresponding KPI, consider which data points will allow you to measure the performance of achieving the objective. Your KPI must be realistic in that you require stored data to be able to retrieve the data and monitor KPI performance.
Another tip is to give your list of KPIs and your list of objectives to a colleague and see if they can accurately establish which objectives each KPI is created for. Another set of eyes will be useful because there is a human tendency to have our blinders on when dealing with goals and objectives. We become so focused on a defined goal or objective that our minds require a nudge to "snap us out of it" and see
Good KPIs help the organization accomplish a particular task. If the KPI is not helpful, then it should be dumped.
Grabbing a list of prepared, industry-specific KPIs is useful for inspiration. Don't use KPIs from other organizations unless they actually align with your company's goals and objectives. More does not equate to better.
KPIs are a hot topic in aviation SMS. Safety managers feel obligated to come up with a KPI list to demonstrate to management and regulatory authorities that they know "what they are doing." When you have too many KPIs, this is an obvious indicator that you don't know what you are doing.
Final word?
Good luck.
A full-featured SMS database helps the accountable executive achieve his SMS objectives. If you need assistance with managing and monitoring KPIs, we can help.
Here are several lists of potential KPIs that should help you become fluent in identifying signs of good KPIs in aviation SMS:
Last updated October 2024.