14 May 2024

Post

Success metrics are meaningless without counter metrics | unMESS Blog

Success metrics are meaningless without counter metrics | unMESS Blog

Track success metrics alone risks over-optimisation blind spots. Counter metrics reveal tradeoffs, promote alignment, and enable continuous learning for long-term viability.

Every business tracks success metrics - the core indicators used to measure performance and progress toward goals. But success metrics alone don't tell the full story. Without pairing them with counter metrics, you risk over-optimising at the expense of other key areas. Counter metrics provide the balancing perspective needed to drive sustainable growth.

Success metrics don't show the full picture

While success metrics like conversion rates, active users, and revenue serve an important role, they are inherently one-dimensional. They show you're improving in a specific area, but not what may be suffering as a result.

For example, if you use gamification to get more new users activating and using your product (a success metric), it could accidentally cause other users to get frustrated and churn at a higher rate. That negative impact on churn wouldn't be visible if you only looked at the activation metric.

Similarly, dropping your prices might get you more conversions and new customers (another success metric), but it could actually reduce your total revenue and make your business less profitable per customer. The revenue and profitability hit wouldn't be obvious if you were just looking at the conversion numbers in isolation.

Counter metrics reveal unintended consequences

This is where counter metrics come in. A counter metric is designed to explicitly monitor for potential downsides and unintended impacts as you optimise a success metric.

Continuing the examples above, a churn metric would act as a counter to activation, while metrics like ARPU and gross margins would counterbalance conversion metrics. Rather than let success metrics create problematic blind spots, counter metrics raise red flags early before imbalances become entrenched.

Over-optimising one metric damages others

The risk of solely focusing on success metrics is over-optimisation - increasing one metric at the expense of others that are crucial for long-term health. This happens all the time like companies realising years later that hypergrowth came at the cost of weak unit economics. Or a campaign that boosted top-line revenue while ballooning CAC beyond viability. With counter metrics in place, you can correct over-optimisation addictions before it's too late. It helps you see the full picture.

How to pair success metrics with their counter metrics

To develop a balanced measurement strategy, first list out all the success metrics you currently track or want to track. Then, thoughtfully identify one or more counter metrics for each that measure potential downside risks.

For example some success metrics:

  • Activation metric tracks how many new users start actively using your product

  • Conversion metric measures how many visitors or leads become paying customers

  • Growth/new revenue metric looks at how much you are growing sales/revenue

  • Engagement metrics show how actively users are interacting with your product

Some examples of counter metrics:

  • Churn/retention tracks how many existing users or customers you lose over time

  • CAC is the cost of acquiring each new customer

  • Profitability measures how much profit you make after expenses

  • ARPU is the average revenue per user

  • Infrastructure/hosting costs track what you spend to support user engagement

Activation metric (success) > Churn/retention counter metric (counter metrics)
You watch churn in case efforts to increase activation somehow cause more cancellations

Conversion metric (success) > CAC, short-term churn (counter metrics)
You watch acquisition costs and quick cancellations in case conversion tactics become unsustainably expensive or buggy

Growth/new revenue metric (success) > Profitability, ARPU (counter metrics)
You monitor profitability and average revenue in case growth comes from low-value customers

Engagement metrics (success) > Infrastructure costs (counter metric)
You track hosting expenses in case success drives unsustainably high usage

The key is finding counter metrics that incentivise a sustainable middle ground, rather than letting success metrics run amok in isolation.

Track success and counter metrics equally

It's not enough to just identify success and counter metrics - organisational behaviour only changes when they are tracked and incentivised equally. Every success metric report should be accompanied by its counter metrics. Product roadmaps should be evaluated based on projected impacts to both success and counter metrics.

Essentially, you need to transform your measurement culture to truly balanced analytics where no metric is optimised in isolation at the expense of other key drivers.

Counter metrics encourage strategic alignment

Beyond just keeping teams honest, balancing success and counter metrics keeps the entire organisation pulling in a coherent, sustainable direction. It's easy for department silos to emerge when individuals or teams are compensated based on specific success metrics without counter metrics.

  • Sales may aim to maximise conversion volumes, even if it means unprofitable customers.

  • Product may release engagement-boosting features without checking impacts on infrastructure costs or churn.

With counter metrics, however, there is inherent incentive alignment across the company toward metrics that collectively measure holistic, long-term health.

Counter metrics drive organisational learning

Counter metrics promote a mindset of continuous learning and improvement, rather than just blindly optimising individual metrics.

When counter metrics reveal unintended negative impacts from improving a success metric, it forces you to analyse what went wrong. You have to revisit the projects, processes, or assumptions that led to those undesirable side effects.

This sparks innovation as you adapt your strategies to optimise for the success metrics, while also systematically reducing the costly negative impacts exposed by the counter metrics over time.

Essentially, measuring both success and counter metrics together creates a virtuous cycle. You're always seeking balanced outcomes that improve what you want, without sacrificing other important areas.

On their own, metrics are just data points. But paired together, success and counter metrics enable intelligent growth by avoiding pivotal trade-offs that could undermine your business' long-term viability.

Ignore counter metrics at your own risk. Properly balanced metrics are essential for adapting and evolving your strategies in a fundamentally sound way over time.

OR watch the full video here:

Every business tracks success metrics - the core indicators used to measure performance and progress toward goals. But success metrics alone don't tell the full story. Without pairing them with counter metrics, you risk over-optimising at the expense of other key areas. Counter metrics provide the balancing perspective needed to drive sustainable growth.

Success metrics don't show the full picture

While success metrics like conversion rates, active users, and revenue serve an important role, they are inherently one-dimensional. They show you're improving in a specific area, but not what may be suffering as a result.

For example, if you use gamification to get more new users activating and using your product (a success metric), it could accidentally cause other users to get frustrated and churn at a higher rate. That negative impact on churn wouldn't be visible if you only looked at the activation metric.

Similarly, dropping your prices might get you more conversions and new customers (another success metric), but it could actually reduce your total revenue and make your business less profitable per customer. The revenue and profitability hit wouldn't be obvious if you were just looking at the conversion numbers in isolation.

Counter metrics reveal unintended consequences

This is where counter metrics come in. A counter metric is designed to explicitly monitor for potential downsides and unintended impacts as you optimise a success metric.

Continuing the examples above, a churn metric would act as a counter to activation, while metrics like ARPU and gross margins would counterbalance conversion metrics. Rather than let success metrics create problematic blind spots, counter metrics raise red flags early before imbalances become entrenched.

Over-optimising one metric damages others

The risk of solely focusing on success metrics is over-optimisation - increasing one metric at the expense of others that are crucial for long-term health. This happens all the time like companies realising years later that hypergrowth came at the cost of weak unit economics. Or a campaign that boosted top-line revenue while ballooning CAC beyond viability. With counter metrics in place, you can correct over-optimisation addictions before it's too late. It helps you see the full picture.

How to pair success metrics with their counter metrics

To develop a balanced measurement strategy, first list out all the success metrics you currently track or want to track. Then, thoughtfully identify one or more counter metrics for each that measure potential downside risks.

For example some success metrics:

  • Activation metric tracks how many new users start actively using your product

  • Conversion metric measures how many visitors or leads become paying customers

  • Growth/new revenue metric looks at how much you are growing sales/revenue

  • Engagement metrics show how actively users are interacting with your product

Some examples of counter metrics:

  • Churn/retention tracks how many existing users or customers you lose over time

  • CAC is the cost of acquiring each new customer

  • Profitability measures how much profit you make after expenses

  • ARPU is the average revenue per user

  • Infrastructure/hosting costs track what you spend to support user engagement

Activation metric (success) > Churn/retention counter metric (counter metrics)
You watch churn in case efforts to increase activation somehow cause more cancellations

Conversion metric (success) > CAC, short-term churn (counter metrics)
You watch acquisition costs and quick cancellations in case conversion tactics become unsustainably expensive or buggy

Growth/new revenue metric (success) > Profitability, ARPU (counter metrics)
You monitor profitability and average revenue in case growth comes from low-value customers

Engagement metrics (success) > Infrastructure costs (counter metric)
You track hosting expenses in case success drives unsustainably high usage

The key is finding counter metrics that incentivise a sustainable middle ground, rather than letting success metrics run amok in isolation.

Track success and counter metrics equally

It's not enough to just identify success and counter metrics - organisational behaviour only changes when they are tracked and incentivised equally. Every success metric report should be accompanied by its counter metrics. Product roadmaps should be evaluated based on projected impacts to both success and counter metrics.

Essentially, you need to transform your measurement culture to truly balanced analytics where no metric is optimised in isolation at the expense of other key drivers.

Counter metrics encourage strategic alignment

Beyond just keeping teams honest, balancing success and counter metrics keeps the entire organisation pulling in a coherent, sustainable direction. It's easy for department silos to emerge when individuals or teams are compensated based on specific success metrics without counter metrics.

  • Sales may aim to maximise conversion volumes, even if it means unprofitable customers.

  • Product may release engagement-boosting features without checking impacts on infrastructure costs or churn.

With counter metrics, however, there is inherent incentive alignment across the company toward metrics that collectively measure holistic, long-term health.

Counter metrics drive organisational learning

Counter metrics promote a mindset of continuous learning and improvement, rather than just blindly optimising individual metrics.

When counter metrics reveal unintended negative impacts from improving a success metric, it forces you to analyse what went wrong. You have to revisit the projects, processes, or assumptions that led to those undesirable side effects.

This sparks innovation as you adapt your strategies to optimise for the success metrics, while also systematically reducing the costly negative impacts exposed by the counter metrics over time.

Essentially, measuring both success and counter metrics together creates a virtuous cycle. You're always seeking balanced outcomes that improve what you want, without sacrificing other important areas.

On their own, metrics are just data points. But paired together, success and counter metrics enable intelligent growth by avoiding pivotal trade-offs that could undermine your business' long-term viability.

Ignore counter metrics at your own risk. Properly balanced metrics are essential for adapting and evolving your strategies in a fundamentally sound way over time.

OR watch the full video here:

Every business tracks success metrics - the core indicators used to measure performance and progress toward goals. But success metrics alone don't tell the full story. Without pairing them with counter metrics, you risk over-optimising at the expense of other key areas. Counter metrics provide the balancing perspective needed to drive sustainable growth.

Success metrics don't show the full picture

While success metrics like conversion rates, active users, and revenue serve an important role, they are inherently one-dimensional. They show you're improving in a specific area, but not what may be suffering as a result.

For example, if you use gamification to get more new users activating and using your product (a success metric), it could accidentally cause other users to get frustrated and churn at a higher rate. That negative impact on churn wouldn't be visible if you only looked at the activation metric.

Similarly, dropping your prices might get you more conversions and new customers (another success metric), but it could actually reduce your total revenue and make your business less profitable per customer. The revenue and profitability hit wouldn't be obvious if you were just looking at the conversion numbers in isolation.

Counter metrics reveal unintended consequences

This is where counter metrics come in. A counter metric is designed to explicitly monitor for potential downsides and unintended impacts as you optimise a success metric.

Continuing the examples above, a churn metric would act as a counter to activation, while metrics like ARPU and gross margins would counterbalance conversion metrics. Rather than let success metrics create problematic blind spots, counter metrics raise red flags early before imbalances become entrenched.

Over-optimising one metric damages others

The risk of solely focusing on success metrics is over-optimisation - increasing one metric at the expense of others that are crucial for long-term health. This happens all the time like companies realising years later that hypergrowth came at the cost of weak unit economics. Or a campaign that boosted top-line revenue while ballooning CAC beyond viability. With counter metrics in place, you can correct over-optimisation addictions before it's too late. It helps you see the full picture.

How to pair success metrics with their counter metrics

To develop a balanced measurement strategy, first list out all the success metrics you currently track or want to track. Then, thoughtfully identify one or more counter metrics for each that measure potential downside risks.

For example some success metrics:

  • Activation metric tracks how many new users start actively using your product

  • Conversion metric measures how many visitors or leads become paying customers

  • Growth/new revenue metric looks at how much you are growing sales/revenue

  • Engagement metrics show how actively users are interacting with your product

Some examples of counter metrics:

  • Churn/retention tracks how many existing users or customers you lose over time

  • CAC is the cost of acquiring each new customer

  • Profitability measures how much profit you make after expenses

  • ARPU is the average revenue per user

  • Infrastructure/hosting costs track what you spend to support user engagement

Activation metric (success) > Churn/retention counter metric (counter metrics)
You watch churn in case efforts to increase activation somehow cause more cancellations

Conversion metric (success) > CAC, short-term churn (counter metrics)
You watch acquisition costs and quick cancellations in case conversion tactics become unsustainably expensive or buggy

Growth/new revenue metric (success) > Profitability, ARPU (counter metrics)
You monitor profitability and average revenue in case growth comes from low-value customers

Engagement metrics (success) > Infrastructure costs (counter metric)
You track hosting expenses in case success drives unsustainably high usage

The key is finding counter metrics that incentivise a sustainable middle ground, rather than letting success metrics run amok in isolation.

Track success and counter metrics equally

It's not enough to just identify success and counter metrics - organisational behaviour only changes when they are tracked and incentivised equally. Every success metric report should be accompanied by its counter metrics. Product roadmaps should be evaluated based on projected impacts to both success and counter metrics.

Essentially, you need to transform your measurement culture to truly balanced analytics where no metric is optimised in isolation at the expense of other key drivers.

Counter metrics encourage strategic alignment

Beyond just keeping teams honest, balancing success and counter metrics keeps the entire organisation pulling in a coherent, sustainable direction. It's easy for department silos to emerge when individuals or teams are compensated based on specific success metrics without counter metrics.

  • Sales may aim to maximise conversion volumes, even if it means unprofitable customers.

  • Product may release engagement-boosting features without checking impacts on infrastructure costs or churn.

With counter metrics, however, there is inherent incentive alignment across the company toward metrics that collectively measure holistic, long-term health.

Counter metrics drive organisational learning

Counter metrics promote a mindset of continuous learning and improvement, rather than just blindly optimising individual metrics.

When counter metrics reveal unintended negative impacts from improving a success metric, it forces you to analyse what went wrong. You have to revisit the projects, processes, or assumptions that led to those undesirable side effects.

This sparks innovation as you adapt your strategies to optimise for the success metrics, while also systematically reducing the costly negative impacts exposed by the counter metrics over time.

Essentially, measuring both success and counter metrics together creates a virtuous cycle. You're always seeking balanced outcomes that improve what you want, without sacrificing other important areas.

On their own, metrics are just data points. But paired together, success and counter metrics enable intelligent growth by avoiding pivotal trade-offs that could undermine your business' long-term viability.

Ignore counter metrics at your own risk. Properly balanced metrics are essential for adapting and evolving your strategies in a fundamentally sound way over time.

OR watch the full video here:

© 2024 unmess. All rights reserved.