Active Users are a Vanity Metric

vanity-metricsActive customers churn. And when they do we’re shocked and confused.

How can this happen? Your customer was very active, logging-in several times in the last month.

I think it’s fair to say that if Active customers churn, then “active” – as a customer “state” – clearly doesn’t equate to success.

So if it doesn’t mean your customer is successful, what exactly does “active” mean?

Let’s explore this a bit further…

The State of Your Customer is NEVER Binary

In my experience, “Active” is usually a vanity metric. We feel good when our users are “active.”

We can tout metrics like Daily or Monthly Active Users (DAU / MAU)… it’s fantastic, as long as “active” means something.

“Inactive” on the other hand is an opposite-of-vanity metric; we panic when they flip from active to inactive.

But neither of those “user states” – active or inactive – actually mean anything on their own, without additional context.

“Active” is a made-up “metric” that may or may not equate to the customer achieving success, realizing value, or doing anything that actually matters to them.

Quite often – at least in SaaS – “active” is unfortunately tied to in-app activity with one of the key inputs being “logins.”

Inactive is more telling, right? The user stops “using” and they stop getting value. Unless the email reports are all they need (are they interacting with those emails a lot but not logging in?), right? Or their seasonal downtime kicks in. Or they’re on vacation.

Or you’re defining “inactive” as not using certain features you WANT them to use (or they bought) but in fact, they’re achieving their Desired Outcome thank you very much.

Context is everything, which is why…

Logins Don’t Matter

While you generally need to sign-in to an app to get value, that action alone is probably not the thing that delivers value to your customer.

Simply being “active” in the product doesn’t mean you’re being “successful” either.

In fact, a lot of logins and random in-app activity could be a sign that your customer can’t figure out what to do… but they sure would like to.

It’s a signal that something’s amiss… but a lot of companies might wrongly classify that customer as “active” and therefore “onboard” and “successful.”

“Active” – logins, random in-app activity, etc. – without context could be that the user wants to do something but can’t figure it out, so “active” in that case is actually a churn threat. Crazy.

A Better Definition of “Active”

When it comes to “activity” in your app, you need to know what activity patterns equate to value delivered.

No, that doesn’t have to be realtime analysis of complex clickstreams across user cohorts… but it might mean that if their Desired Outcome with your CRM is more sales, that they’re adding leads, calling or emailing those leads, scoring those leads, killing some, closing others, and marking some as “won.”

In fact, just a subset of all of those – marking some leads as “won” – would be enough to know their activity is generating the desired results.

On the other hand, you could say that – since they’re NOT using the 42 other features that your product has – or that the pricing tier they signed-up at includes – that they’re inactive and are a churn threat. Even though they’re marking leads as “won.”

The Context of Desired Outcome

If you tag a customer as “active” or “inactive” simply by looking at usage activity WITHOUT the context of Desired Outcome, you will miss things, waste time and resources trying to “save” a customer that’s not a churn threat, ignore customers that are a threat, and otherwise inhibit your growth as a company.

But if you knew what they were trying to achieve, and knew that they were in fact achieving that or at least taking the actions necessary in your product to get them to that point (there is often a Success Gap between functional use of your product and their Desired Outcome), you would know that they are as “active” as necessary and are achieving success with your product.

If value is being delivered – if their Desired Outcome is being achieved – then Activity is where needs to be, at least at this point in the customer lifecycle.

Of course, you need to show them what their Desired Outcome should be, which would require activity and adoption to increase, which is why you need to develop a customer Nurture Program… but that’s a topic for a webinar I did recently with KISSmetrics.

About Lincoln Murphy

I am a Customer Success Consultant focused on Customer Success-driven Growth. I wrote the Customer Success book which you can buy at Amazon. If you need help applying Customer Success-driven Growth principles in your company or would like me to speak at your event, please contact me. Also, connect with me on LinkedIn or follow me on Twitter or Facebook.

Comments

  1. A good article and a telling point. Though the Active/Inactive metric is a valid measurement, being active does not convey customer success and satisfaction any more that a lack of Support tickets conveys satisfaction or comfort with a product. This information can only validate the customer’s Health score when used with other metrics and feedback

Trackbacks

  1. […] covered the topic of users being a vanity metric before, and I just recently covered the topic of “active users” being a vanity metric, as […]

  2. […] artigo foi adaptado do original, “Active Users are a Vanity Metric”, do Sixteen […]

  3. […] Simple. And as a vendor, you could look at metrics like number of emails sent and feel good knowing your customer is “active” and using your […]

  4. […] while they were “active” (it’s difficult to know how meaningfully active a customer or user is in a somewhat passive […]

  5. […] their Desired Outcome, so make sure that whatever activity you’re measuring and monitoring is meaningful activity that’s in-line with moving them toward their Desired […]

  6. […] to that first week and look for patterns between who did, and did not, log in during week 6. (Note: logins alone don’t matter.) Mal and Tam were clearly just looking, but Kaylee and Wash both viewed deals, clicked, bought and […]

  7. […] will include functional milestones within the product, of course, but they won’t just be activity for activity’s sake. They will be the result of meaningful activity and will be tied to other inputs to ensure we know […]

  8. […] said before that “active users” is a vanity metric because if any type of “activity” actually meant something, then active customers and […]

Speak Your Mind

*