Skip to main content

Meaningful Data on Customer Success

By
I've always wondered how instructional designers appear to work in silos while building training and cranking out several hours of courses. With the advent of xAPI and data science, we could consider a possibility of linking training 'outcomes' to customer success.

New Implementation Case Study

Let's take the case of a new product release or a new implementation for a large company like Oracle or Salesforce. The partners and consultants undergo training to either use the product in their day-to-day tasks, or to implement it for a customer. A 5-day training is organized and successfully completed. Now the consultants are ready to head back and actually implement the application.

After this point, I've never had visibility into 'data' about the outcomes of the training. I've never known whether they were actually able to use the specific knowledge to successfully use an application including their ability to troubleshoot issues and design one-off customizations. I recently read a few posts on LinkedIn that questioned if xAPI could take a step further and track more information about what users are doing in the application and map it to learning outcomes. This gave me a few ideas...
  1. Can we gather meaningful data on the entire lifecycle of a project starting from 'training'?
  2. Can we then track if it resulted in changed behavior and successful use of the products and effective troubleshooting?
  3. Did it reduce the number of support tickets that cost the company money?
  4. Did it progress the learner to the next level of maturity in their product knowledge?
If we could design a program to first collect all this data and then present it to a PMO, then could we incrementally focus and redesign training to achieve more specific outcomes, thereby reducing trial and error linked with too many unnecessary support tickets? I think this would be a wonderful alternative to a lot of incomplete metrics that only grill product teams excluding the 'training' and the expected outcomes. This could also make training an integral part of the lifecycle to address and enhance customer experience and satisfaction.

Considerations for Metrics on Customer Success

Training is not the only factor that impacts customer success. It is key for metrics to also include other parameters such as, why was an implementation delayed or unsuccessful? There could be other possible reasons which can be included into the metrics:
  • Unavailability of or issues with the application environment, or existing bugs.
  • Implementor not following the instructions or best practices suggested in training.
  • Confusing design of the application where users repeatedly make mistakes.
  • Prerequisite setups impacting the current tasks were incorrect.
Good metrics depends on complete and good data. They have to be assembled meaningfully to measure business value of the outcomes by clearly identifying the root causes of any issues, and providing opportunity for continual improvement.
Labels:

Comments

Post a Comment

Popular posts from this blog

Big Question: OMG I'm Stuck!!

By
This months Big Question is about Stuck?Getting Unstuck? Stuck, is exactly how I feel, and the reason I started blogging and connecting with people. My blog becomes a forum to get my ideas out. So there's the problem and the solution right there! But come on now, don't we all feel stuck at different points in our work or even personal life? Well, being stuck is very much a reality as anything else, and I've felt this way many times before. Each place I worked posed different kinds of challenges, but to get to the point, here we're talking about being stuck in your organization with a lot of great ideas about how to improve things around you and the service you deliver to the customer. There are several reasons why one gets 'stuck' so to say: Your organization is just very happy doing what they always have been doing as it earns them money anyway. Your team members, who drive a lot of the initiatives because they've been around longer than you, just don'...
7 comments
Read more

Best Practices and Design Patterns

By
How amusing that the very topics I had planned for my blog became a topic of discussion before I could even write up my post. I was planning to list some best practices in my field of work since quite sometime now, as I'm a believer in the concept due to the goal it intends to achieve—better and efficient performance. Looking at the posts and comments on Jane Bozarth and Tony Karrer's blogs it appears that the term is either 'overused' or misunderstood. I never had any doubts about what it meant until I read these posts. I read Jane Bozarth's post on The Myth of "Best Practices" the day she posted it and empathized with her point of view that people expect to get best practices for almost anything they want to learn. She's right from her perspective in saying that before asking such questions, one needs to understand that... ------------------------------------------------------------------------------------------------ A "best practice" is ...
3 comments
Read more