Alita Joyce


October 20, 2019

Summary: To measure learnability, determine your metric, gather your data, and plot the averages on a line curve. Analyze the learning curve by looking at its slope and its plateau.

What Is Learnability?

Learnability is one of the five quality components of usability (the others being efficiency, memorability, errors, and satisfaction). Testing learnability is especially valuable for complex applications and systems that users access frequently, though knowing how quickly users can acclimate to your interface is valuable for even objectively simple systems.

Learnability considers how easy it is for users to accomplish a task the first time they encounter the interface and how many repetitions it takes for them to become efficient at that task.

In a learnability study, we want to produce a learning curve, which reveals longitudinal changes of a quantified aspect of human behavior. With the data from the learning curve, we can identify how long it takes users to reach saturation — a plateau in our charted data which tells us that users have learned the interface as much as possible.

For example, let’s say we are redesigning an enterprise file-backup application intended to be run by IT administrators on a regular basis. We assume users will use the application frequently enough that they will progress up that learning curve. For such an application, it is crucial that users be able to complete their work as fast as possible. In this scenario, a learnability study will determine how fast administrators learn to run a backup efficiently. We recruit several representative users and invite them to the lab. Then we ask them to perform the backup and measure how long they take to do so for the first time. Next, we ask them to come back into the lab and do the task for a second time — again, measuring their task-completion time. This process repeats for several more times. The result of our study will be a learning curve which plots the task time over a set number of trials. 

Learning curve with average time on task decreasing across six trials and a saturation point reached at the fourth trial.
This learning curve shows the hypothetical completion time for a backup as a function of the number of task repetitions (or trials). Notice that the time for the first repetition is longest, and then the completion time decreases — by trial 4, it levels off, reaching the saturation plateau. Although details such as how many repetitions are needed to reach saturation will vary from case to case, this learning curve is representative of all human learning.

Learnability vs Efficiency

There are 3 different aspects of learnability, each of which is important to different kinds of users:

  • First-use learnability: How easy is it to use the design the first time you try? This aspect of learnability is of interest to those users who will only perform the task once. These users won’t progress up the learning curve, so they don’t care how it looks.
  • Steepness of the learning curve: How quickly do people get better with repeated use of the design? This facet of learnability is particularly important for users who will use the design multiple times, even though they won’t use it excessively. If people feel that they are progressing and getting better and better at using your system, they’ll be motivated to stick with it. (And conversely, if people feel that it’s hardly getting better, no matter how hard they try, they’ll start looking for a better solution.)
  • Efficiency of the ultimate plateau: How high is the productivity that users can reach with this interface, once they have fully learned how to use it? This aspect is particularly important for people with a frequent and long-lasting need to use the system — for example, when it’s the main tool for important everyday tasks.

Ideally, of course, your system should fare well on all 3 aspects. But, in the real world, design tradeoffs are often necessary, and you should shape the learning curve to cater mostly to those users who have the highest business value.

The relative importance of these dimensions also depends on the stages in the users’ lives. New users want to be able to learn the system quickly and get to the point of optimal (plateau) performance as soon as possible, but expert users want the plateau to be as low (i.e., the optimal task time as short) as possible.

Sometimes these different attributes of learnability may pull the design in different directions. For instance, a learnable system is not always efficient. Coming back to our  example, let’s assume that the backup was performed through a step-by-step wizard workflow with a lot of instructions and explanations. This system may be highly learnable: users may be able to perform the task as fast as possible even as they complete it for the first time. But the curve would be pretty much flat: they would not be able to perform it much faster the second time, as they would need to go through the same screens and answer the same questions.   As users become well-versed in the interface, this design will feel like hand-holding and will be inefficient for repeated use. (It is for this reason that we recommend implementing accelerators, or process shortcuts, for expert users.) Designers must carefully balance learnability and efficiency.

Learning curve with average time on task consistent across all six trials.
This learning curve shows the hypothetical completion time for a backup application with a wizard flow as a function of the number of task repetitions (or trials). Notice that, despite the increase in trials, the task time stays steady around 16 minutes. This system is learnable but not efficient.

Why Measure Learnability?

High learnability contributes to usability. It results in quick system onboarding which translates to low training costs. Additionally, good learnability can result in high satisfaction because users will feel confident in their abilities.

If your system and corresponding tasks are complex and ones that users access frequently, your product may be a good case for a learnability study. Learnability studies are time and budget consuming, so don’t pitch them haphazardly to stakeholders. It wouldn’t make sense to measure learnability for tasks which users complete infrequently or one time (for example, signing up for a service or filing annual taxes) because users will most likely behave like new users each time they encounter the task. In these cases, a standard usability test would be better suited and more cost-effective than a learnability study.

Running a Learnability Study

In learnability studies, we’re focused on gathering metrics, which is why we turn to quantitative research methods. This sort of study requires focused tasks and controlled experiments, and therefore quantitative usability testing is best suited for studying system learnability.


In running this type of study, we’re trying to determine how easily people learn our interfaces. Therefore, it is important to gather participants with little to no experience using the system that they’ll be testing.

One consideration when it comes to testing learnability is prior experience with similar systems. Prior experience may help users (for example, because they may be already familiar with domain conventions) or may slow them down (for example, because they may suffer from change aversion).  However, this data is still valuable, especially when launching a new product with the goal to steal customers away from existing products. When applicable, recruit participants with no similar system experience and participants with some similar-system experience, and plan to compare corresponding data from both groups.

As for any quantitative study, we recommend that you recruit a fairly large number of participants (usually at least 30–40). The exact number will depend on the complexity of your task, with highly complex tasks requiring more participants to account for the inherently higher data variability, and simpler tasks requiring fewer participants.

Step 1: Determine the Metric

Time on task is the most commonly collected metric for learnability studies. The reason is the power law of learning, which says that the time it takes to complete a task decreases with the number of repetitions of that task. The rest of this article will assume you’re collecting time on task as the primary metric.

Depending on your system, time on task might not be relevant and therefore you need a different metric. In these situations, consider collecting the number of errors users make for a given task.

Step 2: Determine the Number of Trials

The next step consists of deciding how often to collect these metrics — each instance of data collection is known as a trial.

Remember, we’re trying to plot this metric over time, so we need to have the same participants complete the same task multiple times. We recommend you repeat the trials until a plateau is reached. A flattened curve indicates our participants have learned the system (specific to this task) as much as possible.

When considering trials, there are two questions you may be asking: how many trials should I run? And how far apart should the trials be? The answer to both of these questions depend on your circumstances.

To predict the number of trials needed for a user to reach a point of saturated learning, consider your system complexity. As a starting point, consider 5–10 trials but when in doubt, plan for more trials than you think you need, for two reasons: (1) you want to be sure that you’ve reached stable performance and (2)  once you’ve reached a point of stable performance, it’s generally easier to cancel usability sessions than to schedule more.

If you’re wondering how much time is necessary between trials, consider how often you anticipate your customers to use the product and match that interval as closely as possible. For a task that users perform daily or a few times a week, you can have trials on consecutive days. But for tasks done once a month you may want to leave 4 weeks between trials.  

Step 3: Gather and Plot the Data

Remember to recruit the same participants for each trial and have them complete the same task(s) in each trial. (This is different than the normal case, where you want different test users to study different iterations of a design.) You may want to run a learnability study and test with multiple tasks. If this is the case, be sure to randomize your tasks to avoid biasing your results. In research studies, users take what they know from one task and apply it to future tasks; task randomization helps to mitigate this effect.

For each task, calculate the metric averages for each trial and plot them on a line graph with labeled axes. By plotting the data for each trial, you will obtain the learning curve for that task.

Step 4: Analyze the curve

As with any quantitative study, you will want to analyze the data for statistical significance. In other words, you will have to investigate whether the trial effect was indeed significant — namely, whether the drop that you see in your learning curve is real or is just the result of noise in the data. Usually, the statistical method involved will be fairly simple — a one-way repeated-measures ANOVA with trial as the factor.

Once you’ve done your analysis (and presumably found that the trial effect was significant), consider the big picture: What is the slope of your learning curve? Less-learnable interfaces have relatively small drops in the curve and take many trials to reach a point of saturation. Alternatively, highly learnable systems have curves that are steep and drop quickly and reach the saturation point after fewer repetitions.

For example, in our original file-backup example, it took users 4 trials to reach the saturation plateau and become efficient. That may seem acceptable. On the other hand, if it took them 30 trials to reach that same point, the learnability will likely be too low.

Also, consider the final efficiency: is it acceptable that, once users have learned how to perform the task, it will take them 10 minutes? The answer may depend on what that number is for competitor products. If a competitive analysis isn’t viable, you can also compare the findings to costs and ROI. If an administrator spends 10 minutes a day to complete a backup task in an optimal way and performs the task daily for a year, this amounts to 3650 minutes or approximately 60 hours. At a cost of $100 per hour, it means that the company will spend $6000 for completing the backups. Whether that amount is acceptable or may need to be lowered (by improving the design) will depend on the specifics of each product.


The learnability of a product tells us how fast users reach optimal behavior with that product. It is important to measure learnability for UIs that get used relatively frequently. A learnability study involves repeated measurements of the same participants completing the same task. The result of a learnability study is a learning curve that will uncover how many repetitions are needed in order for users to complete the task efficiently.

Even if you don’t conduct a complete learnability research project to plot the full learning curve, thinking about these concepts will help you make the trade-off decisions to design products that target your most important customers.

For more on design tradeoffs, like learnability versus efficiency, check out our course, Design Tradeoffs and UX Decision Frameworks.


Tom Tullis, Bill Albert (2013) Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann.

Allen Newell, Paul Rosenbloom (1980). Mechanisms of skill acquisition and the law of practiceTechnical Report. School of Computer Science, Carnegie Mellon University.


  1. I think this is among the so much vital information for me.

    And i am happy studying your article. But want to statement on few common things, The site taste is ideal, the articles
    is in point of fact excellent : D. Just right process, cheers

  2. Hello everyone, it’s my first visit at this web
    site, and post is in fact fruitful in favor of me, keep up posting such content.

  3. Wonderful blog! Do you have any tips and
    hints for aspiring writers? I’m hoping to start my own site
    soon but I’m a little lost on everything. Would you
    propose starting with a free platform like WordPress or go
    for a paid option? There are so many choices out there that I’m completely confused ..
    Any ideas? Thank you!

  4. Good way of explaining, and good paragraph to get information concerning my presentation subject matter, which i am
    going to present in academy.

  5. Howdy I am so grateful I found your website, I really found
    you by accident, while I was researching on Google for something else, Anyways I am here now and
    would just like to say thanks for a marvelous post
    and a all round entertaining blog (I also love the theme/design), I don’t have time
    to go through it all at the minute but I have book-marked it and also added in your RSS feeds, so when I have
    time I will be back to read more, Please do keep up
    the excellent b.

    Stop by my blog post; idn poker pulsa

  6. Greetings! This is my first visit to your blog!
    We are a team of volunteers and starting a new project in a community in the
    same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  7. Wow, amazing blog layout! How long have you been blogging for?

    you made blogging look easy. The overall look of your web site is wonderful, as well as the content!

  8. Hey! Do you know if they make any plugins to safeguard against
    hackers? I’m kinda paranoid about losing everything I’ve worked hard on. Any recommendations?

  9. Hi there! This article couldn’t be written any better!

    Looking at this post reminds me of my previous roommate!
    He continually kept talking about this. I am going to forward this post to him.
    Pretty sure he’ll have a good read. Thanks for sharing!

  10. We are a group of volunteers and opening a new scheme in our
    community. Your website provided us with valuable information to work on. You’ve done an impressive job and
    our whole community will be grateful to you.

  11. That is really fascinating, You’re an overly skilled blogger.

    I’ve joined your feed and look ahead to seeking extra
    of your wonderful post. Additionally, I have shared your website in my social networks

  12. Hurrah! At last I got a webpage from where I be capable of genuinely take helpful information regarding my study and knowledge.

  13. Good site you have here.. It’s hard to find excellent
    writing like yours these days. I seriously appreciate people like you!

    Take care!!

  14. I’d like to thank you for the efforts you have put in penning
    this website. I really hope to check out the
    same high-grade blog posts by you later on as well. In truth, your
    creative writing abilities has inspired me to get my very own site now 😉

  15. What’s up i am kavin, its my first occasion to commenting anywhere,
    when i read this paragraph i thought i could also create comment due to this brilliant piece of writing.

  16. I believe that is among the so much vital info for me. And
    i’m satisfied studying your article. However should commentary on some common things, The web site taste is
    perfect, the articles is in point of fact excellent :
    D. Good activity, cheers

  17. When I originally commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get three emails with the
    same comment. Is there any way you can remove people from that service?
    Appreciate it!

  18. When someone writes an post he/she maintains the image of a user in his/her mind
    that how a user can be aware of it. Thus that’s why this post is great.

  19. I have to thank you for the efforts you have put in penning this blog.
    I really hope to check out the same high-grade blog posts by you later on as well.
    In truth, your creative writing abilities has inspired me to get my very own site
    now 😉

  20. Hello to every body, it’s my first pay a quick visit of this web
    site; this web site consists of amazing and genuinely fine stuff for readers.

  21. Sweet blog! I found it while surfing around on Yahoo News.

    Do you have any suggestions on how to get listed in Yahoo News?
    I’ve been trying for a while but I never seem to get there!

    Thank you

  22. If you wish for to grow your knowledge only keep visiting this site and be updated with the hottest news
    posted here.

  23. Very nice post. I just stumbled upon your blog and wished to say that I’ve truly enjoyed browsing your blog posts.
    In any case I’ll be subscribing to your feed and I hope you write
    again soon!

  24. Hey there! This is my 1st comment here so I just wanted to give a quick shout out and say I genuinely enjoy reading
    through your blog posts. Can you recommend any other blogs/websites/forums that go
    over the same subjects? Thanks a ton!

  25. An impressive share! I’ve just forwarded this onto a coworker who has been doing a little research on this.
    And he in fact bought me lunch due to the fact that I stumbled
    upon it for him… lol. So let me reword this….
    Thanks for the meal!! But yeah, thanks for spending time to discuss this subject
    here on your web site.

  26. Hi! I just wish to give you a big thumbs up for the great info you’ve
    got right here on this post. I will be coming back to your web site for more soon.

  27. I have read a few good stuff here. Certainly price bookmarking for revisiting.
    I wonder how much effort you place to make this sort of magnificent informative site.

  28. I seriously love your website.. Very nice colors & theme.
    Did you develop this web site yourself? Please reply
    back as I’m hoping to create my own website and want to learn where you got this from
    or exactly what the theme is named. Appreciate it!

  29. Thanks for your personal marvelous posting! I actually enjoyed reading it, you might be a great
    author. I will make certain to bookmark your blog and definitely will come
    back later on. I want to encourage you continue your
    great posts, have a nice evening!

  30. Woah! I’m really loving the template/theme of this site.
    It’s simple, yet effective. A lot of times it’s tough to get that “perfect balance” between usability and appearance.

    I must say you have done a excellent job with this. Additionally, the blog loads extremely quick for me on Opera.
    Outstanding Blog!

  31. It’s truly a great and helpful piece of information.
    I am glad that you shared this useful information with us.

    Please keep us up to date like this. Thank you
    for sharing.

  32. Its like you learn my mind! You appear to know so much about this, such as you
    wrote the e book in it or something. I feel that you just
    could do with some % to drive the message house a little bit, but other than that,
    this is wonderful blog. A fantastic read. I will certainly be back.

  33. What a material of un-ambiguity and preserveness of precious familiarity on the topic
    of unpredicted feelings.

  34. Wow, that’s what I was seeking for, what a material!

    existing here at this weblog, thanks admin of this site.

  35. Attractive section of content. I just stumbled upon your web site and in accession capital to assert
    that I get actually enjoyed account your blog posts.
    Any way I’ll be subscribing to your feeds and even I achievement you access consistently

  36. What i do not realize is in reality how you are now not actually much more
    smartly-appreciated than you might be right now.
    You are so intelligent. You understand thus considerably with regards to
    this matter, produced me in my opinion consider it from a lot of varied angles.

    Its like men and women are not involved unless it is something to do with Lady gaga!
    Your own stuffs nice. At all times deal with it up!

  37. I’ve been browsing online more than 2 hours today, yet I never found
    any interesting article like yours. It is pretty worth enough for me.
    In my opinion, if all web owners and bloggers made good content as you did, the net will be much more useful than ever

  38. You actually make it appear so easy along with your presentation but I
    in finding this topic to be really something whiich I feesl I might
    never understand. It seems too complex and extremely huge for me.
    I’m looking ahead on your subsequent put up, I will try
    tto get the hold oof it!

    My website filles nues

  39. I do believe all the concepts you’ve introduced for your post.
    They’re really convincing and will certainly work.
    Nonetheless, the posts are too short for beginners.
    May just you please lengthen them a little from next time? Thanks for
    the post.

  40. Thanks for the marvelous posting! I certainly enjoyed reading it, you happen to be
    a great author. I will be sure to bookmark your blog
    and definitely will come back in the future.
    I want to encourage yourself to continue your great work, have a nice
    holiday weekend!

  41. You could definitely see your expertise within the article you write.
    The sector hopes for more passionate writers such as you who aren’t afraid to say how they believe.
    Always go after your heart.

  42. Hey very nice website!! Guy .. Excellent ..
    Wonderful .. I will bookmark your web site and take the
    feeds additionally? I’m glad to search out numerous helpful info
    right here in the post, we’d like work out more techniques in this regard,
    thank you for sharing. . . . . .

Leave a Reply

Your email address will not be published.