how-to-get-better-at-embracing-unknowns

Interpreting uncertainty through data visualizations

Credit: Jessica Hullman and Jen Christiansen

In Brief

  • Data-visualization techniques can clarify the uncertainty in information or make it more confusing if not implemented well.
  • For example, even though error bars seem exact, people often misunderstand them. 
  • Quantile dot plots can be effective because they present uncertainty as discrete probabilities that people can readily see. 
  • Effective visualizations of uncertainty can help us make judgments, analytically and emotionally, about the likelihood of future events.
Credit: Tiffany Farrant-Gonzalez; Sources: National Hurricane Center (cone of uncertainty); “Visualizing Uncertain Tropical Cyclone Predictions Using Representative Samples from Ensembles of Forecast Tracks,” by Le Liu et al., in IEEE Transactions on Visualization and Computer Graphics, Vol. 25; August 20, 2018 (multiple storm paths)

Uncertainty pervades the data that scientists and all kinds of organizations use to inform decisions. Visual depictions of information can help clarify the uncertainty—or compound confusion. Ideally, visualizations help us make judgments, analytically and emotionally, about the probability of different outcomes. Abundant evidence on human reasoning suggests, however, that when people are asked to make judgments involving probability, they often discount uncertainty. As society increasingly relies on data, graphics designers are grappling with how best to show uncertainty clearly.

What follows is a gallery of visualization techniques for displaying uncertainty, organized roughly from less effective to more effective. Seeing how different approaches are chosen and implemented can help us become more savvy consumers of data and the uncertainty involved.

NO QUANTIFICATION

The least effective way to present uncertainty is to not show it at all. Sometimes data designers try to compensate for a lack of specified uncertainty by choosing a technique that implies a level of imprecision but does not quantify it. For example, a designer might map data to a visual variable that is hard for people to define, such as a circle floating in space rather than a dot on a graph that has x and y axes. This approach makes the reader’s interpretation more error-prone. Alter­natively a designer might use a program that creates a hand-drawn or “sketchy” feel. Both approaches are risky. 

Credit: Jessica Hullman and Jen Christiansen

INTERVALS

Intervals may be the most common representations of quantified uncertainty. Error bars and confidence envelopes are widely recognized, but even though they seem exact and straightforward, they are notoriously hard to interpret properly. Research shows they are often misunderstood, even by scientists.

Credit: Jessica Hullman and Jen Christiansen

PROBABILITY DENSITY MAPS

Designers can map uncertainty directly to a visual property of the visualization. For example, a gradient plot can shift from dark color (high probability) at the center to lighter color (low probability) at the edges. In a violin plot, wider points mean greater probability. Mapping probability density to a visual variable displays uncertainty in greater detail than interval methods (error bars and confidence envelopes), but its effectiveness depends on how well readers can perceive differences in shading, height or other visual properties.

Credit: Jessica Hullman and Jen Christiansen

ARRAYS OF ICONS

Reframing a probability such as 30 percent as a frequency—three out of 10—can make it easier for people to understand uncertainty and consequently use such information appropriately. People may better understand discrete probabilities because they run into them in everyday experiences.

Credit: Jessica Hullman and Jen Christiansen

MULTIPLE SAMPLES IN SPACE

Plotting of multiple samples in space can be used to show probability in a discrete format for one or more variable quantities. One example of this approach is a quantile dot plot. It shows a number of distinct cases from the quantiles of the data distribution, so that the number of dots (such as two dots high or five dots high, in the example below) conveys probability. When there is uncertainty about parameter values from which estimates are drawn, such as initial conditions, samples can be generated that vary these parameters and can be shown in a single visualization.

Credit: Jessica Hullman and Jen Christiansen

MULTIPLE SAMPLES IN TIME

Plotting multiple possible outcomes as frames in an animation makes uncertainty visceral and much harder to ignore. This technique, called hypothetical outcome plots, can be used for simple and complex visualizations. Perceptual studies indicate that people are surprisingly adept at inferring the distribution of data from the frequency of occurrences: we do not necessarily need to count the number of times an event occurs to estimate its probability. One important factor is the speed of events, which must be fast enough so that people can see a sufficient number of samples yet slow enough for them to consciously register what they saw.

Credit: Tiffany Farrant-Gonzalez (election needle), Jessica Hullman and Jen Christiansen (graph)

HYBRID APPROACHES

Designers can create effective uncertainty visualizations by combining different techniques rather than choosing a standard chart “type.” One example is a fan chart, made famous by the Bank of England. It depicts data up to the present, then projections into the future; uncertainty about the past is an important component in assessing uncertainty about the future. The fan chart presents probability from higher chance to lesser chance in multiple bands that represent different levels of confidence, which the reader can choose from. Readers can perceive the information through the position of the edges of the bands, as well as lightness versus darkness. Some modern software packages for statistical graphics and modeling make it easy to combine uncertainty visualization approaches.

Credit: Jen Christiansen Source: Inflation Report, Bank of England, February 2010

This article was originally published with the title “Confronting Unknowns” in Scientific American 321, 3, 80-83 (September 2019)

doi:10.1038/scientificamerican0919-80

MORE TO EXPLORE

Picturing the Uncertain World: How to Understand, Communicate, and Control Uncertainty through Graphical Display. Harold Wainer. Princeton University Press, 2009.

Visualizing Uncertainty. Claus O. Wilke in Fundamentals of Data Visualization. O’Reilly Media, 2019.

Uncertainty Visualization, Explained. Blog series by Jessica Hullman and Matthew Kay. https://medium.com/multiple-views-visualization-research-explained

FROM OUR ARCHIVES

Saving Big Data from Itself. Alex “Sandy” Pentland; August 2014.

ABOUT THE AUTHOR(S)

Jessica Hullman

    Jessica Hullman is a professor of computer science and journalism at Northwestern University. She and her research group develop and evaluate data-visualization and data-interaction techniques to enhance reasoning about uncertainty.

    Credit: Nick Higgins

    149 comments

    1. Hello! I know this is kind of off topic but I was wondering if you knew where I could
      get a captcha plugin for my comment form? I’m using the
      same blog platform as yours and I’m having trouble finding one?
      Thanks a lot!

    2. Greetings! I’ve been reading your weblog for a while now and finally got the courage to go ahead and give you a
      shout out from Lubbock Texas! Just wanted to tell you keep up the great job!

    3. Hey there! I just want to give you a huge thumbs up for the excellent information you have right here on this
      post. I will be returning to your web site for more soon.

    4. I am not sure where you’re getting your information, but
      great topic. I needs to spend some time learning much more or
      understanding more. Thanks for wonderful info I was looking for this info for my mission.

    5. With havin so much written content do you ever run into any issues
      of plagorism or copyright infringement? My website
      has a lot of completely unique content I’ve either created myself or outsourced
      but it looks like a lot of it is popping it up all over the
      internet without my authorization. Do you know any solutions to help protect against content from being ripped off?
      I’d really appreciate it.

    6. Fantastic goods from you, man. I have have in mind your
      stuff previous to and you are just extremely magnificent.
      I really like what you’ve bought right here, really like what you
      are stating and the best way in which you are saying it.

      You make it enjoyable and you continue to take care of to
      stay it wise. I can’t wait to read much more from you.
      This is actually a tremendous website.

    7. Generally I do not learn post on blogs, but I wish to say that this write-up very forced me to take a look at and do it!

      Your writing style has been amazed me. Thanks,
      quite great article.

    8. I do not even know how I finished up right here, but I believed this publish used to be great.

      I don’t recognise who you are but definitely you are going to
      a well-known blogger in case you are not already.

      Cheers!

    9. It’s very straightforward to find out any topic on web
      as compared to books, as I found this piece of writing at this web site.

    10. Definitely believe that which you stated. Your favorite reason appeared to
      be on the web the easiest thing to be aware of.
      I say to you, I certainly get annoyed while people
      think about worries that they plainly do not know about.
      You managed to hit the nail upon the top as well as
      defined out the whole thing without having side-effects , people can take a signal.
      Will likely be back to get more. Thanks

    11. I’ve been exploring for a bit for any high-quality articles or weblog posts
      on this sort of area . Exploring in Yahoo I eventually stumbled upon this site.
      Reading this info So i am satisfied to express that I’ve a very excellent uncanny feeling I discovered exactly what
      I needed. I such a lot surely will make certain to
      do not put out of your mind this website and give
      it a look on a continuing basis.

    12. I was curious if you ever thought of changing the structure of
      your website? Its very well written; I love what youve got to say.
      But maybe you could a little more in the way of content so people could connect with it better.
      Youve got an awful lot of text for only having 1
      or two pictures. Maybe you could space it out better?

    13. Hi there, constantly i used to check weblog posts here early in the break of day,
      because i enjoy to gain knowledge of more and more.

    14. I like the valuable info you provide to your articles.

      I’ll bookmark your blog and take a look at again right here frequently.
      I am rather sure I will be told many new stuff proper here!

      Good luck for the following!

    15. Thanks a lot for sharing this with all people you actually know what you’re talking approximately!
      Bookmarked. Kindly additionally visit my website =).
      We may have a link change contract between us

    16. Today, I went to the beachfront with my children. I found a sea shell
      and gave it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.” She
      placed the shell to her ear and screamed.

      There was a hermit crab inside and it pinched her ear.
      She never wants to go back! LoL I know this is totally off topic but I had to tell
      someone!

    17. Hey I know this is off topic but I was wondering if you knew of any widgets I could
      add to my blog that automatically tweet my newest twitter updates.
      I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would
      have some experience with something like this. Please let
      me know if you run into anything. I truly enjoy reading
      your blog and I look forward to your new updates.

    18. Appreciating the hard work you put into your blog and in depth information you provide.
      It’s great to come across a blog every once in a while that isn’t
      the same old rehashed material. Great read! I’ve bookmarked
      your site and I’m including your RSS feeds to my Google account.

    19. It’s really a cool and helpful piece of info. I’m happy that you simply shared this useful information with us.
      Please keep us informed like this. Thank you for sharing.

    20. Fantastic goods from you, man. I’ve understand your stuff
      previous to and you are just extremely wonderful. I really like what you’ve acquired here, really like what you’re saying and the way
      in which you say it. You make it entertaining and you still take care of to keep it smart.
      I can not wait to read much more from you. This is really a great
      site.

    21. Everything is very open with a really clear clarification of the issues.
      It was definitely informative. Your site is very helpful.
      Thank you for sharing!

    22. Hello! I understand this is kind of off-topic however I had to ask.
      Does running a well-established website like yours take a large
      amount of work? I’m completely new to writing a blog however I do write in my diary every day.

      I’d like to start a blog so I can easily share my experience and views
      online. Please let me know if you have any kind of suggestions or tips for new aspiring blog owners.
      Thankyou!

    23. Woah! I’m really loving the template/theme of this site.
      It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between usability and appearance.
      I must say that you’ve done a superb job with this. In addition, the blog loads extremely quick for
      me on Internet explorer. Exceptional Blog!

    24. An impressive share! I have just forwarded this onto
      a colleague who has been conducting a little homework on this.
      And he in fact bought me breakfast simply because I discovered
      it for him… lol. So allow me to reword this….

      Thank YOU for the meal!! But yeah, thanx for spending some
      time to talk about this issue here on your site.

    25. If you are going for best contents like myself, simply go to see this site everyday as it presents
      feature contents, thanks

    26. Great blog right here! Additionally your website a lot
      up very fast! What web host are you the use of?
      Can I get your associate hyperlink to your host? I desire my site loaded up as fast as yours lol

    27. Thank you for another informative website.
      Where else could I get that kind of information written in such a perfect means?
      I have a undertaking that I am simply now operating on, and I have been at the look out for such info.

    28. Link exchange is nothing else but it is simply placing the other person’s website link on your page at proper place and other person will also do similar in favor of you.

    29. hi!,I really like your writing so a lot! proportion we be in contact extra approximately
      your article on AOL? I require an expert in this space to solve my problem.
      May be that is you! Having a look ahead to see you.

    30. Wonderful beat ! I wish to apprentice at the same
      time as you amend your site, how could i subscribe
      for a weblog site? The account helped me a acceptable deal.
      I had been tiny bit familiar of this your
      broadcast offered bright clear idea

    31. Hey, I think your blog might be having browser compatibility issues.
      When I look at your blog in Firefox, it looks fine but when opening in Internet Explorer, it
      has some overlapping. I just wanted to give you a quick heads up!
      Other then that, awesome blog!

    32. Thanks for some other excellent post. Where else may just anybody get
      that type of information in such a perfect way of writing?
      I’ve a presentation next week, and I’m at the search
      for such info.

    33. I was more than happy to find this site. I need
      to to thank you for your time for this particularly fantastic read!!

      I definitely liked every little bit of it and i also have you book-marked to look at
      new things in your website.

    34. I was wondering if you ever thought of changing the structure of your
      site? Its very well written; I love what youve got to say.
      But maybe you could a little more in the way of content so people could connect with it better.
      Youve got an awful lot of text for only having one or two images.
      Maybe you could space it out better?

    35. Have you ever considered about including a little bit more than just your articles?
      I mean, what you say is valuable and all.
      But think of if you added some great photos or video clips to
      give your posts more, “pop”! Your content is excellent but with images and clips, this site could definitely be one of the
      greatest in its niche. Wonderful blog!

    36. Howdy would you mind letting me know which web host you’re working with?
      I’ve loaded your blog in 3 different browsers and I must say this
      blog loads a lot faster then most. Can you recommend a good web hosting provider at
      a fair price? Thank you, I appreciate it!

    37. Hello there, I do believe your site may be having web browser compatibility issues.
      When I look at your site in Safari, it looks fine but when opening in I.E., it has some overlapping issues.
      I just wanted to give you a quick heads up! Aside from that, fantastic blog!

    38. You could certainly see your expertise in the article
      you write. The sector hopes for more passionate writers like you who are not afraid to mention how they believe.
      All the time follow your heart.

    39. Hey there! I know this is kinda off topic but I’d figured
      I’d ask. Would you be interested in trading links or maybe guest writing a blog post or vice-versa?
      My website addresses a lot of the same subjects as yours and I think we
      could greatly benefit from each other. If you are interested
      feel free to shoot me an email. I look forward to hearing from you!
      Superb blog by the way!

    40. Hi would you mind sharing which blog platform you’re working with?
      I’m planning to start my own blog in the near future but I’m having
      a difficult time choosing between BlogEngine/Wordpress/B2evolution and Drupal.
      The reason I ask is because your design seems different then most blogs and I’m looking for something
      completely unique. P.S Apologies for getting off-topic
      but I had to ask!

    41. Hi there would you mind letting me know which web host you’re using?
      I’ve loaded your blog in 3 completely different internet browsers and I must say this blog loads a
      lot quicker then most. Can you recommend a good web hosting provider at a
      reasonable price? Kudos, I appreciate it!

    42. Good day! I just would like to offer you a huge
      thumbs up for the great information you’ve got right here
      on this post. I’ll be returning to your web site for more soon.

    43. Good day! This is my 1st comment here so I just wanted
      to give a quick shout out and say I truly enjoy reading your
      blog posts. Can you suggest any other blogs/websites/forums that go over the same subjects?
      Appreciate it!

    44. What’s up friends, how is all, and what you wish for to say on the topic of this
      piece of writing, in my view its genuinely awesome in support
      of me.

    45. Appreciating the hard work you put into your website and
      in depth information you provide. It’s good to come across
      a blog every once in a while that isn’t the same outdated rehashed material.
      Excellent read! I’ve bookmarked your site and I’m including your RSS feeds to my Google account.

    46. It’s the best time to make some plans for the future and it’s time to be happy.
      I have read this post and if I could I want to suggest
      you few interesting things or tips. Maybe you could write next articles referring to this article.
      I want to read more things about it!

    47. Hello! I could have sworn I’ve been to this site before but after
      going through some of the posts I realized
      it’s new to me. Nonetheless, I’m certainly happy I came across it and
      I’ll be book-marking it and checking back often!

    48. Wonderful beat ! I wish to apprentice while you amend your site, how can i subscribe
      for a blog web site? The account aided me a acceptable deal.
      I had been tiny bit acquainted of this your broadcast provided bright clear idea

    49. Woah! I’m really enjoying the template/theme
      of this site. It’s simple, yet effective.
      A lot of times it’s very hard to get that “perfect balance” between superb usability
      and visual appearance. I must say that you’ve done a very good job with this.
      In addition, the blog loads extremely fast for me on Opera.
      Superb Blog!

    50. It’s perfect time to make some plans for the
      future and it’s time to be happy. I’ve learn this publish and if
      I may I desire to recommend you few interesting things or suggestions.
      Perhaps you can write next articles referring to this article.
      I wish to learn more issues about it!

    51. I like the helpful information you provide in your articles.
      I’ll bookmark your blog and check again here frequently.
      I am quite sure I’ll learn many new stuff right here! Best of luck
      for the next!

    52. You really make it seem so easy with your presentation but I find this topic to be really something which I think
      I would never understand. It seems too complex and
      extremely broad for me. I am looking forward for your next post, I’ll try to get the hang
      of it!

    53. It’s a shame you don’t have a donate button! I’d most certainly donate to this brilliant
      blog! I guess for now i’ll settle for book-marking and adding your RSS feed to
      my Google account. I look forward to fresh updates and will talk about this website with my
      Facebook group. Talk soon!

    54. Howdy would you mind sharing which blog platform you’re working with?

      I’m going to start my own blog in the near
      future but I’m having a hard time selecting between BlogEngine/Wordpress/B2evolution and Drupal.
      The reason I ask is because your design seems different then most blogs and I’m looking for something unique.

      P.S My apologies for being off-topic but I had to ask!

    55. Usually I do not learn article on blogs, but I would like to
      say that this write-up very forced me to check out and do so!
      Your writing style has been amazed me. Thank you, quite great
      post.

    56. I think this is one of the most important info for
      me. And i am glad reading your article. But want to remark
      on few general things, The site style is ideal, the articles is really excellent :
      D. Good job, cheers

    57. Howdy! This article couldn’t be written any better! Going
      through this post reminds me of my previous roommate!
      He continually kept preaching about this. I will forward
      this information to him. Pretty sure he’ll have a very
      good read. Many thanks for sharing!

    58. It’s going to be finish of mine day, except before finish I am reading this wonderful piece of writing to improve my experience.

    59. Hello I am so glad I found your site, I really
      found you by accident, while I was browsing on Aol for something else, Anyhow
      I am here now and would just like to say cheers for a remarkable post and a all round enjoyable blog (I also love the theme/design), I don’t have
      time to look over it all at the minute but I have bookmarked it and also added
      your RSS feeds, so when I have time I will be back
      to read a lot more, Please do keep up the awesome jo.

    60. Hello there! I know this is kinda off topic but I was wondering which blog
      platform are you using for this site? I’m getting tired of WordPress because I’ve had problems with hackers and I’m
      looking at alternatives for another platform. I would be great if you could point me in the direction of a good platform.

    61. Howdy I am so delighted I found your website, I really
      found you by accident, while I was browsing on Google for something else,
      Anyhow I am here now and would just like to say cheers for a marvelous post and a all round enjoyable blog (I
      also love the theme/design), I don’t have time to
      browse it all at the moment but I have book-marked it
      and also added in your RSS feeds, so when I have time I will
      be back to read much more, Please do keep up the superb
      b.

    62. Wonderful web site. A lot of helpful information here.
      I’m sending it to a few friends ans additionally sharing
      in delicious. And of course, thank you on your effort!

    63. Hello there, I found your web site via Google even as looking for a similar topic, your website got here up,
      it seems to be good. I have bookmarked it in my google bookmarks.

      Hi there, simply become alert to your blog via Google,
      and found that it’s really informative. I’m going to be
      careful for brussels. I will be grateful if you happen to proceed
      this in future. Many people will probably be benefited from your
      writing. Cheers!

    64. Aw, this was an exceptionally good post. Taking
      the time and actual effort to generate a very good article… but what can I say…
      I put things off a lot and never manage to get anything
      done.

    65. Attractive section of content. I just stumbled upon your
      website and in accession capital to assert that I acquire
      actually enjoyed account your blog posts. Anyway I
      will be subscribing to your augment and even I achievement you access
      consistently quickly.

    66. I’m impressed, I must say. Rarely do I come across a blog that’s equally
      educative and interesting, and let me tell you, you have hit the nail on the head.
      The issue is something which too few people are speaking intelligently about.
      I am very happy that I came across this during my search for something
      concerning this.

    67. Hello, i think that i saw you visited my web site so i came to “return the favor”.I’m trying to find things to
      improve my site!I suppose its ok to use some
      of your ideas!!

    68. It’s appropriate time to make some plans for the future and it’s
      time to be happy. I’ve read this post and if I could I desire to
      suggest you few interesting things or tips. Maybe you can write next articles referring to this article.
      I desire to read even more things about it!

    69. Greetings from Los angeles! I’m bored at work so I decided to browse your blog on my iphone during lunch break.
      I really like the knowledge you provide here and can’t
      wait to take a look when I get home. I’m amazed at how
      quick your blog loaded on my phone .. I’m not even using WIFI, just 3G ..
      Anyhow, great blog!

    Leave a Reply

    Your email address will not be published.