{"id":5978,"date":"2016-12-01T17:18:28","date_gmt":"2016-12-01T22:18:28","guid":{"rendered":"http:\/\/www.decisionsciencenews.com\/?p=5978"},"modified":"2016-12-20T10:20:24","modified_gmt":"2016-12-20T15:20:24","slug":"tools-methods-improve-decision-making-outcomes-information-communication","status":"publish","type":"post","link":"https:\/\/www.decisionsciencenews.com\/?p=5978","title":{"rendered":"Tools, methods to improve decision making, outcomes, information communication"},"content":{"rendered":"

HERE IS WHAT YOU CAME UP WITH<\/p>\n

\n\"tlbxs\"<\/a>
\n
The author’s daughter’s tool kit<\/em>\n<\/p>\n

A while back, Decision Science News put out a call on the Society for Judgment and Decision Making email list looking for “tools, methods to improve decision making, outcomes, and information communication \/ visualization”:<\/p>\n

I’m interested in learning about tools and methods people in this community have created to improve decision making, decision outcomes, and information communication \/ visualization. It would be good to have examples of things that are a) finished, codified b) tested for effectiveness. Bonus points if they are field tested and\/or tested for long-term retention<\/p>\n

This would include things like:
\n* Training programs incl. games, videos, procedures, tutorials
\n* Decision aids, calculators
\n* Elicitation techniques (e.g. SPIES, …)
\n* Changes in information format (e.g. frequency formats, …)
\n* Policies, procedures (e.g. Save More Tomorrow, …)
\n* Feats of choice architecture (e.g., reordering, ….)<\/p>\n

To make the resulting list more useful to the community, it might be wise to structure your submissions like this:<\/p>\n

Tool \/ method name:
\nOne sentence description:
\nOne sentence effectiveness test result:
\nRelevant cite(s):<\/p><\/blockquote>\n

Here are the responses we received. If you have more, put them in the comments, but please structure them as suggested above.<\/p>\n

####################
\nDISTRIBUTION BUILDERS<\/p>\n

These tools are similar to the Distribution Builder (*) tool for eliciting probability distributions
\n(*) Goldstein, Daniel G., Johnson, Eric J. & Sharpe, William F. (2008). Choosing outcomes versus choosing products: Consumer-focused retirement investment advice. Journal of Consumer Research, 35(3), 440-456.<\/p>\n

Quentin Andre\u2019s Javascript Distribution Builder: https:\/\/quentinandre.github.io\/DistributionBuilder<\/p>\n

Don Moore and Uriel Haran\u2019s SPIES elicitation tool: http:\/\/fbm.bgu.ac.il\/lab\/spies\/spies.html<\/p>\n

Charlie Strout\u2019s Javascript Distribution Builder: https:\/\/github.com\/sevenshadow\/DistributionBuilder<\/p>\n

####################
\nGALLONS PER MILE TOOL<\/p>\n

Rick Larrick and Jack Soll created an online GPM (gallons per mile) calculator to help people compare cars\/trade ins. http:\/\/gpmcalculator.com\/<\/p>\n

Cite:<\/p>\n

Larrick, R. P., & Soll, J. B. (2008). The MPG illusion. Science, 320(5883), 1593.<\/p>\n

####################
\nDECISION TIME LIMITS<\/p>\n

Ian Krajbich writes \u201cBy imposing per-decision time limits, we help people divert time from difficult unimportant decisions to easier important ones.\u201d<\/p>\n

Effectiveness test result: Time-constrained subjects achieve better objective outcomes (higher earnings) when they have per-decision time limits, compared to when they are left to allocate time to decisions on their own.<\/p>\n

Cite:
\nOud B, Krajbich I, Miller K, Cheong JH, Botvinick M, Fehr E. 2016 Irrational time allocation in decision-making. Proc. R. Soc. B 283: 20151439. http:\/\/dx.doi.org\/10.1098\/rspb.2015.1439<\/p>\n

####################
\nBALANCE BEAM AID FOR INSTRUCTION IN DIAGNOSIS<\/p>\n

Rob Hamm writes \u201cThe log odds formula for combining multiple independent diagnostic cues corresponds to the formula for combining the impact of equal weights (and helium balloons) placed at different positions on a balance beam. We constructed a demonstration for one medical diagnosis domain (acute chest pain).\u201d<\/p>\n

Effectiveness test result: The math works if we make the na\u00efve Bayesian assumption of independent impacts of different pieces of evidence. A small sample of medical students and faculty played with the program and found it reasonable.<\/p>\n

Cites:
\nHamm RM, Beasley WH, Johnson WJ. A balance beam aid for instruction in clinical diagnostic reasoning. Medical Decision Making 2014; 34(7):854-862 (doi: 10.1177\/ 0272989X14529623).
\nHamm RM, Beasley WH. The balance beam metaphor: A perspective on clinical diagnosis. Medical Decision Making 2014; 34(7):841-853 (doi: 10.1177\/0272989X14528755).<\/p>\n

####################
\nPACE-O-METER TO IMPROVE PEOPLE\u2019S ESTIMATIONS OF TIME-SAVINGS WHEN INCREASING SPEED<\/p>\n

Eyal Pe\u2019er writes: \u201cAn enhanced speedometer that presents, alongside regular speed information, the pace of minutes required to complete 10 miles\/km at given levels of speed (http:\/\/journal.sjdm.org\/12\/121007\/fig2.png)<\/p>\n

Effectiveness test result: When asked to estimate time saved when increasing speed (at various levels) participants who received the \u201cpaceometer\u201d were correct at an overall average rate of about 58% compared to less than 20% in the control conditions. In another study, similar results were found on driving behavior using a driving simulator.<\/p>\n

Cites:
\nPeer, E., & Gamliel, E. (2013). Pace yourself: Improving time-saving judgments when increasing activity speed. Judgment and Decision Making, 8(2), 106.
\nEriksson, G., Patten, C. J., Svenson, O., & Eriksson, L. (2015). Estimated time of arrival and debiasing the time saving bias. Ergonomics, 58(12), 1939-1946.<\/p>\n

####################
\nPROSTATE CANCER TREATMENT DECISION AID
\nMaarten Cuypers writes: \u201cOnline tool with risk communication and values clarification exercise to support treatment selection in (early) prostate cancer patients\u201d<\/p>\n

Effectiveness test result: More knowledge, more value congruent treatment choices, though lower information satisfaction.<\/p>\n

Cites:
\nCuypers, Maarten, Lamers, Romy, Kil, Paul, Poll-Franse, L. van de, & Vries, Marieke de (2015). Impact of a web-based treatment decision aid for early-stage prostate cancer on shared decision-making and health outcomes: Study protocol for a randomized controlled trial. Trials, 16(231)
\nLamers, R.E.D., Cuypers, M., Vries, M. de, Poll-Franse, L. van de, Bosch, J.L.H.R., & Kil, P.J.M. (2016). How do patients choose between active surveillance, radical prostatectomy and radiotherapy?: The effect of a preference sensitive decision aid on treatment decision making for localized prostate cancer. Urologic Oncology: Seminars and Original Investigations<\/p>\n

####################
\nSIMULATED EXPERIENCE<\/p>\n

Emre Soyer writes “A simulation based on a model (e.g., regression), which allows decision makers to enter their inputs and sequentially observe (also graph and\/or store) the estimated outcomes.”<\/p>\n

Effectiveness test result: In different contexts, participants related easily with the tool, trusted their simulated experience more than their own analyses based on descriptions, and made more accurate judgments about uncertainties.<\/p>\n

Cites:
\nHogarth, R. M., & Soyer, E. (Winter 2015). Simulated experience: Making intuitive sense of big data. MIT Sloan Management Review, p. 49-54. (sloanreview.mit.edu\/x\/56215)
\nHogarth R. M., & Soyer E. (2015). Communicating forecasts: The simplicity of simulated experience. Journal of Business Research, 68, 1800-1809
\nHogarth R. M., & Soyer E. (2015). Providing information for decision making: Contrasting description and simulation. Journal of Applied Research in Memory and Cognition, 4, 221-228.
\nHogarth R. M., Mukherjee, K., & Soyer, E. (2013). Assessing the chances of success: Na\u00efve statistics vs. kind experience. Journal of Experimental Psychology: Learning, Memory and Cognition, 39, 14-32.
\nHogarth, R. M., & Soyer, E. (2011). Sequentially simulated outcomes: Kind experience vs. non-transparent description. Journal of Experimental Psychology: General, 140, 3, 434-463.
\nM.A. Bradbury, T. Hens and S. Zeisberger, \u201cImproving Investment Decisions With Simulated Experience,\u201d Review of Finance, published online June 6, 2014.
\nC. Kaufmann, M. Weber and E. Haisley, \u201cThe Role of Experience Sampling and Graphical Displays on One\u2019s Investment Risk Appetite,\u201d Management Science 59, no.2 (February 2013): 323-340.
\nB.K. Hayes, B.R. Newell and G.E. Hawkins. \u201cCausal Model and Sampling Approaches to Reducing Base Rate Neglect,\u201d in \u201cProceedings of the 35th Annual Conference of the Cognitive Science Society,\u201d eds. M. Knauff, M. Pauen, N. Sebanz and I. Wachsmuth (Austin, Texas: Cognitive Science Society, 2013.)<\/p>\n

####################
\nA DIAGNOSTIC SUPPORT SYSTEM (PROTOTYPE) FOR FAMILY PHYSICIANS<\/p>\n

Olga Kostopoulou writes \u201cA diagnostic support tool that integrates with the patient\u2019s electronic health record, and presents physicians with diagnostic alternatives (according to patient age, sex, risk factors and current complaint) at the start of the consultation, BEFORE physicians elicit any further information from the patient.\u201d<\/p>\n

Effectiveness test result: Presenting family physicians with diagnostic alternatives early on, before eliciting any information themselves, increased diagnostic accuracy both in a study with computer-simulated patients, and in a study with standardised patients (actors).<\/p>\n

Cites:
\nKostopoulou O, Rosen A, Round T, Wright E, Douiri A, Delaney BC. Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients. British Journal of General Practice 2015 Jan; 65(630): e49-e54. http:\/\/dx.doi.org\/10.3399\/bjgp15X683161<\/p>\n

Kostopoulou O, Porat T, Corrigan D, Mahmoud S, Delaney BC. Supporting first impressions reduces diagnostic error: evidence from a high-fidelity simulation. British Journal of General Practice. In Press.<\/p>\n

Note: The tool is still at the prototype stage and has not been field-tested yet. It is based on an ontology of medical diagnostic concepts, and will be open source eventually.<\/p>\n

####################
\nANALOGICAL ENCODING<\/p>\n

Aba Szollosi writes \u201cWe tested whether analogical encoding can foster the transfer from learning abstract principles to improving behavioral performance on a range of decision biases.\u201d
\nEffectiveness test result: The method might be effective in eliminating biases on tasks where the violations of statistical principles are measured.<\/p>\n

Relevant cite(s): Aczel, B., Bago, B., Szollosi, A., Foldes, A., & Lukacs, B. (2015). Is it time for studying real-life debiasing? Evaluation of the effectiveness of an analogical intervention technique. Frontiers in psychology, 6:1120. doi: 10.3389\/fpsyg.2015.01120<\/p>\n

####################
\nCHEMDECIDE
\nRichard Hodgett writes about a tool he created to structure complex decision problems. ChemDecide is a suite of software tools which incorporates three Multi-Criteria Decision Analysis (MCDA) techniques: Analytical Hierarchy Process (AHP), Multi-Attribute Range Evaluations (MARE) and ELimination Et Choix Traduisant la REalit\u00e9 trois (ELECTRE III). The software has been used for addressing decisions such as route selection, equipment selection, resource allocation, financial budgeting and project prioritization.<\/p>\n

Cite: Hodgett, R. E., Martin, E. B., Montague, G., & Talford, M. (2014). Handling uncertain decisions in whole process design. Production Planning & Control, 25(12), 1028-1038.<\/p>\n","protected":false},"excerpt":{"rendered":"

A while back, Decision Science News put out a call to the Society for Judgment and Decision Making email list looking for “tools, methods to improve decision making, outcomes, and information communication”. Here are the results of that call.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[5,4,16,2],"tags":[655,52,1520,1518,859,82,203,1521,53,539,1519,1206,35,1207,1522],"class_list":["post-5978","post","type-post","status-publish","format-standard","hentry","category-articles","category-encyclopedia","category-ideas","category-research-news","tag-communication","tag-decision","tag-email","tag-improve","tag-information","tag-jdm","tag-judgment","tag-list","tag-making","tag-methods","tag-outcomes","tag-sjdm","tag-society","tag-tools","tag-tutors"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4LKj-1yq","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/posts\/5978","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5978"}],"version-history":[{"count":6,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/posts\/5978\/revisions"}],"predecessor-version":[{"id":6014,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=\/wp\/v2\/posts\/5978\/revisions\/6014"}],"wp:attachment":[{"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5978"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5978"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.decisionsciencenews.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5978"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}