Heuristica: An R package for testing models of binary choice
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)
CLASSIC HEURISTICS AND DATA SETS ALL IN ONE TIDY PACKAGE
It just got a lot easier to simulate the performance of simple heuristics.
Jean Czerlinski Whitmore, a software engineer at Google with a long history in modeling cognition, and Daniel Barkoczi, a postdoctoral fellow at the Max Planck Institute for Human Development, have created heuristica: an R package to model the performance of simple heuristics. It comprises the heuristics covered in the first chapters of Simple Heuristics That Make Us Smart such as Take The Best, Unit Weighted Linear model, and more. The package also includes data, such as the the original German cities data set which has become a benchmark for testing heuristic models of choice, cited in hundreds of papers.
A good place to start is the README vignette, as with vignettes:
- Comparing the performance of simple heuristics using the Heuristica R package
- How to make your own heuristic
- Reproducing Results (Take The Best vs. regression on city population)
Here’s the heuristica package’s home on CRAN and here’s a description of the package in the authors’ own words:
The heuristica R package implements heuristic decision models, such as Take The Best (TTB) and a unit-weighted linear model. The models are designed for two-alternative choice tasks, such as which of two schools has a higher drop-out rate. The package also wraps more well-known models like regression and logistic regression into the two-alternative choice framework so all these models can be assessed side-by-side. It provides functions to measure accuracy, such as an overall
percentCorrectand, for advanced users, some confusion matrix functions. These measures can be applied in-sample or out-of-sample.The goal is to make it easy to explore the range of conditions in which simple heuristics are better than more complex models. Optimizing is not always better!
I am perturbed when judgment problems are referred to as choice problems. The city population task is a judgment problem where pair comparisons are used to measure the judgments. Choices involve values. Judging which city is larger is based on positively correlated attributes whereas a choice (e.g., which city would one prefer to live in) is usually based on negatively correlated attributes. Failure to make this distinction confuses this literature.
August 3, 2016 @ 11:02 am
Noted. We use the term because the kinds of problems these heuristics deal with are called 2AFC or two-alternative forced choice problems. https://en.wikipedia.org/wiki/Two-alternative_forced_choice
August 3, 2016 @ 11:31 am
Gerg Gigerenzer and rapper Biggie Smalls have more than what you may think in common
https://youtu.be/CGKc5sI7H5U
September 1, 2016 @ 4:17 am