NOTES: * Represents a wildcard on Question Type (SK, UK, UB, or TOT), suggesting variable exists for one or more question type % Represents a wildcard on the item type (See appendix), suggesting variable exists for more than one item DESIGN VARIALBES (COLUMN/VARIABLES 1-4) EXPERIMENT Contains experiment number (Values: ‘1a’, ‘1b’, ‘2’) EXP.CONTRAST.CODE Contrast code for experiment 1a/b vs. 2 comparisons ELICITATION.ORDER IDEA Elicitation Order Assignment (Values: 0 = ‘Best First’, 1 = ‘Best Last’) LIST Describes participants list assignment DEMOGRAPHIC VARIABLES (COLUMN/VARIABLES 5-11) SUBJID Subject ID AGE Subject Age Demographic (Continuous numeric variable) SEX Subject Sex Demographic (VALUES = ‘Male’, ‘Female’, ‘Prefer not to say’, ‘’) CANADIAN.CITIZEN Subject’s Canadian Citizenship Status (VALUES: ‘YES’, ‘NO’) AMERICAN.CITIZEN Subject’s American Citizenship Status (VALUES: ‘YES’, ‘NO’) DUAL.CITIZEN Subject’s Dual Canadian-American Citizenship Status (VALUES: ‘YES’, ‘NO’) EFL.CHECK Subject’s Reported First Language INCLUSION CRITERIA AND ATTENTION CHECKS (COLUMN/VARIABLES 12-20) DURATION.CHECK Subject’s Time to Completion ATTENTION.CHECK.QUARTER Quarter attention check (VALUES: ‘’ = pass, ‘1’ = fail) ATTENTION.CHECK.ALPHA Alpha attention check (VALUES: ‘’ = pass, ‘1’ = fail) ATTENTION.CHECK.SPORTS Sports attention check (VALUES: ‘’ = pass, non empty = fail) DEMO.FAIL Demographic inclusion failure (VALUES: ‘’ = pass, ‘1’ = fail) AC.FAIL Attention check failure (VALUES: ‘’ = pass, ‘1’ = fail) RESP.FAIL Response failure (VALUES: ‘’ = pass, ‘1’ = fail) EXCLUSION.REASON Descriptive String variable describing reason for exclusion EXCLUSION.CODE Vector for excluded participants (0 = include, 1 = exclude) BEST ESTIMATE BY QUESTION TYPE VARIABLES (COLUMN/VARIABLES 21-24) MAE.* GMAE of question type COHERENCE SCORES (COLUMN/VARIABLES 25-29) PROP.LOW.LOWER Proportion of questions where low bound <= upper bound PROP.BEST.BETWEEN Proportion of questions where low bound <= best <= upper bound COHERENCE Sum of prior two columns EO.CODE Regression dummy code for ‘Elicitation Order’ condition (Values: 0 = ‘Best First’, 1 = ‘Best Last’) EO.COHERENCE.INTERACTION Interaction vector for Elicitation Order X Coherence CREDIBLE INTERVAL STATS BY QUESTION TYPE (COLUMN.VARIABLES 30-40) MEAN.*.CI.INT Average confidence in credible interval MEAN.*.CI.COR Proportion of credible intervals capturing correct answer MEAN.*.CI.RANGE Average range of credible interval STANDARDIZED INTERVAL STATS BY QUESTION TYPE (COLUMN.VARIABLES 41-49) MEAN.*.SI.COR Proportion of standardized 80% intervals capturing correct answer MEAN.*.SI.RANGE Average range of 80% standardized interval ***THE REST OF THE DATA FILE (COLUMN/VARIABLES 57-END) ARE ITEM LEVEL STATS FOR THE ABOVE!!!*** PARTICIPANT RESPONSES LIST A (COLUMN/VARIABLES 50-133) A.B.* Responses to behavioural survey (VALUES = ‘YES’ or ‘NO’) A.K.* Responses to the knowledge questions (VALUES = ‘CORRECT’ or ‘INCORRECT’) A.*.%.BEST Best probability estimate A.*.%.HIGH Highest probability estimate A.*.%.INT Confidence in credible interval A.*.%.LOW Lowest probability estimate PARTICIPANT RESPONSES LIST A (COLUMN/VARIABLES 134-218) B.B.* Responses to behavioural survey (VALUES = ‘YES’ or ‘NO’) B.K.* Responses to the knowledge questions (VALUES = ‘CORRECT’ or ‘INCORRECT’) B.*.%.BEST Best probability estimate B.*.%.HIGH Highest probability estimate B.*.%.INT Confidence in credible interval B.*.%.LOW Lowest probability estimate CORRECT RESPONSES (COLUMN/VARIABLES 218-253) CR.*.% Correct response for each question type and item PERFORMANCE MEASURES BY ITEM (COLUMN/VARIABLES 254-577) MAE.*.% MAE of item LOW.LOWER.*.% Low <= best for particular item (VALUES: 1 = TRUE, 0 = FALSE) BEST.BETWEEN.*.% Low <= best <= Upper for particular item (VALUES: 1 = TRUE, 0 = FALSE) A.*.%.CI.COR Does credible interval capture correct response (VALUES: 1 = TRUE, 0 = FALSE) B.*.%.CI.COR Does credible interval capture correct response (VALUES: 1 = TRUE, 0 = FALSE) A.*.%.CI.RANGE Average range of credible interval B.*.%.CI.RANGE Average range of credible interval A.*.%.80.HIGH Upper bound of standardized 80% interval A.*.%.80.LOW Lower bound of standardized 80% interval B.*.%.80.HIGH Upper bound of standardized 80% interval B.*.%.80.LOW Lower bound of standardized 80% interval A.*.%.SI.COR Does standard interval capture correct response (VALUES: 1 = TRUE, 0 = FALSE) B.*.%.SI.COR Does standard interval capture correct response (VALUES: 1 = TRUE, 0 = FALSE)