prop_correct_multiple.RdThis function computes the proportion of correct responses per participant. Proportions can either be separated by condition or collapsed across conditions. This function extends prop_correct_free() to include multiple or randomized lists for participants.
prop_correct_multiple(
data,
responses,
key,
key.trial,
id,
id.trial,
cutoff = 0,
flag = FALSE,
group.by = NULL
)a dataframe of the variables you would like to return. Other variables will be included in the scored output and in the participant output if they are a one to one match with the participant id.
a column name in the dataframe that contains the participant answers for each item in quotes (i.e., "column")
a vector containing the scoring key or data column name. This column does not have to be included in the original dataframe.
a vector containing the trial numbers for each answer. Note: If you input long data (i.e., repeating trial-answer responses), we will take the unique combination of the responses. If a trial number is repeated, you will receive an error. Key and key.trial can also be a separate dataframe, depending on how your output data is formatted.
a column name containing participant ID numbers from the original dataframe.
a column name containing the trial numbers for the participant data from the original dataframe. Note that the free response "key" trial and this trial number should match. The trial key will be repeated for each answer a participant gave.
a numeric value that determines the criteria for scoring (i.e., 0 = strictest, 5 = is most lenient). The scoring criteria uses a Levenshtein distance measure to match participant responses to the answer key.
a logical argument if you want to flag participant scores that are outliers using z-scores away from the mean score for group
an optional argument that can be used to group the output by condition columns. These columns should be in the original dataframe and concatenated c() if there are multiple columns
The dataframe of the original response, answer, scoring, and any other or grouping variables. This dataframe can be used to determine if the cutoff score and scoring matched your answer key as intended. Distance measures are not perfect! Issues and suggestions for improvement are welcome.
A dataframe of the proportion correct by participant, which also includes optional z-scoring, grouping, and other variables.
A dataframe of the summary scores by any optional grouping variables, along with overall total proportion correct scoring.
Note: other columns included in the dataframe will be found in the final scored dataset. If these other columns are between subjects data, they will also be included in the participant dataset (i.e., there's a one to one match of participant ID and column information).
data("multi_data")
data("multi_answers")
DF_long <- arrange_data(data = multi_data,
responses = "Response",
sep = " ",
id = "Sub.ID",
repeated = "List.Number")
library(reshape)
multi_answers$position <- 1:nrow(multi_answers)
answer_long <- melt(multi_answers,
measured = colnames(multi_answers),
id = "position")
colnames(answer_long) <- c("position", "List.ID", "Answer")
answer_long$List.ID <- gsub(pattern = "List",
replacement = "",
x = answer_long$List.ID)
DF_long$response <- tolower(DF_long$response)
answer_long$Answer <- tolower(answer_long$Answer)
answer_long$Answer <- gsub(" ", "", answer_long$Answer)
scored_output <- prop_correct_multiple(data = DF_long,
responses = "response",
key = answer_long$Answer,
key.trial = answer_long$List.ID,
id = "Sub.ID",
id.trial = "List.Number",
cutoff = 1,
flag = TRUE)
head(scored_output$DF_Scored)
#> Responses position Sub.ID List.Number Answer Scored
#> 1 basil 8 5 1 basil 1
#> 2 basil 7 3 1 basil 1
#> 3 bayleaves 7 1 1 bayleaves 1
#> 4 bayleaves 8 3 1 bayleaves 1
#> 5 bayleaves 3 5 1 bayleaves 1
#> 6 celeryseed 1 5 1 celeryseed 1
head(scored_output$DF_Participant)
#> Sub.ID Proportion.Correct List.Number Z.Score.Participant
#> 1 1 0.30 1 -1.1547005
#> 2 3 0.45 1 0.5773503
#> 3 5 0.45 1 0.5773503
#> 4 1 0.45 2 -0.5773503
#> 5 3 0.45 2 -0.5773503
#> 6 5 0.55 2 1.1547005