TABLE III

Use Step Assessment Criteria

AssessmentDefinition
Successful with No Issues (S)The participant was able to complete the task successfully per the evaluation criteria.
Use EventParticipant action or lack of action did not meet the evaluation criteria for the task. Use events were classified as either I or R.
Incomplete/Incorrect (I)The participant did not complete the task as intended.
Resolved (R)The participant struggled, described difficulty, or encountered a close call such as taking or describing some action that would have otherwise resulted in incomplete/incorrect use. The resolved use events were assigned to either OD or CC upon root cause analysis.
Operational Difficulty (OD)The participant was able to complete the task safely and effectively but had significant hesitation or challenges while completing the task.
Close Call (CC)The participant had difficulty or took an action that could have resulted in harm but took additional action to recover and prevent the potential harm from occurring (i.e., “near miss”).
Study Artifact (SA)The participant experienced a use error in the simulated use study that would not occur in real practice. Study artifacts were removed from overall task performance totals and summarized separately.
Not Assessed (NA)The participant was unable to complete the task because of a previous usability issue that rendered it impossible to perform the task. Performance that was scored as not assessed was removed from overall task performance totals and summarized separately.