The CATS Hackathon: Creating and Refining Test Items for Cybersecurity Concept Inventories
Links to Fileshttps://arxiv.org/pdf/1901.09286.pdf
MetadataShow full item record
Type of Work8 pages
journal articles preprints
RightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
Subjectscybersecurity assessment tools (CATS) project
cybersecurity concept inventory (CCI)
cybersecurity curriculum assessment (CCA)
standardized test design
For two days in February 2018, 17 cybersecurity educators and professionals from government and industry met in a "hackathon" to refine existing draft multiple-choice test items, and to create new ones, for a Cybersecurity Concept Inventory (CCI) and Cybersecurity Curriculum Assessment (CCA) being developed as part of the Cybersecurity Assessment Tools (CATS) Project. We report on the results of the CATS Hackathon, discussing the methods we used to develop test items, highlighting the evolution of a sample test item through this process, and offering suggestions to others who may wish to organize similar hackathons. Each test item embodies a scenario, question stem, and five answer choices. During the Hackathon, participants organized into teams to (1) Generate new scenarios and question stems, (2) Extend CCI items into CCA items, and generate new answer choices for new scenarios and stems, and (3) Review and refine draft CCA test items. The CATS Project provides rigorous evidence-based instruments for assessing and evaluating educational practices; these instruments can help identify pedagogies and content that are effective in teaching cybersecurity. The CCI measures how well students understand basic concepts in cybersecurity---especially adversarial thinking---after a first course in the field. The CCA measures how well students understand core concepts after completing a full cybersecurity curriculum
Showing items related by title, author, creator and subject.
Norris, Donald; Mateczun, Laura; Joshi, Anupam; Finin, Tim (2017-06-12)In this paper we examine data from the first ever nationwide survey of cybersecurity among American local governments. We are particularly interested in understanding the threats to local government cybersecurity, their ...
Thompson, Julia D.; Herman, Geoffrey L.; Scheponik, Travis; Oliva, Linda; Sherman, Alan; Golaszewski, Ennis; Phatak, Dhananjay (DigitalCommons@Kennesaw State University, 2018)We conducted an observational study to document student misconceptions about cybersecurity using thematic analysis of 25 think-aloud interviews. By understanding patterns in student misconceptions, we provide a basis for ...
Lal, Ravendar (2013-01-01)Cyber Security has been a big concern especially in past one decade where it is witnessed that targets ranging from large number of internet users to government agencies are being attacked because of vulnerabilities present ...