Initial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Review

Simple item page
dc.contributor.authorOffenberger, Spencer
dc.contributor.authorHerman, Geoffrey L.
dc.contributor.authorPeterson, Peter
dc.contributor.authorSherman, Alan T
dc.contributor.authorGolaszewski, Enis
dc.contributor.authorScheponik, Travis
dc.contributor.authorOliva, Linda
dc.date.accessioned2023-06-07T15:04:02Z
dc.date.available2023-06-07T15:04:02Z
dc.date.issued2020-03-12
dc.description2019 IEEE Frontiers in Education Conference (FIE), Covington, KY, USA, 16-19 October 2019en_US
dc.description.abstractWe analyze expert review and student performance data to evaluate the validity of the Cybersecurity Concept Inventory (CCI) for assessing student knowledge of core cybersecurity concepts after a first course on the topic. A panel of 12 experts in cybersecurity reviewed the CCI, and 142 students from six different institutions took the CCI as a pilot test. The panel reviewed each item of the CCI and the overwhelming majority rated every item as measuring appropriate cybersecurity knowledge. We administered the CCI to students taking a first cybersecurity course either online or proctored by the course instructor. We applied classical test theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring student knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of the expert review and the pilot test and provide recommendations for the continued improvement of the CCI.en_US
dc.description.sponsorshipThis work was supported in part by the U.S. Department of Defense under CAE-R grants H98230-15-1-0294, H98230-15-1-0273, H98230-17-1-0349, and H98230-17-1-0347; and by the National Science Foundation under SFS grant 1241576 and DGE grant 1820531.en_US
dc.description.urihttps://ieeexplore.ieee.org/document/9028652en_US
dc.format.extent9 pagesen_US
dc.genreconference papers and proceedingsen_US
dc.genrepreprintsen_US
dc.identifierdoi:10.13016/m2q36l-nhfl
dc.identifier.citationS. Offenberger et al., "Initial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Review," 2019 IEEE Frontiers in Education Conference (FIE), Covington, KY, USA, 2019, pp. 1-9, doi: 10.1109/FIE43999.2019.9028652.en_US
dc.identifier.urihttps://doi.org/10.1109/FIE43999.2019.9028652
dc.identifier.urihttp://hdl.handle.net/11603/28126
dc.language.isoen_USen_US
dc.publisherIEEEen_US
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department Collection
dc.relation.ispartofUMBC Education Department
dc.relation.ispartofUMBC Faculty Collection
dc.rights© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.en_US
dc.subjectUMBC Cyber Defense Laben_US
dc.titleInitial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Reviewen_US
dc.typeTexten_US
dcterms.creatorhttps://orcid.org/0000-0003-1130-4678en_US
dcterms.creatorhttps://orcid.org/0000-0003-0056-7819en_US

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
CCI-validation-FIE2019-final-6-22-19.pdf
Size:
284.88 KB
Format:
Adobe Portable Document Format
Description:
Download

License bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

UMBC Computer Science and Electrical Engineering Department
UMBC Education Department
UMBC Faculty Collection