All That Glitters Is Not Gold: On the Effectiveness of Cyber Security Qualifications

William Knowles; Jose Such; Antonios Gouglidis; Gaurav Misra; Awais Rashid

All That Glitters Is Not Gold: On the Effectiveness of Cyber Security Qualifications

William Knowles, Jose Such, Antonios Gouglidis, Gaurav Misra, Awais Rashid

Lancaster University

Research output: Contribution to journal › Article › peer-review

172 Downloads (Pure)

Abstract

There has been a proliferation of industry-focused cyber security qualifications, which use different techniques to assess the competencies of cyber security professionals and certify them to employers. There is, however, a lingering question about these qualifications: do they effectively assess the competencies of cyber security professionals?

74 cyber security qualifications were analysed to determine how competency assessment is performed in practice, and five distinct techniques were identified together with the frequency of their use within qualifications. These techniques formed the basis of a large-scale survey of the perceptions of 153 industry stakeholders on the effectiveness of individual techniques and their cost-effectiveness as combinations. Despite a perceived low effectiveness of Multiple Choice Examinations,
industry qualifications were found to rely on it heavily, often as a sole technique, and few qualifications utilised the cost-effective combinations identified by stakeholders.

Original language	English
Journal	COMPUTER
Publication status	Accepted/In press - 1 Apr 2017

Access to Document

All That Glitters Is_KNOWLES_Accepted1April2017_GOLD AAM (CC BY)Accepted author manuscript, 404 KBLicence: CC BY

Cite this

@article{58ea5c9419674d93a61a306983b393c3,

title = "All That Glitters Is Not Gold: On the Effectiveness of Cyber Security Qualifications",

abstract = "There has been a proliferation of industry-focused cyber security qualifications, which use different techniques to assess the competencies of cyber security professionals and certify them to employers. There is, however, a lingering question about these qualifications: do they effectively assess the competencies of cyber security professionals? 74 cyber security qualifications were analysed to determine how competency assessment is performed in practice, and five distinct techniques were identified together with the frequency of their use within qualifications. These techniques formed the basis of a large-scale survey of the perceptions of 153 industry stakeholders on the effectiveness of individual techniques and their cost-effectiveness as combinations. Despite a perceived low effectiveness of Multiple Choice Examinations,industry qualifications were found to rely on it heavily, often as a sole technique, and few qualifications utilised the cost-effective combinations identified by stakeholders.",

author = "William Knowles and Jose Such and Antonios Gouglidis and Gaurav Misra and Awais Rashid",

year = "2017",

month = apr,

day = "1",

language = "English",

journal = "COMPUTER",

issn = "0018-9162",

publisher = "IEEE Computer Society",

}

TY - JOUR

T1 - All That Glitters Is Not Gold: On the Effectiveness of Cyber Security Qualifications

AU - Knowles, William

AU - Such, Jose

AU - Gouglidis, Antonios

AU - Misra, Gaurav

AU - Rashid, Awais

PY - 2017/4/1

Y1 - 2017/4/1

N2 - There has been a proliferation of industry-focused cyber security qualifications, which use different techniques to assess the competencies of cyber security professionals and certify them to employers. There is, however, a lingering question about these qualifications: do they effectively assess the competencies of cyber security professionals? 74 cyber security qualifications were analysed to determine how competency assessment is performed in practice, and five distinct techniques were identified together with the frequency of their use within qualifications. These techniques formed the basis of a large-scale survey of the perceptions of 153 industry stakeholders on the effectiveness of individual techniques and their cost-effectiveness as combinations. Despite a perceived low effectiveness of Multiple Choice Examinations,industry qualifications were found to rely on it heavily, often as a sole technique, and few qualifications utilised the cost-effective combinations identified by stakeholders.

AB - There has been a proliferation of industry-focused cyber security qualifications, which use different techniques to assess the competencies of cyber security professionals and certify them to employers. There is, however, a lingering question about these qualifications: do they effectively assess the competencies of cyber security professionals? 74 cyber security qualifications were analysed to determine how competency assessment is performed in practice, and five distinct techniques were identified together with the frequency of their use within qualifications. These techniques formed the basis of a large-scale survey of the perceptions of 153 industry stakeholders on the effectiveness of individual techniques and their cost-effectiveness as combinations. Despite a perceived low effectiveness of Multiple Choice Examinations,industry qualifications were found to rely on it heavily, often as a sole technique, and few qualifications utilised the cost-effective combinations identified by stakeholders.

M3 - Article

SN - 0018-9162

JO - COMPUTER

JF - COMPUTER

ER -

All That Glitters Is Not Gold: On the Effectiveness of Cyber Security Qualifications

Abstract

Access to Document

Fingerprint

Cite this