Relevance of motion-related assessment metrics in laparoscopic surgery

Ignacio Oropesa; Magdalena K Chmarra; Patricia Sánchez-González; Pablo Lamata de la Orden; Sharon P Rodrigues; Silvia Enciso; Francisco M Sánchez-Margallo; Frank-Willem Jansen; Jenny Dankelman; Enrique J Gómez

doi:10.1177/1553350612459808

Relevance of motion-related assessment metrics in laparoscopic surgery

Ignacio Oropesa, Magdalena K Chmarra, Patricia Sánchez-González, Pablo Lamata de la Orden, Sharon P Rodrigues, Silvia Enciso, Francisco M Sánchez-Margallo, Frank-Willem Jansen, Jenny Dankelman, Enrique J Gómez

Biomedical Engineering Department

Research output: Contribution to journal › Article › peer-review

39 Citations (Scopus)

Abstract

INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills and their correlation with the different abilities sought to measure.

METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, 3 novel tasks for surgical assessment were designed. Face and construct validation was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents, and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed.

RESULTS: Time, path length, and depth showed construct validity for all 3 tasks. Motion smoothness and idle time also showed validity for tasks involving bimanual coordination and tasks requiring a more tactical approach, respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed.

CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.

Original language	English
Pages (from-to)	299-312
Number of pages	14
Journal	Surgical Innovation
Volume	20
Issue number	3
DOIs	https://doi.org/10.1177/1553350612459808
Publication status	Published - Jun 2013

Keywords

Educational Measurement
Humans
Laparoscopy
Movement
Psychomotor Performance
Reproducibility of Results
Statistics, Nonparametric
Task Performance and Analysis

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1177/1553350612459808

Cite this

@article{42e4fdfbba284047bb79ce27a1d3407c,

title = "Relevance of motion-related assessment metrics in laparoscopic surgery",

abstract = "INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills and their correlation with the different abilities sought to measure.METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, 3 novel tasks for surgical assessment were designed. Face and construct validation was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents, and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed.RESULTS: Time, path length, and depth showed construct validity for all 3 tasks. Motion smoothness and idle time also showed validity for tasks involving bimanual coordination and tasks requiring a more tactical approach, respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed.CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.",

keywords = "Educational Measurement, Humans, Laparoscopy, Movement, Psychomotor Performance, Reproducibility of Results, Statistics, Nonparametric, Task Performance and Analysis",

author = "Ignacio Oropesa and Chmarra, {Magdalena K} and Patricia S{\'a}nchez-Gonz{\'a}lez and {Lamata de la Orden}, Pablo and Rodrigues, {Sharon P} and Silvia Enciso and S{\'a}nchez-Margallo, {Francisco M} and Frank-Willem Jansen and Jenny Dankelman and G{\'o}mez, {Enrique J}",

year = "2013",

month = jun,

doi = "10.1177/1553350612459808",

language = "English",

volume = "20",

pages = "299--312",

journal = "Surgical Innovation",

issn = "1553-3506",

publisher = "SAGE Publications Inc.",

number = "3",

}

TY - JOUR

T1 - Relevance of motion-related assessment metrics in laparoscopic surgery

AU - Oropesa, Ignacio

AU - Chmarra, Magdalena K

AU - Sánchez-González, Patricia

AU - Lamata de la Orden, Pablo

AU - Rodrigues, Sharon P

AU - Enciso, Silvia

AU - Sánchez-Margallo, Francisco M

AU - Jansen, Frank-Willem

AU - Dankelman, Jenny

AU - Gómez, Enrique J

PY - 2013/6

Y1 - 2013/6

N2 - INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills and their correlation with the different abilities sought to measure.METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, 3 novel tasks for surgical assessment were designed. Face and construct validation was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents, and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed.RESULTS: Time, path length, and depth showed construct validity for all 3 tasks. Motion smoothness and idle time also showed validity for tasks involving bimanual coordination and tasks requiring a more tactical approach, respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed.CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.

AB - INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills and their correlation with the different abilities sought to measure.METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, 3 novel tasks for surgical assessment were designed. Face and construct validation was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents, and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed.RESULTS: Time, path length, and depth showed construct validity for all 3 tasks. Motion smoothness and idle time also showed validity for tasks involving bimanual coordination and tasks requiring a more tactical approach, respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed.CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.

KW - Educational Measurement

KW - Humans

KW - Laparoscopy

KW - Movement

KW - Psychomotor Performance

KW - Reproducibility of Results

KW - Statistics, Nonparametric

KW - Task Performance and Analysis

U2 - 10.1177/1553350612459808

DO - 10.1177/1553350612459808

M3 - Article

C2 - 22983805

SN - 1553-3506

VL - 20

SP - 299

EP - 312

JO - Surgical Innovation

JF - Surgical Innovation

IS - 3

ER -

Relevance of motion-related assessment metrics in laparoscopic surgery

Abstract

Keywords

UN SDGs

Access to Document

Fingerprint

Cite this