Assessment of changes in gaze patterns during training in point-of-care ultrasound

Alice H Y Chan; Wei Feng Lee; Pascal W M Van Gerven; Jordan Chenkin

doi:10.1186/s12909-022-03680-5

Assessment of changes in gaze patterns during training in point-of-care ultrasound

Alice H Y Chan^*, Wei Feng Lee, Pascal W M Van Gerven, Jordan Chenkin

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

BACKGROUND: Point-of-care ultrasound (POCUS) is a core skill in emergency medicine (EM), however, there is a lack of objective competency measures. Eye-tracking technology is a potentially useful assessment tool, as gaze patterns can reliably discriminate between experts and novices across medical specialties. We aim to determine if gaze metrics change in an independent and predictable manner during ultrasound training.

METHODS: A convenience sample of first-year residents from a single academic emergency department was recruited. Participants interpreted 16 ultrasound videos of the focused assessment with sonography for trauma (FAST) scan while their gaze patterns were recorded using a commercially available eye-tracking device. The intervention group then completed an introductory ultrasound course whereas the control group received no additional education. The gaze assessment was subsequently repeated. The primary outcome was total gaze duration on the area of interest (AOI). Secondary outcomes included time to fixation, mean duration of first fixation and mean number of fixations on the AOI.

RESULTS: 10 EM residents in the intervention group and 10 non-EM residents in the control group completed the study. After training, there was an 8.8 s increase in the total gaze time on the AOI in the intervention group compared to a 4.0 s decrease in the control group (p = .03). EM residents were also 3.8 s quicker to fixate on the AOI whereas the control group became 2.5 s slower (p = .04). There were no significant interactions on the number of fixations (0.43 vs. 0.18, p = .65) or duration of first fixation on the AOI (0.02 s vs. 0.06 s, p = .63).

CONCLUSIONS: There are significant and quantifiable changes in gaze metrics, which occur with incremental learning after an ultrasound course. Further research is needed to validate the serial use of eye-tracking technology in following a learner's progress toward competency in point-of-care ultrasound image interpretation.

Original language	English
Article number	658
Number of pages	7
Journal	BMC Medical Education
Volume	22
Issue number	1
DOIs	https://doi.org/10.1186/s12909-022-03680-5
Publication status	Published - 2 Sept 2022

Access to Document

10.1186/s12909-022-03680-5Licence: CC BY

Cite this

@article{9147fa238f1248a795391dc9e60514f7,

title = "Assessment of changes in gaze patterns during training in point-of-care ultrasound",

abstract = "BACKGROUND: Point-of-care ultrasound (POCUS) is a core skill in emergency medicine (EM), however, there is a lack of objective competency measures. Eye-tracking technology is a potentially useful assessment tool, as gaze patterns can reliably discriminate between experts and novices across medical specialties. We aim to determine if gaze metrics change in an independent and predictable manner during ultrasound training.METHODS: A convenience sample of first-year residents from a single academic emergency department was recruited. Participants interpreted 16 ultrasound videos of the focused assessment with sonography for trauma (FAST) scan while their gaze patterns were recorded using a commercially available eye-tracking device. The intervention group then completed an introductory ultrasound course whereas the control group received no additional education. The gaze assessment was subsequently repeated. The primary outcome was total gaze duration on the area of interest (AOI). Secondary outcomes included time to fixation, mean duration of first fixation and mean number of fixations on the AOI.RESULTS: 10 EM residents in the intervention group and 10 non-EM residents in the control group completed the study. After training, there was an 8.8 s increase in the total gaze time on the AOI in the intervention group compared to a 4.0 s decrease in the control group (p = .03). EM residents were also 3.8 s quicker to fixate on the AOI whereas the control group became 2.5 s slower (p = .04). There were no significant interactions on the number of fixations (0.43 vs. 0.18, p = .65) or duration of first fixation on the AOI (0.02 s vs. 0.06 s, p = .63).CONCLUSIONS: There are significant and quantifiable changes in gaze metrics, which occur with incremental learning after an ultrasound course. Further research is needed to validate the serial use of eye-tracking technology in following a learner's progress toward competency in point-of-care ultrasound image interpretation.",

author = "Chan, {Alice H Y} and Lee, {Wei Feng} and {Van Gerven}, {Pascal W M} and Jordan Chenkin",

note = "{\textcopyright} 2022. The Author(s).",

year = "2022",

month = sep,

day = "2",

doi = "10.1186/s12909-022-03680-5",

language = "English",

volume = "22",

journal = "BMC Medical Education",

issn = "1472-6920",

publisher = "BioMed Central Ltd",

number = "1",

}

TY - JOUR

T1 - Assessment of changes in gaze patterns during training in point-of-care ultrasound

AU - Chan, Alice H Y

AU - Lee, Wei Feng

AU - Van Gerven, Pascal W M

AU - Chenkin, Jordan

PY - 2022/9/2

Y1 - 2022/9/2

N2 - BACKGROUND: Point-of-care ultrasound (POCUS) is a core skill in emergency medicine (EM), however, there is a lack of objective competency measures. Eye-tracking technology is a potentially useful assessment tool, as gaze patterns can reliably discriminate between experts and novices across medical specialties. We aim to determine if gaze metrics change in an independent and predictable manner during ultrasound training.METHODS: A convenience sample of first-year residents from a single academic emergency department was recruited. Participants interpreted 16 ultrasound videos of the focused assessment with sonography for trauma (FAST) scan while their gaze patterns were recorded using a commercially available eye-tracking device. The intervention group then completed an introductory ultrasound course whereas the control group received no additional education. The gaze assessment was subsequently repeated. The primary outcome was total gaze duration on the area of interest (AOI). Secondary outcomes included time to fixation, mean duration of first fixation and mean number of fixations on the AOI.RESULTS: 10 EM residents in the intervention group and 10 non-EM residents in the control group completed the study. After training, there was an 8.8 s increase in the total gaze time on the AOI in the intervention group compared to a 4.0 s decrease in the control group (p = .03). EM residents were also 3.8 s quicker to fixate on the AOI whereas the control group became 2.5 s slower (p = .04). There were no significant interactions on the number of fixations (0.43 vs. 0.18, p = .65) or duration of first fixation on the AOI (0.02 s vs. 0.06 s, p = .63).CONCLUSIONS: There are significant and quantifiable changes in gaze metrics, which occur with incremental learning after an ultrasound course. Further research is needed to validate the serial use of eye-tracking technology in following a learner's progress toward competency in point-of-care ultrasound image interpretation.

AB - BACKGROUND: Point-of-care ultrasound (POCUS) is a core skill in emergency medicine (EM), however, there is a lack of objective competency measures. Eye-tracking technology is a potentially useful assessment tool, as gaze patterns can reliably discriminate between experts and novices across medical specialties. We aim to determine if gaze metrics change in an independent and predictable manner during ultrasound training.METHODS: A convenience sample of first-year residents from a single academic emergency department was recruited. Participants interpreted 16 ultrasound videos of the focused assessment with sonography for trauma (FAST) scan while their gaze patterns were recorded using a commercially available eye-tracking device. The intervention group then completed an introductory ultrasound course whereas the control group received no additional education. The gaze assessment was subsequently repeated. The primary outcome was total gaze duration on the area of interest (AOI). Secondary outcomes included time to fixation, mean duration of first fixation and mean number of fixations on the AOI.RESULTS: 10 EM residents in the intervention group and 10 non-EM residents in the control group completed the study. After training, there was an 8.8 s increase in the total gaze time on the AOI in the intervention group compared to a 4.0 s decrease in the control group (p = .03). EM residents were also 3.8 s quicker to fixate on the AOI whereas the control group became 2.5 s slower (p = .04). There were no significant interactions on the number of fixations (0.43 vs. 0.18, p = .65) or duration of first fixation on the AOI (0.02 s vs. 0.06 s, p = .63).CONCLUSIONS: There are significant and quantifiable changes in gaze metrics, which occur with incremental learning after an ultrasound course. Further research is needed to validate the serial use of eye-tracking technology in following a learner's progress toward competency in point-of-care ultrasound image interpretation.

U2 - 10.1186/s12909-022-03680-5

DO - 10.1186/s12909-022-03680-5

M3 - Article

C2 - 36056331

SN - 1472-6920

VL - 22

JO - BMC Medical Education

JF - BMC Medical Education

IS - 1

M1 - 658

ER -