Cross-validation of a learning climate instrument in a non-western postgraduate clinical environment

Jaime L. Pacifico; Cees P.M. Van Der Vleuten; Arno M.M. Muijtjens; Erlyn A. Sana; Sylvia Heeneman

doi:10.1186/s12909-018-1127-0

Cross-validation of a learning climate instrument in a non-western postgraduate clinical environment

Jaime L. Pacifico, Cees P.M. Van Der Vleuten, Arno M.M. Muijtjens, Erlyn A. Sana, Sylvia Heeneman

Research output: Contribution to journal › Article › peer-review

5 Citations (Scopus)

18 Downloads (Pure)

Abstract

Background: In postgraduate training, there is a need to continuously assess the learning and working conditions to optimize learning. Students or trainees respond to the learning climate as they perceive it. The Dutch Residency Educational Climate Test (D-RECT) is a learning climate measurement tool with well-substantiated validity. However, it was originally designed for Dutch postgraduate trainees and it remains to be shown whether extrapolation to non-Western settings is viable. The dual objective of this study was to revalidate D-RECT outside of a Western setting and to evaluate the factor structure of a recently revised version of the D-RECT containing 35 items.

Methods: We invited Filipino internal medicine residents from 96 hospitals to complete the revised 35-item D-RECT. Subsequently, we performed a confirmatory factor analysis to check the fit of the 9 scale model of the revised 35-item D-RECT. Inter-rater reliability was assessed using generalizability theory.

Results: Confirmatory factor analysis unveiled that the factor structure of the revised 35-item D-RECT provided a reasonable fit to the Filipino data, after removal of 7 items. Five to seven evaluations of individual residents were needed per scale to obtain a reliable result.

Conclusion: Even in a non-Western setting, the D-RECT exhibited psychometric validity. This study validated the factor structure of the revised 35-item D-RECT after some modifications. We recommend that its application be extended to other Asian countries and specialties.

Original language	English
Article number	22
Number of pages	7
Journal	BMC Medical Education
Volume	18
DOIs	https://doi.org/10.1186/s12909-018-1127-0
Publication status	Published - 25 Jan 2018
Externally published	Yes

Bibliographical note

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Keywords

Cross-cultural validation
Educational climate
Learning climate
Learning climate measurement tool
Postgraduate medical education

Access to Document

10.1186/s12909-018-1127-0Licence: CC BY

Published versionFinal published version, 367 KBLicence: CC BY

Cite this

@article{4cf22da3733a40c8b1e8cddae840a8d8,

title = "Cross-validation of a learning climate instrument in a non-western postgraduate clinical environment",

abstract = "Background: In postgraduate training, there is a need to continuously assess the learning and working conditions to optimize learning. Students or trainees respond to the learning climate as they perceive it. The Dutch Residency Educational Climate Test (D-RECT) is a learning climate measurement tool with well-substantiated validity. However, it was originally designed for Dutch postgraduate trainees and it remains to be shown whether extrapolation to non-Western settings is viable. The dual objective of this study was to revalidate D-RECT outside of a Western setting and to evaluate the factor structure of a recently revised version of the D-RECT containing 35 items. Methods: We invited Filipino internal medicine residents from 96 hospitals to complete the revised 35-item D-RECT. Subsequently, we performed a confirmatory factor analysis to check the fit of the 9 scale model of the revised 35-item D-RECT. Inter-rater reliability was assessed using generalizability theory. Results: Confirmatory factor analysis unveiled that the factor structure of the revised 35-item D-RECT provided a reasonable fit to the Filipino data, after removal of 7 items. Five to seven evaluations of individual residents were needed per scale to obtain a reliable result. Conclusion: Even in a non-Western setting, the D-RECT exhibited psychometric validity. This study validated the factor structure of the revised 35-item D-RECT after some modifications. We recommend that its application be extended to other Asian countries and specialties.",

keywords = "Cross-cultural validation, Educational climate, Learning climate, Learning climate measurement tool, Postgraduate medical education",

author = "Pacifico, {Jaime L.} and {Van Der Vleuten}, {Cees P.M.} and Muijtjens, {Arno M.M.} and Sana, {Erlyn A.} and Sylvia Heeneman",

note = "Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. ",

year = "2018",

month = jan,

day = "25",

doi = "10.1186/s12909-018-1127-0",

language = "English",

volume = "18",

journal = "BMC Medical Education",

issn = "1472-6920",

publisher = "BioMed Central Ltd.",

}

TY - JOUR

T1 - Cross-validation of a learning climate instrument in a non-western postgraduate clinical environment

AU - Pacifico, Jaime L.

AU - Van Der Vleuten, Cees P.M.

AU - Muijtjens, Arno M.M.

AU - Sana, Erlyn A.

AU - Heeneman, Sylvia

N1 - Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

PY - 2018/1/25

Y1 - 2018/1/25

N2 - Background: In postgraduate training, there is a need to continuously assess the learning and working conditions to optimize learning. Students or trainees respond to the learning climate as they perceive it. The Dutch Residency Educational Climate Test (D-RECT) is a learning climate measurement tool with well-substantiated validity. However, it was originally designed for Dutch postgraduate trainees and it remains to be shown whether extrapolation to non-Western settings is viable. The dual objective of this study was to revalidate D-RECT outside of a Western setting and to evaluate the factor structure of a recently revised version of the D-RECT containing 35 items. Methods: We invited Filipino internal medicine residents from 96 hospitals to complete the revised 35-item D-RECT. Subsequently, we performed a confirmatory factor analysis to check the fit of the 9 scale model of the revised 35-item D-RECT. Inter-rater reliability was assessed using generalizability theory. Results: Confirmatory factor analysis unveiled that the factor structure of the revised 35-item D-RECT provided a reasonable fit to the Filipino data, after removal of 7 items. Five to seven evaluations of individual residents were needed per scale to obtain a reliable result. Conclusion: Even in a non-Western setting, the D-RECT exhibited psychometric validity. This study validated the factor structure of the revised 35-item D-RECT after some modifications. We recommend that its application be extended to other Asian countries and specialties.

AB - Background: In postgraduate training, there is a need to continuously assess the learning and working conditions to optimize learning. Students or trainees respond to the learning climate as they perceive it. The Dutch Residency Educational Climate Test (D-RECT) is a learning climate measurement tool with well-substantiated validity. However, it was originally designed for Dutch postgraduate trainees and it remains to be shown whether extrapolation to non-Western settings is viable. The dual objective of this study was to revalidate D-RECT outside of a Western setting and to evaluate the factor structure of a recently revised version of the D-RECT containing 35 items. Methods: We invited Filipino internal medicine residents from 96 hospitals to complete the revised 35-item D-RECT. Subsequently, we performed a confirmatory factor analysis to check the fit of the 9 scale model of the revised 35-item D-RECT. Inter-rater reliability was assessed using generalizability theory. Results: Confirmatory factor analysis unveiled that the factor structure of the revised 35-item D-RECT provided a reasonable fit to the Filipino data, after removal of 7 items. Five to seven evaluations of individual residents were needed per scale to obtain a reliable result. Conclusion: Even in a non-Western setting, the D-RECT exhibited psychometric validity. This study validated the factor structure of the revised 35-item D-RECT after some modifications. We recommend that its application be extended to other Asian countries and specialties.

KW - Cross-cultural validation

KW - Educational climate

KW - Learning climate

KW - Learning climate measurement tool

KW - Postgraduate medical education

UR - http://www.scopus.com/inward/record.url?scp=85041585996&partnerID=8YFLogxK

U2 - 10.1186/s12909-018-1127-0

DO - 10.1186/s12909-018-1127-0

M3 - Article

C2 - 29370793

AN - SCOPUS:85041585996

SN - 1472-6920

VL - 18

JO - BMC Medical Education

JF - BMC Medical Education

M1 - 22

ER -

Cross-validation of a learning climate instrument in a non-western postgraduate clinical environment

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this