Developing the ForCAP Framework for Competency Assessment in Care Plan Formulation: A Delphi Study and Preliminary Psychometric Evaluation

Mohamad As’ad Efendy; Michael I. Aggari

doi:10.30994/jnp.v10i1.1289

Authors

Mohamad As’ad Efendy Faculty of Nursing, Universitas Strada Indonesia, Kediri, Indonesia https://orcid.org/0000-0003-2736-7593
Michael I. Aggari School of Nursing, Philippine Women’s University, Manila, Philippines

DOI:

https://doi.org/10.30994/jnp.v10i1.1289

Keywords:

Clinical competence, Delphi technique, Education, Nursing, Nursing Process, Psychometrics

Abstract

Background: Care plan formulation is a core nursing competency, but instruments that target it are limited, particularly in Indonesia.
Purpose: To develop the Framework for Competency Assessment in Care Plan Formulation (ForCAP), to examine expert consensus on its structure, and to obtain preliminary content-validity, reliability, and dimensionality evidence for an aligned student self-assessment questionnaire.
Methods: This sequential multiphase instrument-development study reviewed 16 competency frameworks (2010–2023), conducted a two-round modified Delphi with 15 purposively selected experts (acceptance: at least 70% rating 3 or 4), and had the same experts rate the content validity of a 32-item questionnaire, which was then piloted with 224 nursing students.
Results: The initial 57 elements were refined to 5 domains, 10 competencies, and 32 sub-competencies; all 42 final elements were accepted (Fleiss’ kappa 0.93). Item-level content validity ranged from 0.80 to 0.93 (scale-level 0.82–0.86). Total-score Cronbach’s alpha was 0.87 (95% CI 0.85–0.89); domain alphas were 0.46–0.68.
Conclusion: Experts endorsed the ForCAP structure, and the questionnaire total score has preliminary support. The faculty-rated rubric, proficiency anchors, and progression indicators remain provisional and need further validation.

Downloads

Download data is not yet available.

References

Adubi, I. O., Olaogun, A. A., & Adejumo, P. O. (2018). Effect of standardized nursing language continuing education programme on nurses’ documentation of care at University College Hospital, Ibadan. Nursing Open, 5(1), 37–44. https://doi.org/10.1002/nop2.108

Aldemir Atmaca, K., Hançer Tok, H., & Yıldız, E. (2025). Turkish adaptation of the student survey on writing nursing care plans: A validity and reliability study. BMC Nursing, 24(1). https://doi.org/10.1186/s12912-025-04037-1

Alkhelaiwi, W. A., Traynor, M., Rogers, K., & Wilson, I. (2024). Assessing the competence of nursing students in clinical practice: The clinical preceptors’ perspective. Healthcare, 12(10), 1031. https://doi.org/10.3390/healthcare12101031

American Association of Colleges of Nursing. (2021). The essentials: Core competencies for professional nursing education. Retrieved from https://www.aacnnursing.org/Portals/0/PDFs/Publications/Essentials-2021.pdf

Andrade, H. L. (2019). A critical review of research on student self-assessment. Frontiers in Education, 4, 87. https://doi.org/10.3389/feduc.2019.00087

Bae, J., Lee, J., Choi, M., Jang, Y., Park, C. G., & Lee, Y. J. (2023). Development of the clinical reasoning competency scale for nurses. BMC Nursing, 22, 138. https://doi.org/10.1186/s12912-023-01244-6

Ballantyne, H. (2016). Developing nursing care plans. Nursing Standard, 30(26), 51–57. https://doi.org/10.7748/ns.30.26.51.s47

Barrett, D., & Heale, R. (2020). What are Delphi studies? Evidence-Based Nursing, 23(3), 68–69. https://doi.org/10.1136/ebnurs-2020-103303

Benner, P. (1984). From novice to expert: Excellence and power in clinical nursing practice. Menlo Park, CA: Addison-Wesley.

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149

Bruner, J. S. (1966). Toward a theory of instruction. Cambridge, MA: Harvard University Press.

Cochran, W. G. (1977). Sampling techniques (3rd ed.). New York, NY: John Wiley & Sons.

Creswell, J. W., & Plano Clark, V. L. (2017). Designing and conducting mixed methods research (3rd ed.). Thousand Oaks, CA: SAGE Publications.

Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014). Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology, 67(4), 401–409. https://doi.org/10.1016/j.jclinepi.2013.12.002

Emmanuel, C. E., Blessing, O. J., & Paulina, A. A. (2024). Perception and utilization of standardized nursing languages among nurses in south-south Nigeria. International Journal of Nursing and Midwifery, 16(1), 1–8. https://doi.org/10.5897/ijnm2023.0536

Enebeli, E. C., Akpan-Idiok, P. A., & Chukwudozie, C. C. (2023). Nurses’ lived experiences in the utilization of standardized nursing languages in documentation of nursing care, in Cross River State, Nigeria. International Journal of Nursing Knowledge, 34(4), 276–283. https://doi.org/10.1111/2047-3095.12400

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378–382. https://doi.org/10.1037/h0031619

Fukada, M. (2018). Nursing competency: Definition, structure and development. Yonago Acta Medica, 61(1), 1–7. https://doi.org/10.33160/yam.2018.03.001

Gravina, E. W. (2017). Competency-based education and its effect on nursing education: A literature review. Teaching and Learning in Nursing, 12(2), 117–121. https://doi.org/10.1016/j.teln.2016.11.004

Gwet, K. L. (2008). Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology, 61(1), 29–48. https://doi.org/10.1348/000711006X126600

Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77–89. https://doi.org/10.1080/19312450709336664

Huang, S.-M., Fang, S.-C., Hung, C.-T., & Chen, Y.-H. (2022). Psychometric evaluation of a nursing competence assessment tool among nursing students: A development and validation study. BMC Medical Education, 22, 372. https://doi.org/10.1186/s12909-022-03439-y

Immonen, K., Oikarainen, A., Tomietto, M., Kääriäinen, M., Tuomikoski, A.-M., Kaučič, B. M., … Mikkonen, K. (2019). Assessment of nursing students’ competence in clinical practice: A systematic review of reviews. International Journal of Nursing Studies, 100, 103414. https://doi.org/10.1016/j.ijnurstu.2019.103414

Jünger, S., Payne, S. A., Brine, J., Radbruch, L., & Brearley, S. G. (2017). Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review. Palliative Medicine, 31(8), 684–706. https://doi.org/10.1177/0269216317690685

Koy, V., Yunibhand, J., Rauth, A., Bircher, N., Prak, M., & Henker, R. (2023). Development and psychometric testing of a competency of nursing process questionnaire. International Journal of Nursing Sciences, 10(2), 245–250. https://doi.org/10.1016/j.ijnss.2023.03.009

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

Lasater, K. (2007). Clinical judgment development: Using simulation to create an assessment rubric. Journal of Nursing Education, 46(11), 496–503. https://doi.org/10.3928/01484834-20071101-04

Lenburg, C. B. (1999). The framework, concepts and methods of the competency outcomes and performance assessment (COPA) model. OJIN: The Online Journal of Issues in Nursing, 4(2). https://doi.org/10.3912/OJIN.Vol4No02Man02

Lewis, L. S., Rebeschi, L. M., & Hunt, E. (2022). Nursing education practice update 2022: Competency-based education in nursing. SAGE Open Nursing, 8. https://doi.org/10.1177/23779608221140774

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385. https://doi.org/10.1097/00006199-198611000-00017

Murray, M., Sundin, D., & Cope, V. (2019). Benner’s model and Duchscher’s theory: Providing the framework for understanding new graduate nurses’ transition to practice. Nurse Education in Practice, 34, 199–203. https://doi.org/10.1016/j.nepr.2018.12.003

Nabizadeh-Gharghozar, Z., Alavi, N. M., & Ajorpaz, N. M. (2021). Clinical competence in nursing: A hybrid concept analysis. Nurse Education Today, 97, 104728. https://doi.org/10.1016/j.nedt.2020.104728

Naryati, N., Hadi, M., Agung, R. N., & Fajarini, M. (2025). Challenges in clinical training for professional nurse students: A qualitative study. Jurnal Keperawatan Padjadjaran, 13(3), 281–292. https://doi.org/10.24198/jkp.v13i3.2700

Nasa, P., Jain, R., & Juneja, D. (2021). Delphi methodology in healthcare research: How to decide its appropriateness. World Journal of Methodology, 11(4), 116–129. https://doi.org/10.5662/wjm.v11.i4.116

Niederberger, M., & Spranger, J. (2020). Delphi technique in health sciences: A map. Frontiers in Public Health, 8, 457. https://doi.org/10.3389/fpubh.2020.00457

O’Cathain, A., Murphy, E., & Nicholl, J. (2008). The quality of mixed methods studies in health services research. Journal of Health Services Research & Policy, 13(2), 92–98. https://doi.org/10.1258/jhsrp.2007.007074

Pang, W. I. P., & Yuan, H. (2026). Development and content validation of a comprehensive nursing care assessment rubric (CNAR) in simulation. Teaching and Learning in Nursing. https://doi.org/10.1016/j.teln.2026.06.011

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147

Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199

PPNI. (2016). Standar diagnosis keperawatan Indonesia: Definisi dan indikator diagnostik (1st ed.). Jakarta, Indonesia: DPP PPNI.

PPNI. (2018a). Standar intervensi keperawatan Indonesia: Definisi dan tindakan keperawatan (1st ed.). Jakarta, Indonesia: DPP PPNI.

PPNI. (2018b). Standar luaran keperawatan Indonesia: Definisi dan kriteria hasil keperawatan (1st ed.). Jakarta, Indonesia: DPP PPNI.

Ramazanzadeh, N., Ghahramanian, A., Zamanzadeh, V., Onyeka, T. C., Valizadeh, L., & Ghaffarifar, S. (2023). Translation, cross-cultural adaptation and evaluation of the Iranian Persian version of student survey on writing nursing care plan. Nursing Open, 10(8), 5476–5484. https://doi.org/10.1002/nop2.1786

Redman, R., Lenburg, C. B., & Walker, P. H. (1999). Competency assessment: Methods for development and implementation in nursing education. OJIN: The Online Journal of Issues in Nursing, 4(2). https://doi.org/10.3912/OJIN.Vol4No02Man03

Saifan, A., Devadas, B., Daradkeh, F., Abdel-Fattah, H., Aljabery, M., & Michael, L. M. (2021). Solutions to bridge the theory-practice gap in nursing education in the UAE: A qualitative study. BMC Medical Education, 21, 490. https://doi.org/10.1186/s12909-021-02919-x

Salvador, J. T., Alqahtani, F. M., Sauce, B. R. J., Alvarez, M. O. C., Rosario, A. B., Reyes, L. D. V., Mohamed, E. R., Awadh, L. A., Sanchez, K. K. B., Alzaid, M., Agman, D. D., & Schonewille, M. A. P. (2022). Development of student survey on writing nursing care plan: An exploratory sequential mixed-methods study. Journal of Nursing Management, 30(5). https://doi.org/10.1111/jonm.12996

Sanchez, C. L. (2019). Nursing care plan: An evidence-based tool for learning and providing high-quality care. Journal of Nursing Education and Practice, 9(6), 1–7. https://doi.org/10.5430/jnep.v9n6p1

Senarathne, H. S., & Meegoda, M. (2021). Comparative analysis of cultural competence of senior and junior nursing students. Sri Lanka Journal of Health Research, 1(1), 14–19. https://doi.org/10.4038/sljhr.v1i1.28

Šerková, D., & Marečková, J. (2018). Creation and validation of Q-DIO, an instrument for rating the quality of nursing documentation – literature review. Central European Journal of Nursing and Midwifery, 9(1), 799–810. https://doi.org/10.15452/CEJNM.2018.09.0007

Silva, M. B. da, Engelman, B., Figueiredo, M. S., & Almeida, M. de A. (2022). Standardized nursing languages in orthopedics from the perspective of the nursing role effectiveness model. Revista Gaúcha de Enfermagem, 43. https://doi.org/10.1590/1983-1447.2022.20210321.en

Somantri, I., Sekarwana, N., Mediawati, A. S., Ramoo, V., Yahaya, N. A., & Yudianto, K. (2021). Analysis of standardized nursing languages application in the context of nursing diagnosis in hospital in Indonesia. Open Access Macedonian Journal of Medical Sciences, 9(T6), 173–178. https://doi.org/10.3889/oamjms.2021.7307

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2

Watson, J. (1985). Nursing: The philosophy and science of caring. Boulder, CO: University Press of Colorado.

Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6

Zhang, T., Wu, X., Peng, G., Zhang, Q., Chen, L., Cai, Z., & Ou, H. (2021). Effectiveness of standardized nursing terminologies for nursing practice and healthcare outcomes: A systematic review. International Journal of Nursing Knowledge, 32(4), 220–228. https://doi.org/10.1111/2047-3095.12315