Objective To construct an evaluation index system for the Field Epidemiology Training Program (FETP) that adapts to the "learning while doing" training model and has a long training cycle, thereby providing a measurement tool for targeted training implementation and improvement of training effectiveness.

Methods A preliminary quality evaluation index system for the FETP was established through literature review with the Kirkpatrick model and CIPP model as theoretical frameworks. Two rounds of Delphi expert consultation were conducted among 43 experts engaged in relevant fields. Indexes were screened based on scores for rationality, importance, and operability, and the weight of each index was calculated.

Results The expert positive coefficient (100.00% vs. 93.02%) and expert authority coefficient (0.886 vs. 0.849) in the second round were higher than those in the first round. The concordance coefficients of rationality, importance, and operability of expert opinions were 0.118, 0.127, and 0.089 in the first round (P < 0.05) and 0.179, 0.189, and 0.163 in the second round (P < 0.01), respectively, indicating good concordance of expert opinions. After screening, the final index system for evaluation of FETP quality consisted of 3 first-level indexes, 8 second-level indexes, and 50 third-level indexes. The coefficients of variation (CV) of the third-level indexes for rationality, importance, and operability were 0.07–0.22, 0.06–0.22, and 0.09–0.20, respectively. The normalized weights of the first-level, second-level, and third-level indexes were within the ranges of 0.319–0.351, 0.101–0.151, and 0.009–0.026, respectively.

Conclusions The constructed index system for the FETP quality evaluation demonstrates good scientificity and reliability. While balancing training process management and effectiveness evaluation, the system comprehensively considers the importance of training needs, providing measurement contents and quantitative basis for the quality assessment of program implementation.