Objective To develop a conceptual framework and a system of indicators for evaluating the effectiveness of basic public health services projects, and to provide scientific approaches and tools for such evaluations.

Methods Guided by the health output, and considering the characteristics of public health services and the content of China′s basic public health service projects, as well as relevant theoretical models, we elaborated on the basic dimensions of evaluating the effectiveness of basic public health service projects and constructed a conceptual framework based on the elaboration between 2021 and 2022. Through in-depth individual interviews, Delphi expert consultations, and expert panels, an indicator system for evaluating the effectiveness of a basic public health services project was developed and the weights of the indicators were determined using the analytical hierarchy process.

Results The conceptual framework developed to evaluate the effectiveness of China′s basic public health projects includes five aspects: improving population health literacy, improving health status, reducing environmental risk factors, innovating and improving related health policies and systems, and increasing supply and demand satisfaction. The results of the expert consultation showed that the Delphi experts′ familiarity coefficient was 0.92, the judgment coefficient was 0.88, and the authority coefficient was 0.9. Ultimately, the study created an indicator system for evaluating the effectiveness of basic public health projects that includes 5 primary dimensions, 18 secondary indicators, and 52 tertiary indicators. Data relevant to the indicators could be collected through health information monitoring systems and online surveys. Regarding the weights of the primary dimensions, the highest weight was assigned to health status (0.448 2), followed by health literacy (0.205 8).

Conclusion The conceptual framework and indicator system for evaluating basic public health service projects constructed in this study emphasize a value-oriented approach to health outcomes with high accuracy and reliability. This system fully utilizes available health information monitoring data, demonstrates good operability, and comprehensively covers evaluation contents, positioning it as a scientific tool for evaluating the effectiveness of basic public health service projects.