This prompt introduces the peer-reviewed article, “A rapid assessment methodology for the evaluation of primary care organization and performance in Brazil,” authored by James Macinko, Celia Almeida, and Paulo Klingelhoefer de Sá, published in Health Policy and Planning in 2007. This study presents a methodology for the rapid assessment of primary care services at the district level and examines its validity and potential utility, particularly in developing countries.
The research was conducted in Petrópolis, Brazil, a municipality chosen for its diverse population, early adoption of the Family Health Program (PSF), and local health secretariat’s receptiveness to evaluation. The study’s primary objective was to demonstrate the validity of the rapid assessment methodology by comparing user experiences in two types of primary care services: the newly developed Family Health Program (PSF) and traditional services. It also aimed to illustrate how managers and healthcare providers could use these methods for improving decision-making within an evolving health system.
Methodology Highlights:
- The study adapted a previously developed questionnaire, the Primary Care Assessment Tool (PCAT), which measures essential dimensions of primary care, including access, gatekeeping, longitudinality, comprehensiveness, coordination, family focus, and community orientation. An additional scale assessing provider skills and training was also included.
- The instrument was translated into Portuguese and adjusted to reflect Brazilian realities.
- 468 users were randomly selected from 40 primary care clinics (25 PSF and 15 traditional services) between January and February 2004.
- Responses were used to generate a composite ‘total primary care index’ and eight sub-indices, each corresponding to a primary care dimension.
- Psychometric properties were assessed through Cronbach’s alpha for internal consistency reliability and principal components factor analysis. The study also compared user assessments with earlier provider assessments.
Key Findings:
- Users of the new Family Health Program (PSF) clinics reported significantly higher overall assessments of the total primary care index compared to users of traditional services.
- Specifically, PSF clinics performed better on gatekeeping, comprehensiveness, family focus, and community orientation.
- The total primary care score demonstrated good internal consistency, with a Cronbach’s alpha of 0.80, and could be reduced to a single principal component, supporting its reliability and validity.
- User assessments of primary care services were predicted by self-rated health (Odds Ratio 1.72) and the specific clinic, but not by demographic or socio-economic characteristics of clients.
- While there was no significant difference in the total primary care index between user and provider assessments, they disagreed on two sub-indices: gatekeeping (users rated higher) and family focus (users rated lower).
- The study also revealed considerable variation in primary care experiences among clinics, even within the same service type, indicating opportunities for quality improvement initiatives.
Significance and Implications:
The study concludes that the presented methodology offers a rapid and valid means to gather information on clinic-level variation in primary care organization and performance at the district level. It highlights that the instrument is internally consistent, appears valid, and is not sensitive to demographic or socio-economic characteristics, making it potentially adaptable for use in other developing countries. The ability to compare user and provider perspectives also suggests that provider surveys could initially monitor general performance, with user surveys providing more detailed insights when needed. This tool is hoped to help fill the gap in validated rapid-assessment tools for measuring primary care performance in the developing world.
APA Reference:
Macinko, J., Almeida, C., & de Sá, P. K. (2007). A rapid assessment methodology for the evaluation of primary care organization and performance in Brazil. Health Policy and Planning, 22(3), 167-177.