Primary Care Tools: Enhancing Healthcare Quality and Accountability

Efforts to ensure healthcare organizations are accountable for the services they provide are increasingly important. The fundamental aim of any health service is to improve health outcomes, both through immediate care and long-term prevention. Services that do not contribute to this goal are becoming harder to justify. Therefore, assessing both the structure and processes within healthcare systems remains crucial. With growing evidence highlighting the significant role primary care plays in improving health outcomes, particularly in preventative care and chronic disease management (1), evaluating and assuring the quality of primary care delivery is paramount.

This is where Primary Care Tools come into play. These tools, most notably the Primary Care Assessment Tools (PCAT), have been developed to serve this exact purpose. The PCAT suite includes a range of surveys designed to gather comprehensive data from various perspectives within the healthcare ecosystem:

• Consumer-client surveys: To capture patient experiences and perceptions of primary care services.
• Facility surveys: To assess the resources and organizational structure of primary care facilities.
• Provider surveys: To understand provider perspectives on service delivery and practice characteristics.
• Health system survey (in development): A broader tool designed to evaluate primary care at a systemic level.

While the original PCAT manual was initially designed for research contexts, the core principles and methodologies are highly relevant for broader applications, particularly in evaluating and enhancing the quality of primary care delivery in diverse settings.

Understanding the Core Concept of Primary Care

Primary care possesses unique characteristics that distinguish it from other levels of healthcare. These characteristics are not focused on specific illnesses or problems but are person-focused, making primary care relevant to everyone, regardless of their current health status.

Crucially, primary care acts as the entry point and coordinating hub for specialized care. Experiences within primary care, therefore, reflect the broader effectiveness and patient journey through the entire healthcare system. By collecting baseline data and monitoring changes over time, healthcare systems and insurance providers can leverage primary care insights to ensure accountability and drive improvements in service delivery.

Primary care is now widely recognized as the bedrock of effective and efficient healthcare systems. Its key components are well-defined (2, 3) and include:

• First Contact Care: The role of primary care as the initial point of contact for new health needs.
• Person-Focused Care Over Time: Building ongoing relationships between patients and providers to ensure continuity of care.
• Comprehensiveness: Providing a wide range of services to address the majority of common health needs.
• Coordination: Integrating various health services to ensure seamless and holistic patient care.

These core components are further enriched by related aspects that emphasize patient-centeredness and community integration:

• Community Orientation: Tailoring care to the specific needs and context of the community served.
• Family-Centeredness: Recognizing the family’s role in patient care and decision-making.
• Cultural Competence: Delivering care that respects and integrates the cultural beliefs and practices of diverse populations.

This theoretical framework of primary care attributes underpins the development of tools designed to gather and analyze data on primary care services for both children and adults. These assessments focus on organizational resources and processes, identifying areas for improvement that can positively impact healthcare delivery outcomes (4). The PCAT instruments are specifically structured around these core primary care principles, ensuring that the data collected directly reflects the key dimensions of high-quality primary care.

An in-depth understanding of these concepts is essential to appreciate the purpose and significance of the questions included in primary care assessment tools. Primary care is fundamentally about providing continuous, person-centered care that is informed by an understanding of the patient’s family, community, and cultural background.

The provision of primary care is characterized by a specific set of attributes (5), which can be categorized into four main attributes and three related aspects:

• “First-Contact” Care: This attribute emphasizes primary care providers as the initial point of contact for most health concerns, excluding emergencies. The provider acts as the gateway to the healthcare system, offering direct care or guiding patients to appropriate specialist services when necessary. Effective first-contact care requires both accessibility (a structural element ensuring services are readily available) and utilization (a behavioral element reflecting patients’ tendency to seek primary care first for new health needs).

• Continuous (Ongoing) Care: This refers to the long-term relationship between a patient and their primary care provider, forming a healthcare “home.” This continuity is crucial for building trust, understanding patient history, and tailoring care over time. It necessitates a population registry (a structural element identifying the patient population served) and a person-focused relationship (a behavioral element emphasizing the ongoing provider-patient connection beyond episodic illness care).

• Coordinated Care: This involves the seamless integration of various healthcare services to address all of a patient’s health needs, both physical and mental. The core of coordination is the availability and utilization of patient information (both structural and behavioral elements) to ensure that current care decisions are informed by past and existing health issues and treatments (3).

• Comprehensive Care: This attribute highlights the breadth of services offered within primary care. It encompasses a wide range of services, from preventative care and health promotion to the management of acute and chronic conditions. Comprehensive primary care addresses the majority of common health needs, excluding only the most uncommon or highly specialized conditions. This includes services like prevention, health coaching, counseling, management of common illnesses and injuries, minor procedures, basic mental health services, and connections to community health resources.

Each of these four core domains is further broken down into two subdomains: a structure-related subdomain, which assesses the capacity to deliver the necessary services, and a behavior-related subdomain, which evaluates whether these services are actually provided when needed. This results in eight core subdomains applicable across different types of primary care tools, including surveys for adult and child consumers, providers, and facilities.

Building upon these core attributes, three additional aspects further define high-quality primary care:

• Family-Centered Care: Recognizes the integral role of the family in a patient’s health journey. It emphasizes family involvement in assessment, treatment, and decision-making, acknowledging the impact of family dynamics, history, and health on individual well-being.

• Community-Oriented Care: Contextualizes care within the broader community. Community-oriented primary care (COPC) goes beyond individual patient needs to address the health needs of the entire defined population. It focuses on unmet health needs within the community and the social determinants of health that influence community well-being.

• Culturally Competent Care: Ensures care is delivered with respect for individual beliefs, interpersonal styles, and cultural attitudes that influence health perceptions and behaviors. It requires providers to develop skills to translate cultural understanding into effective and appropriate healthcare practices.

The Evolution and Impact of Primary Care Assessment Tools

The evolution of healthcare delivery and organization has spurred significant advancements in primary care research and program development. The creation and refinement of primary care tools, particularly the PCAT, represent a direct response to the growing need to measure and improve primary care delivery within various healthcare systems. This initiative stemmed from a collaborative effort involving the U.S. Maternal and Child Health Bureau (MCHB), state and local MCH programs, the Henry J. Kaiser Family Foundation, the Child and Adolescent Health Policy Center (CAHPC), and the Primary Care Policy Center for the Underserved at the Johns Hopkins Bloomberg School of Public Health.

Historically, defining and measuring primary care effectiveness was a challenge (3, 5). Early definitions lacked the specificity needed for practical assessment. However, the focus shifted towards evaluating structural and process elements within healthcare systems as measurable indicators of primary care quality. Structural elements encompass factors like accessibility, range of services, defined patient populations, and continuity of care infrastructure. Process elements include service utilization patterns and the effectiveness of health problem recognition and management. The four core domains of primary care – first contact, continuity, comprehensiveness, and coordination – can all be effectively assessed by examining these structural (“capacity”) and process (“actions” or “behavior”) elements.

Primary care assessment tools like PCAT are specifically designed to measure the attainment of these primary care attributes. They provide valuable data on structural and process elements across the core domains. This includes information on facility focus, patient demographics, available services, and perspectives from patients, providers, and facilities regarding care experiences. The data gathered can be used to generate subdomain, domain, and overall primary care scores, providing a quantifiable measure of primary care quality.

The PCAT tools have undergone rigorous testing and validation across diverse populations and healthcare settings. Between 1995 and 1996, child and adolescent versions of the Consumer-Client and Provider surveys were tested through telephone interviews with parents of 1,017 children enrolled in Florida’s Healthy Kids program (6). Further validation in 1998, published in a study examining primary care quality for children in Washington, D.C., involved telephone surveys with 450 consumers and mail surveys with 101 providers. The results demonstrated the tools’ reliability and consistency in measuring key primary care domains and their ability to differentiate primary care delivery across various provider organizations and facilities (4).

Adaptations for adult populations were tested in a 1999 survey of 890 individuals from an HMO group and a low-income group in South Carolina (7). These studies and subsequent research have provided extensive data for statistical validation, reliability testing, and instrument refinement for adult populations.

The PCAT tools have been adopted and utilized globally, including in Canada (Quebec), Brazil, Spain (Catalonia), South Korea, and China (Taiwan and mainland China). Translations are available in Spanish, Catalan, Portuguese, Mandarin Chinese, and Korean, reflecting the international recognition of the need for robust primary care assessment tools. Published evaluations from these international implementations further confirm the cross-cultural reliability of PCAT in assessing primary care quality.

For those seeking more detailed information about PCAT, its administration, and its diverse applications, Dr. Leiyu Shi ([email protected]) remains a key contact.

PCAT Research Publications

Berra S, Audisio Y, Mantaras J, Nicora V, Mamondi V, Starfield B. [Adaptación del conjunto de instrumentos para la evaluación de la atención primaria de la salud PCAT al contexto argentino]. Argentine J Public Health 2011;2:6-14.

Berra S, Rocha KB, Rodriguez-Sanz M, et al. Properties of a short questionnaire for assessing primary care experiences for children in a population survey. BMC Public Health 2011;11:285.

Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics (J Ambul Pediatr Assoc) 2000;105:998-1003.

Clancy DE, Cope DW, Magruder KM, Huang P, Salter KH, Fields AW. Evaluating group visits in an uninsured or inadequately insured patient population with uncontrolled type 2 diabetes. Diabetes Educ 2003;29:292-302.

Clancy DE, Yeager DE, Huang P, Magruder KM. Further evaluating the acceptability of group visits in an uninsured or inadequately insured patient population with uncontrolled type 2 diabetes. Diabetes Educ 2007;33:309-14.

Figueiredo TM, Villa TC, Scatena LM, et al. Performance of primary healthcare services in tuberculosis control. Rev Saude Publica 2009;43:825-31.

Haggerty JL, Pineault R, Beaulieu MD, et al. Practice features associated with patient-reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008;6:116-23.

Haggerty JL, Pineault R, Beaulieu MD, et al. Room for improvement: patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007;53:1057-2001:e.1,6,1056.

Harzheim E, Duncan BB, Stein AT, et al. Quality and effectiveness of different approaches to primary care delivery in Brazil. BMC Health Serv Res 2006;6:156.

Harzheim E, Starfield B, Rajmil L, Alvarez-Dardet C, Stein AT. Internal consistency and reliability of Primary Care Assessment Tool (PCATool-Brasil) for child health services. Cad Saude Publica 2006;22:1649-59.

Lee JH, Choi YJ, Sung NJ, et al. Development of the Korean primary care assessment tool–measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care 2009;21:103-11.

Levesque, J, Haggerty, J, Beninguisse, G, et al. Mapping the coverage of attributes in validated instruments that evaluate primary healthcare from the patient perspective. BMC Family Practice 2012;13:20.

Macinko J, Almeida C, de Sa PK. A rapid assessment methodology for the evaluation of primary care organization and performance in Brazil. Health Policy Plann 2007;22:167-77.

Malouin R, Starfield B, Sepulveda M. Evaluating the tools used to assess the medical home. Manag Care 2009;18:44-8.

Motta MC, Villa TC, Golub J, et al. Access to tuberculosis diagnosis in Itaborai City, Rio de Janeiro, Brazil: the patient’s point of view. Int J Tuberc Lung Dis 2009;13:1137-41.

Muldoon L, Dahrouge S, Hogg W, Geneau R, Russell G, Shortt M. Community orientation in primary care practices: Results from the Comparison of Models of Primary Health Care in Ontario Study. Can Fam Physician 2010;56:676-83.

Pasarin MI, Berra S, Rajmil L, Solans M, Borrell C, Starfield B. A tool to evaluate primary health care from the population perspective. Aten Primaria 2007;39:395-401.

Pongpirul K, Starfield B, Srivanichakorn S, Pannarunothai S. Policy characteristics facilitating primary health care in Thailand: A pilot study in transitional country. Int J Equity Health 2009;8:8.

Rowan MS, Lawson B, MacLean C, Burge F. Upholding the principles of primary care in preceptors’ practices. Fam Med 2002;34:744-9.

Russell G, Dahrouge S, Tuna M, Hogg W, Geneau R, Gebremichael G. Getting it all done. Organizational factors linked with comprehensive primary care. Fam Pract 2010;27:535-41.

Shi L, Starfield B, Xu J. Validating the Adult Primary Care Assessment Tool. J Fam Pract 2001;50:161W-175W.

Shi L, Starfield B, Xu J, Politzer R, Regan J. Primary care quality: community health center and health maintenance organization. South Med J 2003;96:787-95.

Starfield B, Cassady C, Nanda J, Forrest CB, Berk R. Consumer experiences and provider perceptions of the quality of primary care: implications for managed care. J Fam Pract 1998;46:216-26.

Stevens GD, Shi L. Racial and ethnic disparities in the quality of primary care for children. J Fam Pract 2002;51:573.

Sung NJ, Suh SY, Lee DW, et al. Patient’s assessment of primary care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010;22:493-9.

Tourigny A, Aubin M, Haggerty J, et al. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010;56:e273-82.

Tsai J, Shi L, Yu WL, Hung LM, Lebrun LA. Physician specialty and the quality of medical care experiences in the context of the Taiwan national health insurance system. J Am Board Fam Med 2010;23:402-12.

Tsai J, Shi L, Yu WL, Lebrun LA. Usual source of care and the quality of medical care experiences: a cross-sectional survey of patients from a Taiwanese community. Med Care 2010;48:628-34.

[van Stralen CJ, Belisario SA, van Stralen TB, Lima AM, Massote AW, Oliveira CL. Perceptions of primary health care among users and health professionals: a comparison of units with and without family health care in Central-West Brazil]. Cad Saude Publica 2008;24 Suppl 1:S148-58.](/sites/default/files/2023-04/van-stralen-2008.pdf “van-stralen-2008”)

Villalbi JR, Pasarin M, Montaner I, Cabezas C, Starfield B. [Evaluation of primary health care]. Aten Primaria 2003;31:382-5.

Wong SY, Kung K, Griffiths SM, et al. Comparison of primary care experiences among adults in general outpatient clinics and private general practice clinics in Hong Kong. BMC Public Health 2010;10:397.

References

1. Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q 2005;83:457-502.
2. Institute of Medicine. A Manpower Policy for Primary Health Care. IOM Publication 78-02. Washington, DC: National Academy of Sciences, 1978.
3. Starfield B. Primary Care: Balancing Health Needs, Services, and Technology. New York: Oxford University Press, 1998.
4. Starfield B, Cassady C, Nanda J, Forrest CB, Berk R. Consumer experiences and provider perceptions of the quality of primary care: implications for managed care. J Fam Pract 1998;46:216-26.
5. Starfield B. Measuring the attainment of primary care. J Med Educ 1979;54:361-9.
6. Hurtado MP. Factors associated with primary care quality for low-income children in HMOs: Florida’s Healthy Kids Program. Baltimore, MD: Johns Hopkins School of Public Health, 1999.
7. Shi L, Starfield B, Xu J. Validating the Adult Primary Care Assessment Tool. J Fam Pract 2001;50:161W,175W.

Request PCAT information