User login
METHODS: We conducted a cross-sectional study of 15 member practices of the Ambulatory Sentinel Practice Network selected to represent diverse health care markets. Each practice completed a Managed Care Survey to characterize the degree of organizational and financial restrictiveness for each individual health care plan. A total of 199 managed care plans were characterized. Then, 1475 consecutive outpatients completed a patient survey that included: the Components of Primary Care Instrument as a measure of attributes of primary care; a measure of the amount of inconvenience involved with using the health care plan; and the Medical Outcomes Study Visit Rating Form for assessing patient satisfaction.
RESULTS: Clinicians’ reports of inconvenience were significantly associated (P <.001) with the financial and organizational restrictiveness scores of the plan. There was no association between plan restrictiveness and patient report of multiple aspects of the delivery of primary care or patient satisfaction with the visit.
CONCLUSIONS: Plan restrictiveness is associated with greater perceived hassle for clinicians but not for patients. Plan restrictiveness seems to be creating great pressures for clinicians, but is not affecting patients’ reports of the quality of important attributes of primary care or satisfaction with the visit. Physicians and their staffs appear to be buffering patients from the potentially negative effects of plan restrictiveness.
Managed care has become the predominant approach to health care financing in the United States.1 This explosive growth has been accompanied by an increasingly complex array of types of managed care plans and a growth in the use of restrictions and financial incentives to influence physician practice behavior.2 Contributing to the diversity and complexity of managed care are new incentive systems, strategies to manage patterns of care,3,4 and a shift toward national investor-owned plans. In addition, many practicing physicians are participating in new business relationships, including physician hospital organizations, medical service organizations, and risk-sharing arrangements. The treatment of all managed care plans as a single entity for comparison with fee-for-service plans is no longer adequate to capture the effect of the health care context on the delivery of care or health outcomes.5 A typology of features that represents a plan’s organizational and incentive features would facilitate understanding of what specific aspects affect outcomes of care across the nation.6,7 The Managed Care Survey was developed for use in this study to build on previous work by measuring specific attributes of different managed care plans that may affect both physician and patient outcomes.
Managed care organizations traditionally position primary care clinicians as the cornerstones of their delivery system8; however, the effect of the restrictiveness of managed care plans on the patient-physician relationship and the delivery of important attributes of primary care (as described by the Institute of Medicine9) are poorly understood. A common assumption is that managed care fosters primary care because of its gatekeeper and first-contact functions.8 Since health systems organized around primary care have been shown to have better population-level outcomes,10 one might expect similar results from managed care systems.11-13 Several aspects of the current competitive managed care marketplace, however, do not appear to be conducive to achieving the goals of primary care.14,15 The restrictions on clinicians’ and patients’ choices have raised concerns about the potential detrimental effect of managed care on the patient-physician relationship.16 In addition, the practice of annual re-bidding of managed care contracts can cause a forced disruption in continuity of care17 with detrimental effects on patients.15,18 For these reasons, the Institute of Medicine recommends monitoring the performance of health care systems to assess the adequacy of the delivery of attributes of primary care.9
The restrictions and incentives imposed by managed care organizations that are designed to modify physician practice behavior may inadvertently effect other valued aspects of patient care. The purpose of our study is to evaluate the association of managed care restrictiveness with specific attributes of primary care, visit-based patient satisfaction, and perceived inconvenience (or “hassle”) of using the plan.
Methods
Study Design, Sites, and Sample
A cross-sectional design was used to collect data from 15 member practices of the Ambulatory Sentinel Practice Network (ASPN). ASPN, composed of 752 community-based practicing clinicians, was established in 1982 to conduct practice-based research. Its 122 practices in 34 states have been shown to serve a nationally representative patient population and provide access to health care markets with a wide range of penetration and maturity of managed care.19 We solicited volunteer practice sites and chose 15 US ASPN sites to represent high-, medium-, and low-levels of managed care penetration in both urban and rural areas. Clinician and practice characteristics, including the clinicians’ estimate of the proportion of managed care in the practice, were obtained from the ASPN member database, which is updated annually. All 15 sites that were invited to participate in the study agreed to complete it.
Data Collection
The ASPN central office recruited and trained participating practice personnel and coordinated project implementation. Between April and August 1997, practices were sent explicit protocol instructions and copies of the Managed Care Survey and the patient survey and were instructed to choose a start date for administering surveys to 50 consecutive patients of each participating clinician. Patients were asked to complete the survey before leaving the office. A preassigned number corresponding to the patient’s insurance plan was written on the survey before it was given to the patient. The staff also kept track of the age, sex, and insurance plan of those patients who declined to participate, so that any nonparticipation bias could be evaluated.
In addition, for each practice a single Managed Care Survey was completed jointly by a physician and office manager to characterize each individual managed care health care plan with a minimum of 5% of all patients. Each insurance plan on the survey was identified by the same number that was used on the corresponding individual patients’ health care plans on the patient survey.
Measures
Managed care was conceptualized as a set of organizational restraints and financial incentives that are intended to focus and limit clinicians’ use of health care resources. The Managed Care Survey was designed to characterize managed care plans along several dimensions. The survey was developed by the ASPN Task Force on Managed Care, which consisted of 6 family physicians from the United States and 1 from Canada representing diversity in gender, geographic location, organization of practice, managed care market, and years in practice. Group consensus was used to identify and define the key managed care features that represent organizational restraints, financial incentives, and other aspects affecting the restrictiveness of plans.
The plan features measured by the managed care survey included the proportion of each practice’s patients in the plan, the plan’s financial restrictiveness and organizational restrictiveness, and the level of hassle associated with it. The financial restrictiveness portion of the survey included the type of reimbursement (capitation global risk, capitation professional risk, capitation primary care risk, discounted fee-for-service, or fee-for-service) and whether the plan carried a clinician-withhold fund or an incentive-bonus fund. The organizational restrictiveness part of the survey included plan characterization on the following features: mental health carve-out, laboratory services, formulary, preauthorization for diagnostic or treatment procedures, preauthorization for physician referrals, specialty network, and procedure (site of service) constraints. The managed care survey features and their definitions are listed in Appendix A.*
Some plan features were viewed as more important than others for describing a plan’s financial and organizational restrictiveness. Each member of the ASPN Managed Care Task Force assigned a value of importance for each feature (using a Likert scale where 1 = somewhat important; 10 = very important). The group mean assigned weight for each feature was used to calculate the 2 weighted summary scores representing the financial and organizational restrictiveness of each plan.
In addition to the managed care plan features, clinicians completing the survey were asked to rate the degree of hassle, defined as the degree of time-consuming interference with routine practice activities perceived to be associated with the plan, on a scale of 1 to 5. Additional items on the Managed Care Survey included questions about the type of practice (solo, multispecialty group, and so forth), political/business affiliations, recent mergers/buyouts, and type of clinician compensation.
The attributes of delivery of primary care were measured by the revised Components of Primary Care Instrument (CPCI)20,21 which measures key attributes of the patient-provider relationship based on the recent Institute of Medicine definition of primary care.9 The CPCI assesses interpersonal communication, comprehensive care, continuity of care, coordination of care, provider’s accumulated knowledge about the patient, family orientation, community orientation, advocacy, and patient preference for their usual provider. Each attribute is measured from the patient’s perspective of the patient-provider relationship. Descriptive statistics, internal consistency reliabilities, and scale content are displayed in Appendix B.* Missing data on the CPCI scale scores were handled by setting a maximum number of missing values allowed per scale and computing a score using individual responses to the remaining scale items. Questionnaires missing more data than the maximum allowed were given no score for that scale. Therefore, the total number of patients with complete data per scale, and the sample size for analyses, varies by scale.
Patient satisfaction with the visit was measured using the Medical Outcomes Study 9-Item Visit Rating Form.22 Two scores were computed, patient satisfaction with the physician and with practice operation.23 Another specific patient item (satisfaction with the amount of time spent with the physician) was also assessed separately. Eight items were written to assess the patient’s perceived hassle in obtaining health care, and a summary scale score was computed (internal consistency reliability = .80). Additional items on the patient survey included patient age, sex, 2 reports of health status, whether today’s physician is the patient’s regular physician, and if no, whether the patient’s regular physician is a member of the office. Standard demographic items were included on the abbreviated survey for new patients. Also included were questions regarding whether that visit was for well-care or serious illness, and whether they had been forced to change physicians in the past 2 years.
Analyses
Data from the Managed Care Survey and the patient survey were linked by a unique identifier on the basis of site and site-specific health care plan. Patient surveys that could not be linked (eg, because of a missing plan identifier or because the plan was not rated on the Managed Care Survey) were included in the descriptive statistics of the study sample, but are excluded from the analyses involving the managed care features. Descriptive statistics of the sites, clinicians, and plan features are calculated. We used chi-square tests to compare the data available from the nonresponders with the data from the responders to assess bias.
We used the Pearson correlation to test the association of the plans’ financial and organizational restrictiveness scores with the clinicians’ reports of hassle. The association of the managed care plan restrictiveness scores with each of the CPCI scale scores, patient satisfaction with the visit, and patient perceived hassle was tested with multilevel modeling techniques using hierarchical linear regression software.24 Multilevel modeling is an analysis technique that accounts for the nested structural context of the data. Two potential confounding variables, patient age and health status, were included as covariates in these analyses.
Results
All 15 sites returned a completed Managed Care Survey. Practice characteristics are displayed in Table 1. One fourth of the practices had experienced a recent professional merger and one third had undergone a recent purchase or buyout. The average number of managed care plans in each practice ranged from 1 to 25, with an average of 13.3 plans. The average proportion of patients in a managed care plan per site was 51% (range = 21% to 100%). The 41 clinicians participating in the study are characterized in Table 2. The vast majority of clinicians had MD degrees, and 66% were men. On average, clinicians spent 90% of their time on patient care.
The patient response rate was also excellent. Of the 1922 patients approached, 1839 (96%) agreed to complete the patient survey. One hundred and six patients returned a blank survey and represent passive refusers. Of the 1733 patients returning a survey at least partially completed, 1503 were established patients, and 230 were new patients. Twenty-eight established patients did not see their regular physician, and that physician was not a member of the office they were visiting that day. These patients were excluded, bringing the final patient sample size to 1475.
Patient characteristics are reported in Table 3. The majority of patients were women, and health status, on average, was good. Most patients (84%) saw their regular physician, approximately half had a well-care visit within the past 2 years, and approximately one fourth were treated for a serious illness within the past 2 years. Fifty-nine percent of established patients had some type of managed care insurance. Standard Medicare and Medicaid insurance accounted for 21% of patients, and only 11% were categorized as having traditional commercial insurance. Established patients who declined to complete the patient survey (n = 41) were similar in average age and type of insurance but were more likely to be men than the patients who completed the survey.
Table 1, Table 4 displays the frequency of the different managed care features measured by the Managed Care Survey. Laboratory services, preauthorization, specialty networks, and site of service were features of more than 50% of the 199 managed care plans characterized. Physicians rated plans with a restrictive feature as generating greater hassle on average than plans without restrictive features. The 2 exceptions to this trend were plans with point-of-service and withhold features.
We investigated the association of managed care plan restrictiveness with each of the CPCI scale scores and patient satisfaction with the visit. Of the 870 patients with a type of managed care insurance, 786 patients had complete data for this analysis. For ease of interpretation, the managed care restrictiveness scores were divided into low (27%), medium (46%), and high (27%).25 This categorization of the restrictiveness scores has 3 advantages: interpretation of 3 group means versus a b coefficient is easier; a nonlinear association is readily determined; and the distributions of the outcome measure for the high and low groups can be shown to be nonoverlapping. If no statistically significant difference is found between these 2 distinctly different extreme groups, this can be taken as evidence for not rejecting the null hypothesis of no association.
As indicated in Table 5, the mean of the different CPCI, hassle, and patient satisfaction scores were very similar across each level of managed care plan financial restrictiveness. Similarly, organizational restrictiveness was not significantly associated with any of the CPCI scale scores, patient report of hassle, or the satisfaction scores. These analyses were adjusted for patient age and health status and the nested effect of the data.
Discussion
We used innovative measures and a unique practice-based laboratory to assess the impact of specific aspects of managed care on the delivery of important attributes of primary care. The findings suggest that the restrictiveness of managed care plans does not affect patients’ perceptions of multiple attributes of primary care or their satisfaction with the visit. However, both financial and organizational restrictiveness were associated with greater clinician-reported hassle. These findings may not conform to the widespread belief by practicing clinicians that plan characteristics affect patients in a direct way,8,26 and clinicians may be reassured to find that they are able to maintain good primary care relationships with patients amidst the challenges they experience.
Clinician hassle was rated in terms of the time required for insurance-mandated administrative activities generated by the plan (eg, the length and repetition of required forms and written or verbal requirements). Other studies have reported specific physician-reported hassles associated with particular plans.8,27 Most of the hassles can be attributed to an added administrative burden, such as the need to make phone calls, write letters, and gather information from medical records in response to denial of payment, requests for patient information, or precertification of services.27 Our findings that clinicians reported increased administrative burden with more restrictive plans reinforce the idea by Freberg28 that it is difficult to know whether managed care plans are cost effective or merely add to the hidden cost of administrative overhead. Future studies should investigate the amount of effort required for additional administrative burdens relative to the cost savings of the plan.
The lack of association between patient-perceived hassle and plan restrictiveness indicates that the burdens of plan restrictiveness fall squarely on the shoulders of clinicians and staff. It is also likely that patients who are less concerned about plan restrictions may have self-selected a restrictive plan for cost savings or other perceived benefits. For these patients, the benefits (eg, lower deductibles, coverage of health maintenance visits) may outweigh the disadvantages (eg, restricted freedom of choice, increased personal cost incurred to opt for out-of-plan services).
Concerns have been raised about conflict of interest, the effect of financial incentives on physician behavior, the quality of the patient-physician relationship and decision making, time constraints, and the potential for underservice with managed care systems.16,26,29-34 Grumbach and colleagues26 found that 57% of physicians surveyed reported that they felt pressure from the managed care organization to limit referrals; 75% felt pressure to see more patients per day; and 17% and 24%, respectively, felt that limiting referrals and seeing more patients per day compromised patient care. In our study, patients in highly restrictive managed care plans did not perceive their physician to be any less of an advocate for their health care than patients in the low- or medium-restrictiveness groups. Thus, this sample of primary care clinicians continued to engage in trusting relationships with their patients despite the potential conflict of interest that could arise from managed care plans’ financial incentives to restrict care.
In our sample of patients, as well as in others,21 the CPCI assessed important aspects of primary care with good internal consistency. The instrument’s scale scores have been shown to be associated with patient satisfaction21 and delivery of preventive services,35 and have been shown to detect differences in the delivery of primary care to patients who faced forced discontinuity of care and those who remained with their regular physician.15 The CPCI should be sensitive to many of the potential ill effects of managed care on the patient-physician relationship and delivery of primary care. The lack of association between plan restrictiveness and patient report of primary care is striking, and there is strong evidence that the clinicians and office staff who report being hassled by these restrictions are not allowing those hassles to interfere with their delivery of patient care.
Others26 have evaluated physician satisfaction with specific plan features and physician-rated quality of specific health care plans.36 We asked physicians to objectively report the presence or absence of specific organizational and financial features of each of the managed care plans in their practices. Using the Managed Care Survey to characterize specific organizational and financial aspects of plans is a major advance in being able to test the importance of these features on physician behavior and processes of care and patient outcomes.
Limitations
The main potential threat to the internal validity of the study is patient nonresponse. The nonrespondents were more likely to be men than patients who completed the survey. It is possible that these patients may have been less satisfied with care and may have reported lower scores on the CPCI. However, nonrespondents represent only 10% of those approached, and it is unlikely that the findings of the study would have changed if they had been included. We are also unable to comment on how long a patient had been with their current insurance plan. Length of exposure and actual experience with the features of a plan could potentially affect the association of plan restrictiveness with perceived delivery of primary care. However, consecutive patients were enrolled, which should reduce the likelihood of a selection bias of such a variable.
Replication of this study in a larger number of community-based practice sites and in a general community sample would add to the generalizability of the findings. In these times of increased business interest in medicine,37 it is important to continue to monitor and evaluate the immediate, long-term, intended, and unintended outcomes of specific features of managed care.
Conclusions
Managed care plan restrictiveness does not appear to be affecting the delivery of primary care as measured from the perspective of the patient. However, the financial and organizational restrictiveness of managed care plans does lead to greater clinician hassle. We interpret these results to suggest that primary care clinicians are able to effectively buffer the effects of health plan structure on their patients. These findings raise questions about the effect of plan restrictiveness on efficient use of clinician time and the clinician’s ability to continue to deliver quality primary care amidst competing administrative demands.
Acknowledgments
We would like to thank each of the participating ASPN practices, their staffs, and patients, without whom the study would not have been possible. The practices participating in this study included the following: Batesville Family Practice Clinic, Batesville, Arkansas; Loma Linda University, Department of Family Medicine, Loma Linda, California; C. Frazer Shipman, Wheatridge, Colorado; The Family Medical Group, Bristol, Connecticut; St. John’s Mercy Family Medicine, St. Louis, Missouri; Manchester Family Health Center, Manchester, New Hampshire; Primary Care Center at Hillsborough, Belle Mead, New Jersey, and Family Medicine at Monument Square, New Brunswick, New Jersey; Central Square Health Services Center, Central Square, New York; Enid Family Medicine Clinic, Enid, Oklahoma; Good Samaritan Family Practice, ELCO, Lebanon, Pennsylvania; Michael Hartsell, MD, Greeneville, Tennessee; Annadale Family Medicine, PC, Annadale, Virginia, and Tappahannack Family Practice, Tappahannack, Virginia; and Cle Elum Family Medicine Center, Cle Elum, Washington.
Thanks to each of the ASPN Managed Care Task Force members who developed the Managed Care Survey and pilot tested the project instruments and protocol: A. John Orzano, MD; H. Andrew Selinger, MD; Robert James, MD; William Fosmire, MD; Linda French, MD; Frank Reed, MD; John Scott, MD; and Dennis de Leon, MD.
1. KPMG Peat Marwick. Executive summary. Health benefits in 1995. Minneapolis, Minn: KPMG Peat Marwick; 1995.
2. Schoen C. Managed care: a national experiment. Unanswered questions and potential risks. Bull NY Acad Med 1995;72:645-56.
3. Gold MR, Hurley R, Lake T, Ensor T, Berenson R. A national survey of the arrangements managed care plans make with physicians. N Engl J Med 1995;333:1678-83.
4. Kane N, Turnbull T, Schoen C. Case studies of IPA and network HMOs: report to the Commonwealth Fund; 1995.
5. Davis K. The culture of managed care: implications for patients. Bull NY Acad Med 1996;73:179.-
6. Welch WP, Hillman AL, Pauly MV. Toward new typologies for HMOs. Milbank Q 1990;68:221-43.
7. Landon BE, Wilson IB, Cleary PD. A conceptual model of the effects of health care organizations on the quality of medical care. JAMA 1998;279:1377-82.
8. Halm EA, Causino N, Blumenthal D. Is gatekeeping better than traditional care? A survey of physician’s attitudes. JAMA 1997;278:1677-81.
9. Donaldson MS. YK, Lohr KN, Vanselow NA, eds. Primary care: America’s health in a new era. Washington D.C.: National Academy Press; 1996.
10. Starfield B. Primary care: concept, evaluation, and policy. New York, NY: Oxford University Press; 1992.
11. Franks P, Clancy CM, Nutting PA. Gatekeeping revisited: protecting patients from overtreatment. N Engl J Med 1992;327:424-7.
12. Greenfield S, Rogers W, Mangotich M, Carney MF, Tarlov AR. Outcomes of patients with hypertension and non-insulin-dependent diabetes mellitus treated by different systems and specialties: results from the medical outcomes study. JAMA 1995;274:1436-44.
13. Starfield B. Primary care: participants or gatekeepers? Diabetes Care 1994;17:12-7.
14. Blumenthal D, Mort E, Edwards J. The efficacy of primary care for vulnerable population groups. Health Serv Res 1995;30:253-73.
15. Flocke SA, Stange KC, Zyzanski SJ. The impact of insurance type and forced discontinuity on the delivery of primary care. J Fam Pract 1997;45:129-35.
16. Emanuel EJ, Dubler NN. Preserving the physician-patient relationship in the era of managed care. JAMA 1995;273:323-9.
17. Davis K, Collins KS, Schoen C, Morris C. Choice matters: Enrollees’ views of their health plans. Health Aff 1995;14:100-12.
18. Kahana E, Stange KC, Meehan R, Raff L. Forced disruption in continuity of primary care: the patients’ perspective. Sociological Focus 1997;30:172-82.
19. Green LA, Miller RS, Reed FM, Iverson DC, Barley GE. How representative of typical practice are practice-based research networks? A report from the Ambulatory Sentinel Practice Network (ASPN). Arch Fam Med 1993;2:939-49.
20. Flocke SA. Primary care instrument [letter]. J Fam Pract 1998;46:12.-
21. Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract 1997;45:64-74.
22. Rubin H, Gandek B, Roger WH, Kisinski M, McHorney C, Ware J. Patients’ ratings of outpatient visits in different practice settings. JAMA 1993;270:835-40.
23. Stange KC, Zyzanski SJ, Jaen CR, et al. Illuminating the black box: a description of 4454 patient visits to 138 family physicians. J Fam Pract 1998;46:377-89.
24. Bryk AS, Raudenbush SW. Hierarchical linear models: applications and data analysis methods. Newbury Park, Calif: Sage Publications; 1992.
25. Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psych 1939;30:17-24.
26. Grumbach K, Osmond D, Vranizan K, Jaffe D, Bindman AB. Primary care physicians’ experience of financial incentives in managed-care systems. N Engl J Med 1998;339:1516-21.
27. Texas Medical Association. TMA updates hassle factor log form. Tex Med 1993;89:22-4.
28. Freberg GW. Managed care: ‘the hassle factor,’ by choice or coercion. Conn Med 1992;56:203-6.
29. Collins KS, Schoen C, Sandman DR. The commonwealth fund survey of physician experiences with managed care. New York, NY: The Commonwealth Fund; 1997.
30. Kassirer JP. Managed care and the morality of the marketplace. N Engl J Med 1995;333:50-52.
31. Glass RM. The patient-physician relationship. JAMA 1996;275:147-8.
32. Orentlicher D. Health care reform and the patient-physician relationship. Health Matrix 1995;5:141-80.
33. Hillman AL. Financial incentives for physicians in HMOs: Is there a conflict of interest? N Engl J Med 1987;317:1743-8.
34. Council on Ethical and Judicial Affairs AMA. Ethical issues in managed care. JAMA 1995;273:330-5.
35. Flocke SA, Stange KC, Zyzanski SJ. The association of attributes of primary care with preventive service delivery. Med Care 1997;36:AS21-30.
36. Borowsky SJ, Davis MK, Goertz C, Lurie N. Are all health plans created equal? JAMA 1997;278:917-21.
37. Lundburg GD. The failure of organized health system reform: now what? JAMA 1995;273:1539-41.
METHODS: We conducted a cross-sectional study of 15 member practices of the Ambulatory Sentinel Practice Network selected to represent diverse health care markets. Each practice completed a Managed Care Survey to characterize the degree of organizational and financial restrictiveness for each individual health care plan. A total of 199 managed care plans were characterized. Then, 1475 consecutive outpatients completed a patient survey that included: the Components of Primary Care Instrument as a measure of attributes of primary care; a measure of the amount of inconvenience involved with using the health care plan; and the Medical Outcomes Study Visit Rating Form for assessing patient satisfaction.
RESULTS: Clinicians’ reports of inconvenience were significantly associated (P <.001) with the financial and organizational restrictiveness scores of the plan. There was no association between plan restrictiveness and patient report of multiple aspects of the delivery of primary care or patient satisfaction with the visit.
CONCLUSIONS: Plan restrictiveness is associated with greater perceived hassle for clinicians but not for patients. Plan restrictiveness seems to be creating great pressures for clinicians, but is not affecting patients’ reports of the quality of important attributes of primary care or satisfaction with the visit. Physicians and their staffs appear to be buffering patients from the potentially negative effects of plan restrictiveness.
Managed care has become the predominant approach to health care financing in the United States.1 This explosive growth has been accompanied by an increasingly complex array of types of managed care plans and a growth in the use of restrictions and financial incentives to influence physician practice behavior.2 Contributing to the diversity and complexity of managed care are new incentive systems, strategies to manage patterns of care,3,4 and a shift toward national investor-owned plans. In addition, many practicing physicians are participating in new business relationships, including physician hospital organizations, medical service organizations, and risk-sharing arrangements. The treatment of all managed care plans as a single entity for comparison with fee-for-service plans is no longer adequate to capture the effect of the health care context on the delivery of care or health outcomes.5 A typology of features that represents a plan’s organizational and incentive features would facilitate understanding of what specific aspects affect outcomes of care across the nation.6,7 The Managed Care Survey was developed for use in this study to build on previous work by measuring specific attributes of different managed care plans that may affect both physician and patient outcomes.
Managed care organizations traditionally position primary care clinicians as the cornerstones of their delivery system8; however, the effect of the restrictiveness of managed care plans on the patient-physician relationship and the delivery of important attributes of primary care (as described by the Institute of Medicine9) are poorly understood. A common assumption is that managed care fosters primary care because of its gatekeeper and first-contact functions.8 Since health systems organized around primary care have been shown to have better population-level outcomes,10 one might expect similar results from managed care systems.11-13 Several aspects of the current competitive managed care marketplace, however, do not appear to be conducive to achieving the goals of primary care.14,15 The restrictions on clinicians’ and patients’ choices have raised concerns about the potential detrimental effect of managed care on the patient-physician relationship.16 In addition, the practice of annual re-bidding of managed care contracts can cause a forced disruption in continuity of care17 with detrimental effects on patients.15,18 For these reasons, the Institute of Medicine recommends monitoring the performance of health care systems to assess the adequacy of the delivery of attributes of primary care.9
The restrictions and incentives imposed by managed care organizations that are designed to modify physician practice behavior may inadvertently effect other valued aspects of patient care. The purpose of our study is to evaluate the association of managed care restrictiveness with specific attributes of primary care, visit-based patient satisfaction, and perceived inconvenience (or “hassle”) of using the plan.
Methods
Study Design, Sites, and Sample
A cross-sectional design was used to collect data from 15 member practices of the Ambulatory Sentinel Practice Network (ASPN). ASPN, composed of 752 community-based practicing clinicians, was established in 1982 to conduct practice-based research. Its 122 practices in 34 states have been shown to serve a nationally representative patient population and provide access to health care markets with a wide range of penetration and maturity of managed care.19 We solicited volunteer practice sites and chose 15 US ASPN sites to represent high-, medium-, and low-levels of managed care penetration in both urban and rural areas. Clinician and practice characteristics, including the clinicians’ estimate of the proportion of managed care in the practice, were obtained from the ASPN member database, which is updated annually. All 15 sites that were invited to participate in the study agreed to complete it.
Data Collection
The ASPN central office recruited and trained participating practice personnel and coordinated project implementation. Between April and August 1997, practices were sent explicit protocol instructions and copies of the Managed Care Survey and the patient survey and were instructed to choose a start date for administering surveys to 50 consecutive patients of each participating clinician. Patients were asked to complete the survey before leaving the office. A preassigned number corresponding to the patient’s insurance plan was written on the survey before it was given to the patient. The staff also kept track of the age, sex, and insurance plan of those patients who declined to participate, so that any nonparticipation bias could be evaluated.
In addition, for each practice a single Managed Care Survey was completed jointly by a physician and office manager to characterize each individual managed care health care plan with a minimum of 5% of all patients. Each insurance plan on the survey was identified by the same number that was used on the corresponding individual patients’ health care plans on the patient survey.
Measures
Managed care was conceptualized as a set of organizational restraints and financial incentives that are intended to focus and limit clinicians’ use of health care resources. The Managed Care Survey was designed to characterize managed care plans along several dimensions. The survey was developed by the ASPN Task Force on Managed Care, which consisted of 6 family physicians from the United States and 1 from Canada representing diversity in gender, geographic location, organization of practice, managed care market, and years in practice. Group consensus was used to identify and define the key managed care features that represent organizational restraints, financial incentives, and other aspects affecting the restrictiveness of plans.
The plan features measured by the managed care survey included the proportion of each practice’s patients in the plan, the plan’s financial restrictiveness and organizational restrictiveness, and the level of hassle associated with it. The financial restrictiveness portion of the survey included the type of reimbursement (capitation global risk, capitation professional risk, capitation primary care risk, discounted fee-for-service, or fee-for-service) and whether the plan carried a clinician-withhold fund or an incentive-bonus fund. The organizational restrictiveness part of the survey included plan characterization on the following features: mental health carve-out, laboratory services, formulary, preauthorization for diagnostic or treatment procedures, preauthorization for physician referrals, specialty network, and procedure (site of service) constraints. The managed care survey features and their definitions are listed in Appendix A.*
Some plan features were viewed as more important than others for describing a plan’s financial and organizational restrictiveness. Each member of the ASPN Managed Care Task Force assigned a value of importance for each feature (using a Likert scale where 1 = somewhat important; 10 = very important). The group mean assigned weight for each feature was used to calculate the 2 weighted summary scores representing the financial and organizational restrictiveness of each plan.
In addition to the managed care plan features, clinicians completing the survey were asked to rate the degree of hassle, defined as the degree of time-consuming interference with routine practice activities perceived to be associated with the plan, on a scale of 1 to 5. Additional items on the Managed Care Survey included questions about the type of practice (solo, multispecialty group, and so forth), political/business affiliations, recent mergers/buyouts, and type of clinician compensation.
The attributes of delivery of primary care were measured by the revised Components of Primary Care Instrument (CPCI)20,21 which measures key attributes of the patient-provider relationship based on the recent Institute of Medicine definition of primary care.9 The CPCI assesses interpersonal communication, comprehensive care, continuity of care, coordination of care, provider’s accumulated knowledge about the patient, family orientation, community orientation, advocacy, and patient preference for their usual provider. Each attribute is measured from the patient’s perspective of the patient-provider relationship. Descriptive statistics, internal consistency reliabilities, and scale content are displayed in Appendix B.* Missing data on the CPCI scale scores were handled by setting a maximum number of missing values allowed per scale and computing a score using individual responses to the remaining scale items. Questionnaires missing more data than the maximum allowed were given no score for that scale. Therefore, the total number of patients with complete data per scale, and the sample size for analyses, varies by scale.
Patient satisfaction with the visit was measured using the Medical Outcomes Study 9-Item Visit Rating Form.22 Two scores were computed, patient satisfaction with the physician and with practice operation.23 Another specific patient item (satisfaction with the amount of time spent with the physician) was also assessed separately. Eight items were written to assess the patient’s perceived hassle in obtaining health care, and a summary scale score was computed (internal consistency reliability = .80). Additional items on the patient survey included patient age, sex, 2 reports of health status, whether today’s physician is the patient’s regular physician, and if no, whether the patient’s regular physician is a member of the office. Standard demographic items were included on the abbreviated survey for new patients. Also included were questions regarding whether that visit was for well-care or serious illness, and whether they had been forced to change physicians in the past 2 years.
Analyses
Data from the Managed Care Survey and the patient survey were linked by a unique identifier on the basis of site and site-specific health care plan. Patient surveys that could not be linked (eg, because of a missing plan identifier or because the plan was not rated on the Managed Care Survey) were included in the descriptive statistics of the study sample, but are excluded from the analyses involving the managed care features. Descriptive statistics of the sites, clinicians, and plan features are calculated. We used chi-square tests to compare the data available from the nonresponders with the data from the responders to assess bias.
We used the Pearson correlation to test the association of the plans’ financial and organizational restrictiveness scores with the clinicians’ reports of hassle. The association of the managed care plan restrictiveness scores with each of the CPCI scale scores, patient satisfaction with the visit, and patient perceived hassle was tested with multilevel modeling techniques using hierarchical linear regression software.24 Multilevel modeling is an analysis technique that accounts for the nested structural context of the data. Two potential confounding variables, patient age and health status, were included as covariates in these analyses.
Results
All 15 sites returned a completed Managed Care Survey. Practice characteristics are displayed in Table 1. One fourth of the practices had experienced a recent professional merger and one third had undergone a recent purchase or buyout. The average number of managed care plans in each practice ranged from 1 to 25, with an average of 13.3 plans. The average proportion of patients in a managed care plan per site was 51% (range = 21% to 100%). The 41 clinicians participating in the study are characterized in Table 2. The vast majority of clinicians had MD degrees, and 66% were men. On average, clinicians spent 90% of their time on patient care.
The patient response rate was also excellent. Of the 1922 patients approached, 1839 (96%) agreed to complete the patient survey. One hundred and six patients returned a blank survey and represent passive refusers. Of the 1733 patients returning a survey at least partially completed, 1503 were established patients, and 230 were new patients. Twenty-eight established patients did not see their regular physician, and that physician was not a member of the office they were visiting that day. These patients were excluded, bringing the final patient sample size to 1475.
Patient characteristics are reported in Table 3. The majority of patients were women, and health status, on average, was good. Most patients (84%) saw their regular physician, approximately half had a well-care visit within the past 2 years, and approximately one fourth were treated for a serious illness within the past 2 years. Fifty-nine percent of established patients had some type of managed care insurance. Standard Medicare and Medicaid insurance accounted for 21% of patients, and only 11% were categorized as having traditional commercial insurance. Established patients who declined to complete the patient survey (n = 41) were similar in average age and type of insurance but were more likely to be men than the patients who completed the survey.
Table 1, Table 4 displays the frequency of the different managed care features measured by the Managed Care Survey. Laboratory services, preauthorization, specialty networks, and site of service were features of more than 50% of the 199 managed care plans characterized. Physicians rated plans with a restrictive feature as generating greater hassle on average than plans without restrictive features. The 2 exceptions to this trend were plans with point-of-service and withhold features.
We investigated the association of managed care plan restrictiveness with each of the CPCI scale scores and patient satisfaction with the visit. Of the 870 patients with a type of managed care insurance, 786 patients had complete data for this analysis. For ease of interpretation, the managed care restrictiveness scores were divided into low (27%), medium (46%), and high (27%).25 This categorization of the restrictiveness scores has 3 advantages: interpretation of 3 group means versus a b coefficient is easier; a nonlinear association is readily determined; and the distributions of the outcome measure for the high and low groups can be shown to be nonoverlapping. If no statistically significant difference is found between these 2 distinctly different extreme groups, this can be taken as evidence for not rejecting the null hypothesis of no association.
As indicated in Table 5, the mean of the different CPCI, hassle, and patient satisfaction scores were very similar across each level of managed care plan financial restrictiveness. Similarly, organizational restrictiveness was not significantly associated with any of the CPCI scale scores, patient report of hassle, or the satisfaction scores. These analyses were adjusted for patient age and health status and the nested effect of the data.
Discussion
We used innovative measures and a unique practice-based laboratory to assess the impact of specific aspects of managed care on the delivery of important attributes of primary care. The findings suggest that the restrictiveness of managed care plans does not affect patients’ perceptions of multiple attributes of primary care or their satisfaction with the visit. However, both financial and organizational restrictiveness were associated with greater clinician-reported hassle. These findings may not conform to the widespread belief by practicing clinicians that plan characteristics affect patients in a direct way,8,26 and clinicians may be reassured to find that they are able to maintain good primary care relationships with patients amidst the challenges they experience.
Clinician hassle was rated in terms of the time required for insurance-mandated administrative activities generated by the plan (eg, the length and repetition of required forms and written or verbal requirements). Other studies have reported specific physician-reported hassles associated with particular plans.8,27 Most of the hassles can be attributed to an added administrative burden, such as the need to make phone calls, write letters, and gather information from medical records in response to denial of payment, requests for patient information, or precertification of services.27 Our findings that clinicians reported increased administrative burden with more restrictive plans reinforce the idea by Freberg28 that it is difficult to know whether managed care plans are cost effective or merely add to the hidden cost of administrative overhead. Future studies should investigate the amount of effort required for additional administrative burdens relative to the cost savings of the plan.
The lack of association between patient-perceived hassle and plan restrictiveness indicates that the burdens of plan restrictiveness fall squarely on the shoulders of clinicians and staff. It is also likely that patients who are less concerned about plan restrictions may have self-selected a restrictive plan for cost savings or other perceived benefits. For these patients, the benefits (eg, lower deductibles, coverage of health maintenance visits) may outweigh the disadvantages (eg, restricted freedom of choice, increased personal cost incurred to opt for out-of-plan services).
Concerns have been raised about conflict of interest, the effect of financial incentives on physician behavior, the quality of the patient-physician relationship and decision making, time constraints, and the potential for underservice with managed care systems.16,26,29-34 Grumbach and colleagues26 found that 57% of physicians surveyed reported that they felt pressure from the managed care organization to limit referrals; 75% felt pressure to see more patients per day; and 17% and 24%, respectively, felt that limiting referrals and seeing more patients per day compromised patient care. In our study, patients in highly restrictive managed care plans did not perceive their physician to be any less of an advocate for their health care than patients in the low- or medium-restrictiveness groups. Thus, this sample of primary care clinicians continued to engage in trusting relationships with their patients despite the potential conflict of interest that could arise from managed care plans’ financial incentives to restrict care.
In our sample of patients, as well as in others,21 the CPCI assessed important aspects of primary care with good internal consistency. The instrument’s scale scores have been shown to be associated with patient satisfaction21 and delivery of preventive services,35 and have been shown to detect differences in the delivery of primary care to patients who faced forced discontinuity of care and those who remained with their regular physician.15 The CPCI should be sensitive to many of the potential ill effects of managed care on the patient-physician relationship and delivery of primary care. The lack of association between plan restrictiveness and patient report of primary care is striking, and there is strong evidence that the clinicians and office staff who report being hassled by these restrictions are not allowing those hassles to interfere with their delivery of patient care.
Others26 have evaluated physician satisfaction with specific plan features and physician-rated quality of specific health care plans.36 We asked physicians to objectively report the presence or absence of specific organizational and financial features of each of the managed care plans in their practices. Using the Managed Care Survey to characterize specific organizational and financial aspects of plans is a major advance in being able to test the importance of these features on physician behavior and processes of care and patient outcomes.
Limitations
The main potential threat to the internal validity of the study is patient nonresponse. The nonrespondents were more likely to be men than patients who completed the survey. It is possible that these patients may have been less satisfied with care and may have reported lower scores on the CPCI. However, nonrespondents represent only 10% of those approached, and it is unlikely that the findings of the study would have changed if they had been included. We are also unable to comment on how long a patient had been with their current insurance plan. Length of exposure and actual experience with the features of a plan could potentially affect the association of plan restrictiveness with perceived delivery of primary care. However, consecutive patients were enrolled, which should reduce the likelihood of a selection bias of such a variable.
Replication of this study in a larger number of community-based practice sites and in a general community sample would add to the generalizability of the findings. In these times of increased business interest in medicine,37 it is important to continue to monitor and evaluate the immediate, long-term, intended, and unintended outcomes of specific features of managed care.
Conclusions
Managed care plan restrictiveness does not appear to be affecting the delivery of primary care as measured from the perspective of the patient. However, the financial and organizational restrictiveness of managed care plans does lead to greater clinician hassle. We interpret these results to suggest that primary care clinicians are able to effectively buffer the effects of health plan structure on their patients. These findings raise questions about the effect of plan restrictiveness on efficient use of clinician time and the clinician’s ability to continue to deliver quality primary care amidst competing administrative demands.
Acknowledgments
We would like to thank each of the participating ASPN practices, their staffs, and patients, without whom the study would not have been possible. The practices participating in this study included the following: Batesville Family Practice Clinic, Batesville, Arkansas; Loma Linda University, Department of Family Medicine, Loma Linda, California; C. Frazer Shipman, Wheatridge, Colorado; The Family Medical Group, Bristol, Connecticut; St. John’s Mercy Family Medicine, St. Louis, Missouri; Manchester Family Health Center, Manchester, New Hampshire; Primary Care Center at Hillsborough, Belle Mead, New Jersey, and Family Medicine at Monument Square, New Brunswick, New Jersey; Central Square Health Services Center, Central Square, New York; Enid Family Medicine Clinic, Enid, Oklahoma; Good Samaritan Family Practice, ELCO, Lebanon, Pennsylvania; Michael Hartsell, MD, Greeneville, Tennessee; Annadale Family Medicine, PC, Annadale, Virginia, and Tappahannack Family Practice, Tappahannack, Virginia; and Cle Elum Family Medicine Center, Cle Elum, Washington.
Thanks to each of the ASPN Managed Care Task Force members who developed the Managed Care Survey and pilot tested the project instruments and protocol: A. John Orzano, MD; H. Andrew Selinger, MD; Robert James, MD; William Fosmire, MD; Linda French, MD; Frank Reed, MD; John Scott, MD; and Dennis de Leon, MD.
METHODS: We conducted a cross-sectional study of 15 member practices of the Ambulatory Sentinel Practice Network selected to represent diverse health care markets. Each practice completed a Managed Care Survey to characterize the degree of organizational and financial restrictiveness for each individual health care plan. A total of 199 managed care plans were characterized. Then, 1475 consecutive outpatients completed a patient survey that included: the Components of Primary Care Instrument as a measure of attributes of primary care; a measure of the amount of inconvenience involved with using the health care plan; and the Medical Outcomes Study Visit Rating Form for assessing patient satisfaction.
RESULTS: Clinicians’ reports of inconvenience were significantly associated (P <.001) with the financial and organizational restrictiveness scores of the plan. There was no association between plan restrictiveness and patient report of multiple aspects of the delivery of primary care or patient satisfaction with the visit.
CONCLUSIONS: Plan restrictiveness is associated with greater perceived hassle for clinicians but not for patients. Plan restrictiveness seems to be creating great pressures for clinicians, but is not affecting patients’ reports of the quality of important attributes of primary care or satisfaction with the visit. Physicians and their staffs appear to be buffering patients from the potentially negative effects of plan restrictiveness.
Managed care has become the predominant approach to health care financing in the United States.1 This explosive growth has been accompanied by an increasingly complex array of types of managed care plans and a growth in the use of restrictions and financial incentives to influence physician practice behavior.2 Contributing to the diversity and complexity of managed care are new incentive systems, strategies to manage patterns of care,3,4 and a shift toward national investor-owned plans. In addition, many practicing physicians are participating in new business relationships, including physician hospital organizations, medical service organizations, and risk-sharing arrangements. The treatment of all managed care plans as a single entity for comparison with fee-for-service plans is no longer adequate to capture the effect of the health care context on the delivery of care or health outcomes.5 A typology of features that represents a plan’s organizational and incentive features would facilitate understanding of what specific aspects affect outcomes of care across the nation.6,7 The Managed Care Survey was developed for use in this study to build on previous work by measuring specific attributes of different managed care plans that may affect both physician and patient outcomes.
Managed care organizations traditionally position primary care clinicians as the cornerstones of their delivery system8; however, the effect of the restrictiveness of managed care plans on the patient-physician relationship and the delivery of important attributes of primary care (as described by the Institute of Medicine9) are poorly understood. A common assumption is that managed care fosters primary care because of its gatekeeper and first-contact functions.8 Since health systems organized around primary care have been shown to have better population-level outcomes,10 one might expect similar results from managed care systems.11-13 Several aspects of the current competitive managed care marketplace, however, do not appear to be conducive to achieving the goals of primary care.14,15 The restrictions on clinicians’ and patients’ choices have raised concerns about the potential detrimental effect of managed care on the patient-physician relationship.16 In addition, the practice of annual re-bidding of managed care contracts can cause a forced disruption in continuity of care17 with detrimental effects on patients.15,18 For these reasons, the Institute of Medicine recommends monitoring the performance of health care systems to assess the adequacy of the delivery of attributes of primary care.9
The restrictions and incentives imposed by managed care organizations that are designed to modify physician practice behavior may inadvertently effect other valued aspects of patient care. The purpose of our study is to evaluate the association of managed care restrictiveness with specific attributes of primary care, visit-based patient satisfaction, and perceived inconvenience (or “hassle”) of using the plan.
Methods
Study Design, Sites, and Sample
A cross-sectional design was used to collect data from 15 member practices of the Ambulatory Sentinel Practice Network (ASPN). ASPN, composed of 752 community-based practicing clinicians, was established in 1982 to conduct practice-based research. Its 122 practices in 34 states have been shown to serve a nationally representative patient population and provide access to health care markets with a wide range of penetration and maturity of managed care.19 We solicited volunteer practice sites and chose 15 US ASPN sites to represent high-, medium-, and low-levels of managed care penetration in both urban and rural areas. Clinician and practice characteristics, including the clinicians’ estimate of the proportion of managed care in the practice, were obtained from the ASPN member database, which is updated annually. All 15 sites that were invited to participate in the study agreed to complete it.
Data Collection
The ASPN central office recruited and trained participating practice personnel and coordinated project implementation. Between April and August 1997, practices were sent explicit protocol instructions and copies of the Managed Care Survey and the patient survey and were instructed to choose a start date for administering surveys to 50 consecutive patients of each participating clinician. Patients were asked to complete the survey before leaving the office. A preassigned number corresponding to the patient’s insurance plan was written on the survey before it was given to the patient. The staff also kept track of the age, sex, and insurance plan of those patients who declined to participate, so that any nonparticipation bias could be evaluated.
In addition, for each practice a single Managed Care Survey was completed jointly by a physician and office manager to characterize each individual managed care health care plan with a minimum of 5% of all patients. Each insurance plan on the survey was identified by the same number that was used on the corresponding individual patients’ health care plans on the patient survey.
Measures
Managed care was conceptualized as a set of organizational restraints and financial incentives that are intended to focus and limit clinicians’ use of health care resources. The Managed Care Survey was designed to characterize managed care plans along several dimensions. The survey was developed by the ASPN Task Force on Managed Care, which consisted of 6 family physicians from the United States and 1 from Canada representing diversity in gender, geographic location, organization of practice, managed care market, and years in practice. Group consensus was used to identify and define the key managed care features that represent organizational restraints, financial incentives, and other aspects affecting the restrictiveness of plans.
The plan features measured by the managed care survey included the proportion of each practice’s patients in the plan, the plan’s financial restrictiveness and organizational restrictiveness, and the level of hassle associated with it. The financial restrictiveness portion of the survey included the type of reimbursement (capitation global risk, capitation professional risk, capitation primary care risk, discounted fee-for-service, or fee-for-service) and whether the plan carried a clinician-withhold fund or an incentive-bonus fund. The organizational restrictiveness part of the survey included plan characterization on the following features: mental health carve-out, laboratory services, formulary, preauthorization for diagnostic or treatment procedures, preauthorization for physician referrals, specialty network, and procedure (site of service) constraints. The managed care survey features and their definitions are listed in Appendix A.*
Some plan features were viewed as more important than others for describing a plan’s financial and organizational restrictiveness. Each member of the ASPN Managed Care Task Force assigned a value of importance for each feature (using a Likert scale where 1 = somewhat important; 10 = very important). The group mean assigned weight for each feature was used to calculate the 2 weighted summary scores representing the financial and organizational restrictiveness of each plan.
In addition to the managed care plan features, clinicians completing the survey were asked to rate the degree of hassle, defined as the degree of time-consuming interference with routine practice activities perceived to be associated with the plan, on a scale of 1 to 5. Additional items on the Managed Care Survey included questions about the type of practice (solo, multispecialty group, and so forth), political/business affiliations, recent mergers/buyouts, and type of clinician compensation.
The attributes of delivery of primary care were measured by the revised Components of Primary Care Instrument (CPCI)20,21 which measures key attributes of the patient-provider relationship based on the recent Institute of Medicine definition of primary care.9 The CPCI assesses interpersonal communication, comprehensive care, continuity of care, coordination of care, provider’s accumulated knowledge about the patient, family orientation, community orientation, advocacy, and patient preference for their usual provider. Each attribute is measured from the patient’s perspective of the patient-provider relationship. Descriptive statistics, internal consistency reliabilities, and scale content are displayed in Appendix B.* Missing data on the CPCI scale scores were handled by setting a maximum number of missing values allowed per scale and computing a score using individual responses to the remaining scale items. Questionnaires missing more data than the maximum allowed were given no score for that scale. Therefore, the total number of patients with complete data per scale, and the sample size for analyses, varies by scale.
Patient satisfaction with the visit was measured using the Medical Outcomes Study 9-Item Visit Rating Form.22 Two scores were computed, patient satisfaction with the physician and with practice operation.23 Another specific patient item (satisfaction with the amount of time spent with the physician) was also assessed separately. Eight items were written to assess the patient’s perceived hassle in obtaining health care, and a summary scale score was computed (internal consistency reliability = .80). Additional items on the patient survey included patient age, sex, 2 reports of health status, whether today’s physician is the patient’s regular physician, and if no, whether the patient’s regular physician is a member of the office. Standard demographic items were included on the abbreviated survey for new patients. Also included were questions regarding whether that visit was for well-care or serious illness, and whether they had been forced to change physicians in the past 2 years.
Analyses
Data from the Managed Care Survey and the patient survey were linked by a unique identifier on the basis of site and site-specific health care plan. Patient surveys that could not be linked (eg, because of a missing plan identifier or because the plan was not rated on the Managed Care Survey) were included in the descriptive statistics of the study sample, but are excluded from the analyses involving the managed care features. Descriptive statistics of the sites, clinicians, and plan features are calculated. We used chi-square tests to compare the data available from the nonresponders with the data from the responders to assess bias.
We used the Pearson correlation to test the association of the plans’ financial and organizational restrictiveness scores with the clinicians’ reports of hassle. The association of the managed care plan restrictiveness scores with each of the CPCI scale scores, patient satisfaction with the visit, and patient perceived hassle was tested with multilevel modeling techniques using hierarchical linear regression software.24 Multilevel modeling is an analysis technique that accounts for the nested structural context of the data. Two potential confounding variables, patient age and health status, were included as covariates in these analyses.
Results
All 15 sites returned a completed Managed Care Survey. Practice characteristics are displayed in Table 1. One fourth of the practices had experienced a recent professional merger and one third had undergone a recent purchase or buyout. The average number of managed care plans in each practice ranged from 1 to 25, with an average of 13.3 plans. The average proportion of patients in a managed care plan per site was 51% (range = 21% to 100%). The 41 clinicians participating in the study are characterized in Table 2. The vast majority of clinicians had MD degrees, and 66% were men. On average, clinicians spent 90% of their time on patient care.
The patient response rate was also excellent. Of the 1922 patients approached, 1839 (96%) agreed to complete the patient survey. One hundred and six patients returned a blank survey and represent passive refusers. Of the 1733 patients returning a survey at least partially completed, 1503 were established patients, and 230 were new patients. Twenty-eight established patients did not see their regular physician, and that physician was not a member of the office they were visiting that day. These patients were excluded, bringing the final patient sample size to 1475.
Patient characteristics are reported in Table 3. The majority of patients were women, and health status, on average, was good. Most patients (84%) saw their regular physician, approximately half had a well-care visit within the past 2 years, and approximately one fourth were treated for a serious illness within the past 2 years. Fifty-nine percent of established patients had some type of managed care insurance. Standard Medicare and Medicaid insurance accounted for 21% of patients, and only 11% were categorized as having traditional commercial insurance. Established patients who declined to complete the patient survey (n = 41) were similar in average age and type of insurance but were more likely to be men than the patients who completed the survey.
Table 1, Table 4 displays the frequency of the different managed care features measured by the Managed Care Survey. Laboratory services, preauthorization, specialty networks, and site of service were features of more than 50% of the 199 managed care plans characterized. Physicians rated plans with a restrictive feature as generating greater hassle on average than plans without restrictive features. The 2 exceptions to this trend were plans with point-of-service and withhold features.
We investigated the association of managed care plan restrictiveness with each of the CPCI scale scores and patient satisfaction with the visit. Of the 870 patients with a type of managed care insurance, 786 patients had complete data for this analysis. For ease of interpretation, the managed care restrictiveness scores were divided into low (27%), medium (46%), and high (27%).25 This categorization of the restrictiveness scores has 3 advantages: interpretation of 3 group means versus a b coefficient is easier; a nonlinear association is readily determined; and the distributions of the outcome measure for the high and low groups can be shown to be nonoverlapping. If no statistically significant difference is found between these 2 distinctly different extreme groups, this can be taken as evidence for not rejecting the null hypothesis of no association.
As indicated in Table 5, the mean of the different CPCI, hassle, and patient satisfaction scores were very similar across each level of managed care plan financial restrictiveness. Similarly, organizational restrictiveness was not significantly associated with any of the CPCI scale scores, patient report of hassle, or the satisfaction scores. These analyses were adjusted for patient age and health status and the nested effect of the data.
Discussion
We used innovative measures and a unique practice-based laboratory to assess the impact of specific aspects of managed care on the delivery of important attributes of primary care. The findings suggest that the restrictiveness of managed care plans does not affect patients’ perceptions of multiple attributes of primary care or their satisfaction with the visit. However, both financial and organizational restrictiveness were associated with greater clinician-reported hassle. These findings may not conform to the widespread belief by practicing clinicians that plan characteristics affect patients in a direct way,8,26 and clinicians may be reassured to find that they are able to maintain good primary care relationships with patients amidst the challenges they experience.
Clinician hassle was rated in terms of the time required for insurance-mandated administrative activities generated by the plan (eg, the length and repetition of required forms and written or verbal requirements). Other studies have reported specific physician-reported hassles associated with particular plans.8,27 Most of the hassles can be attributed to an added administrative burden, such as the need to make phone calls, write letters, and gather information from medical records in response to denial of payment, requests for patient information, or precertification of services.27 Our findings that clinicians reported increased administrative burden with more restrictive plans reinforce the idea by Freberg28 that it is difficult to know whether managed care plans are cost effective or merely add to the hidden cost of administrative overhead. Future studies should investigate the amount of effort required for additional administrative burdens relative to the cost savings of the plan.
The lack of association between patient-perceived hassle and plan restrictiveness indicates that the burdens of plan restrictiveness fall squarely on the shoulders of clinicians and staff. It is also likely that patients who are less concerned about plan restrictions may have self-selected a restrictive plan for cost savings or other perceived benefits. For these patients, the benefits (eg, lower deductibles, coverage of health maintenance visits) may outweigh the disadvantages (eg, restricted freedom of choice, increased personal cost incurred to opt for out-of-plan services).
Concerns have been raised about conflict of interest, the effect of financial incentives on physician behavior, the quality of the patient-physician relationship and decision making, time constraints, and the potential for underservice with managed care systems.16,26,29-34 Grumbach and colleagues26 found that 57% of physicians surveyed reported that they felt pressure from the managed care organization to limit referrals; 75% felt pressure to see more patients per day; and 17% and 24%, respectively, felt that limiting referrals and seeing more patients per day compromised patient care. In our study, patients in highly restrictive managed care plans did not perceive their physician to be any less of an advocate for their health care than patients in the low- or medium-restrictiveness groups. Thus, this sample of primary care clinicians continued to engage in trusting relationships with their patients despite the potential conflict of interest that could arise from managed care plans’ financial incentives to restrict care.
In our sample of patients, as well as in others,21 the CPCI assessed important aspects of primary care with good internal consistency. The instrument’s scale scores have been shown to be associated with patient satisfaction21 and delivery of preventive services,35 and have been shown to detect differences in the delivery of primary care to patients who faced forced discontinuity of care and those who remained with their regular physician.15 The CPCI should be sensitive to many of the potential ill effects of managed care on the patient-physician relationship and delivery of primary care. The lack of association between plan restrictiveness and patient report of primary care is striking, and there is strong evidence that the clinicians and office staff who report being hassled by these restrictions are not allowing those hassles to interfere with their delivery of patient care.
Others26 have evaluated physician satisfaction with specific plan features and physician-rated quality of specific health care plans.36 We asked physicians to objectively report the presence or absence of specific organizational and financial features of each of the managed care plans in their practices. Using the Managed Care Survey to characterize specific organizational and financial aspects of plans is a major advance in being able to test the importance of these features on physician behavior and processes of care and patient outcomes.
Limitations
The main potential threat to the internal validity of the study is patient nonresponse. The nonrespondents were more likely to be men than patients who completed the survey. It is possible that these patients may have been less satisfied with care and may have reported lower scores on the CPCI. However, nonrespondents represent only 10% of those approached, and it is unlikely that the findings of the study would have changed if they had been included. We are also unable to comment on how long a patient had been with their current insurance plan. Length of exposure and actual experience with the features of a plan could potentially affect the association of plan restrictiveness with perceived delivery of primary care. However, consecutive patients were enrolled, which should reduce the likelihood of a selection bias of such a variable.
Replication of this study in a larger number of community-based practice sites and in a general community sample would add to the generalizability of the findings. In these times of increased business interest in medicine,37 it is important to continue to monitor and evaluate the immediate, long-term, intended, and unintended outcomes of specific features of managed care.
Conclusions
Managed care plan restrictiveness does not appear to be affecting the delivery of primary care as measured from the perspective of the patient. However, the financial and organizational restrictiveness of managed care plans does lead to greater clinician hassle. We interpret these results to suggest that primary care clinicians are able to effectively buffer the effects of health plan structure on their patients. These findings raise questions about the effect of plan restrictiveness on efficient use of clinician time and the clinician’s ability to continue to deliver quality primary care amidst competing administrative demands.
Acknowledgments
We would like to thank each of the participating ASPN practices, their staffs, and patients, without whom the study would not have been possible. The practices participating in this study included the following: Batesville Family Practice Clinic, Batesville, Arkansas; Loma Linda University, Department of Family Medicine, Loma Linda, California; C. Frazer Shipman, Wheatridge, Colorado; The Family Medical Group, Bristol, Connecticut; St. John’s Mercy Family Medicine, St. Louis, Missouri; Manchester Family Health Center, Manchester, New Hampshire; Primary Care Center at Hillsborough, Belle Mead, New Jersey, and Family Medicine at Monument Square, New Brunswick, New Jersey; Central Square Health Services Center, Central Square, New York; Enid Family Medicine Clinic, Enid, Oklahoma; Good Samaritan Family Practice, ELCO, Lebanon, Pennsylvania; Michael Hartsell, MD, Greeneville, Tennessee; Annadale Family Medicine, PC, Annadale, Virginia, and Tappahannack Family Practice, Tappahannack, Virginia; and Cle Elum Family Medicine Center, Cle Elum, Washington.
Thanks to each of the ASPN Managed Care Task Force members who developed the Managed Care Survey and pilot tested the project instruments and protocol: A. John Orzano, MD; H. Andrew Selinger, MD; Robert James, MD; William Fosmire, MD; Linda French, MD; Frank Reed, MD; John Scott, MD; and Dennis de Leon, MD.
1. KPMG Peat Marwick. Executive summary. Health benefits in 1995. Minneapolis, Minn: KPMG Peat Marwick; 1995.
2. Schoen C. Managed care: a national experiment. Unanswered questions and potential risks. Bull NY Acad Med 1995;72:645-56.
3. Gold MR, Hurley R, Lake T, Ensor T, Berenson R. A national survey of the arrangements managed care plans make with physicians. N Engl J Med 1995;333:1678-83.
4. Kane N, Turnbull T, Schoen C. Case studies of IPA and network HMOs: report to the Commonwealth Fund; 1995.
5. Davis K. The culture of managed care: implications for patients. Bull NY Acad Med 1996;73:179.-
6. Welch WP, Hillman AL, Pauly MV. Toward new typologies for HMOs. Milbank Q 1990;68:221-43.
7. Landon BE, Wilson IB, Cleary PD. A conceptual model of the effects of health care organizations on the quality of medical care. JAMA 1998;279:1377-82.
8. Halm EA, Causino N, Blumenthal D. Is gatekeeping better than traditional care? A survey of physician’s attitudes. JAMA 1997;278:1677-81.
9. Donaldson MS. YK, Lohr KN, Vanselow NA, eds. Primary care: America’s health in a new era. Washington D.C.: National Academy Press; 1996.
10. Starfield B. Primary care: concept, evaluation, and policy. New York, NY: Oxford University Press; 1992.
11. Franks P, Clancy CM, Nutting PA. Gatekeeping revisited: protecting patients from overtreatment. N Engl J Med 1992;327:424-7.
12. Greenfield S, Rogers W, Mangotich M, Carney MF, Tarlov AR. Outcomes of patients with hypertension and non-insulin-dependent diabetes mellitus treated by different systems and specialties: results from the medical outcomes study. JAMA 1995;274:1436-44.
13. Starfield B. Primary care: participants or gatekeepers? Diabetes Care 1994;17:12-7.
14. Blumenthal D, Mort E, Edwards J. The efficacy of primary care for vulnerable population groups. Health Serv Res 1995;30:253-73.
15. Flocke SA, Stange KC, Zyzanski SJ. The impact of insurance type and forced discontinuity on the delivery of primary care. J Fam Pract 1997;45:129-35.
16. Emanuel EJ, Dubler NN. Preserving the physician-patient relationship in the era of managed care. JAMA 1995;273:323-9.
17. Davis K, Collins KS, Schoen C, Morris C. Choice matters: Enrollees’ views of their health plans. Health Aff 1995;14:100-12.
18. Kahana E, Stange KC, Meehan R, Raff L. Forced disruption in continuity of primary care: the patients’ perspective. Sociological Focus 1997;30:172-82.
19. Green LA, Miller RS, Reed FM, Iverson DC, Barley GE. How representative of typical practice are practice-based research networks? A report from the Ambulatory Sentinel Practice Network (ASPN). Arch Fam Med 1993;2:939-49.
20. Flocke SA. Primary care instrument [letter]. J Fam Pract 1998;46:12.-
21. Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract 1997;45:64-74.
22. Rubin H, Gandek B, Roger WH, Kisinski M, McHorney C, Ware J. Patients’ ratings of outpatient visits in different practice settings. JAMA 1993;270:835-40.
23. Stange KC, Zyzanski SJ, Jaen CR, et al. Illuminating the black box: a description of 4454 patient visits to 138 family physicians. J Fam Pract 1998;46:377-89.
24. Bryk AS, Raudenbush SW. Hierarchical linear models: applications and data analysis methods. Newbury Park, Calif: Sage Publications; 1992.
25. Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psych 1939;30:17-24.
26. Grumbach K, Osmond D, Vranizan K, Jaffe D, Bindman AB. Primary care physicians’ experience of financial incentives in managed-care systems. N Engl J Med 1998;339:1516-21.
27. Texas Medical Association. TMA updates hassle factor log form. Tex Med 1993;89:22-4.
28. Freberg GW. Managed care: ‘the hassle factor,’ by choice or coercion. Conn Med 1992;56:203-6.
29. Collins KS, Schoen C, Sandman DR. The commonwealth fund survey of physician experiences with managed care. New York, NY: The Commonwealth Fund; 1997.
30. Kassirer JP. Managed care and the morality of the marketplace. N Engl J Med 1995;333:50-52.
31. Glass RM. The patient-physician relationship. JAMA 1996;275:147-8.
32. Orentlicher D. Health care reform and the patient-physician relationship. Health Matrix 1995;5:141-80.
33. Hillman AL. Financial incentives for physicians in HMOs: Is there a conflict of interest? N Engl J Med 1987;317:1743-8.
34. Council on Ethical and Judicial Affairs AMA. Ethical issues in managed care. JAMA 1995;273:330-5.
35. Flocke SA, Stange KC, Zyzanski SJ. The association of attributes of primary care with preventive service delivery. Med Care 1997;36:AS21-30.
36. Borowsky SJ, Davis MK, Goertz C, Lurie N. Are all health plans created equal? JAMA 1997;278:917-21.
37. Lundburg GD. The failure of organized health system reform: now what? JAMA 1995;273:1539-41.
1. KPMG Peat Marwick. Executive summary. Health benefits in 1995. Minneapolis, Minn: KPMG Peat Marwick; 1995.
2. Schoen C. Managed care: a national experiment. Unanswered questions and potential risks. Bull NY Acad Med 1995;72:645-56.
3. Gold MR, Hurley R, Lake T, Ensor T, Berenson R. A national survey of the arrangements managed care plans make with physicians. N Engl J Med 1995;333:1678-83.
4. Kane N, Turnbull T, Schoen C. Case studies of IPA and network HMOs: report to the Commonwealth Fund; 1995.
5. Davis K. The culture of managed care: implications for patients. Bull NY Acad Med 1996;73:179.-
6. Welch WP, Hillman AL, Pauly MV. Toward new typologies for HMOs. Milbank Q 1990;68:221-43.
7. Landon BE, Wilson IB, Cleary PD. A conceptual model of the effects of health care organizations on the quality of medical care. JAMA 1998;279:1377-82.
8. Halm EA, Causino N, Blumenthal D. Is gatekeeping better than traditional care? A survey of physician’s attitudes. JAMA 1997;278:1677-81.
9. Donaldson MS. YK, Lohr KN, Vanselow NA, eds. Primary care: America’s health in a new era. Washington D.C.: National Academy Press; 1996.
10. Starfield B. Primary care: concept, evaluation, and policy. New York, NY: Oxford University Press; 1992.
11. Franks P, Clancy CM, Nutting PA. Gatekeeping revisited: protecting patients from overtreatment. N Engl J Med 1992;327:424-7.
12. Greenfield S, Rogers W, Mangotich M, Carney MF, Tarlov AR. Outcomes of patients with hypertension and non-insulin-dependent diabetes mellitus treated by different systems and specialties: results from the medical outcomes study. JAMA 1995;274:1436-44.
13. Starfield B. Primary care: participants or gatekeepers? Diabetes Care 1994;17:12-7.
14. Blumenthal D, Mort E, Edwards J. The efficacy of primary care for vulnerable population groups. Health Serv Res 1995;30:253-73.
15. Flocke SA, Stange KC, Zyzanski SJ. The impact of insurance type and forced discontinuity on the delivery of primary care. J Fam Pract 1997;45:129-35.
16. Emanuel EJ, Dubler NN. Preserving the physician-patient relationship in the era of managed care. JAMA 1995;273:323-9.
17. Davis K, Collins KS, Schoen C, Morris C. Choice matters: Enrollees’ views of their health plans. Health Aff 1995;14:100-12.
18. Kahana E, Stange KC, Meehan R, Raff L. Forced disruption in continuity of primary care: the patients’ perspective. Sociological Focus 1997;30:172-82.
19. Green LA, Miller RS, Reed FM, Iverson DC, Barley GE. How representative of typical practice are practice-based research networks? A report from the Ambulatory Sentinel Practice Network (ASPN). Arch Fam Med 1993;2:939-49.
20. Flocke SA. Primary care instrument [letter]. J Fam Pract 1998;46:12.-
21. Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract 1997;45:64-74.
22. Rubin H, Gandek B, Roger WH, Kisinski M, McHorney C, Ware J. Patients’ ratings of outpatient visits in different practice settings. JAMA 1993;270:835-40.
23. Stange KC, Zyzanski SJ, Jaen CR, et al. Illuminating the black box: a description of 4454 patient visits to 138 family physicians. J Fam Pract 1998;46:377-89.
24. Bryk AS, Raudenbush SW. Hierarchical linear models: applications and data analysis methods. Newbury Park, Calif: Sage Publications; 1992.
25. Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psych 1939;30:17-24.
26. Grumbach K, Osmond D, Vranizan K, Jaffe D, Bindman AB. Primary care physicians’ experience of financial incentives in managed-care systems. N Engl J Med 1998;339:1516-21.
27. Texas Medical Association. TMA updates hassle factor log form. Tex Med 1993;89:22-4.
28. Freberg GW. Managed care: ‘the hassle factor,’ by choice or coercion. Conn Med 1992;56:203-6.
29. Collins KS, Schoen C, Sandman DR. The commonwealth fund survey of physician experiences with managed care. New York, NY: The Commonwealth Fund; 1997.
30. Kassirer JP. Managed care and the morality of the marketplace. N Engl J Med 1995;333:50-52.
31. Glass RM. The patient-physician relationship. JAMA 1996;275:147-8.
32. Orentlicher D. Health care reform and the patient-physician relationship. Health Matrix 1995;5:141-80.
33. Hillman AL. Financial incentives for physicians in HMOs: Is there a conflict of interest? N Engl J Med 1987;317:1743-8.
34. Council on Ethical and Judicial Affairs AMA. Ethical issues in managed care. JAMA 1995;273:330-5.
35. Flocke SA, Stange KC, Zyzanski SJ. The association of attributes of primary care with preventive service delivery. Med Care 1997;36:AS21-30.
36. Borowsky SJ, Davis MK, Goertz C, Lurie N. Are all health plans created equal? JAMA 1997;278:917-21.
37. Lundburg GD. The failure of organized health system reform: now what? JAMA 1995;273:1539-41.