Latha Sivaprasad, MD https://ma1.mdedge.com/ en Stat Laboratory Order Feedback https://ma1.mdedge.com/content/stat-laboratory-order-feedback <span property="schema:name" class="field field--name-title field--type-string field--label-hidden">Stat Laboratory Order Feedback</span> <span rel="schema:author" class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/users/content-migration" typeof="schema:Person" property="schema:name" datatype="">Content Migration</span></span> <span property="schema:dateCreated" content="2013-12-12T05:00:00+00:00" class="field field--name-created field--type-created field--label-hidden">Thu, 12/12/2013 - 00:00</span> <div class="layout layout--onecol"> <div class="layout__region layout__region--content"> <div class="block block-layout-builder block-field-blocknodearticlefield-article-type"> <div class="field field--name-field-article-type field--type-entity-reference field--label-above"> <div class="field__label">Article Type</div> <div class="field__item"><a href="/article-type/article" hreflang="en">Article</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlechanged"> <div class="field field--name-changed field--type-changed field--label-inline clearfix"> <div class="field__label">Changed</div> <div class="field__item">Sun, 05/21/2017 - 17:23</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">The assessment of stat laboratory test ordering practice and impact of targeted individual feedback in an urban teaching hospital</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-inline clearfix"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/atsushi-sorita-md" hreflang="en">Atsushi Sorita, MD</a></div> <div class="field__item"><a href="/authors/daniel-i-steinberg-md" hreflang="en">Daniel I. Steinberg, MD</a></div> <div class="field__item"><a href="/authors/michael-leitman-md" hreflang="en">Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/alfred-burger-md" hreflang="en">Alfred Burger, MD</a></div> <div class="field__item"><a href="/authors/gregg-husk-md" hreflang="en">Gregg Husk, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="jhm2108-sec-0007"><p>Overuse of inpatient stat laboratory orders (stat is an abbreviation of the Latin word <em>statim</em>, meaning immediately, without delay; alternatively, some consider it an acronym for short turnaround time) is a major problem in the modern healthcare system.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0001">1</a>, <a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>, <a class="ref-link-bib" href="#jhm2108-bib-0003">3</a>, <a class="ref-link-bib" href="#jhm2108-bib-0004">4</a>, <a class="ref-link-bib" href="#jhm2108-bib-0005">5</a>]</span> Ordering laboratory tests stat is a common way to expedite processing, with expectation of results being reported within 1 hour from the time ordered, according to the College of American Pathologists.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0006">6</a>]</span> However, stat orders are also requested for convenience,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>]</span> to expedite discharge,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> or to meet expectation of turnaround times.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0008">8</a>, <a class="ref-link-bib" href="#jhm2108-bib-0009">9</a>, <a class="ref-link-bib" href="#jhm2108-bib-0010">10</a>]</span> Overuse of stat orders increases cost and may reduce the effectiveness of a system. Reduction of excessive stat order requests helps support safe and efficient patient care<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0011">11</a>, <a class="ref-link-bib" href="#jhm2108-bib-0012">12</a>]</span> and may reduce laboratory costs.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>, <a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>]</span></p><p>Several studies have examined interventions to optimize stat laboratory utilization.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>, <a class="ref-link-bib" href="#jhm2108-bib-0015">15</a>]</span> Potentially effective interventions include establishment of stat ordering guidelines, utilization of point‐of‐care testing, and prompt feedback via computerized physician order entry (CPOE) systems.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0016">16</a>, <a class="ref-link-bib" href="#jhm2108-bib-0017">17</a>, <a class="ref-link-bib" href="#jhm2108-bib-0018">18</a>]</span> However, limited evidence is available regarding the effectiveness of audit and feedback in reducing stat ordering frequency.</p><p>Our institution shared the challenge of a high frequency of stat laboratory test orders. An interdisciplinary working group comprising leadership in the medicine, surgery, informatics, laboratory medicine, and quality and patient safety departments was formed to approach this problem and identify potential interventions. The objectives of this study are to describe the patterns of stat orders at our institution as well as to assess the effectiveness of the targeted individual feedback intervention in reducing utilization of stat laboratory test orders.</p></section><section id="jhm2108-sec-0008"><h3 class="main">METHODS</h3><section id="jhm2108-sec-0009"><h3 class="main">Design</h3><p>This study is a retrospective analysis of administrative data for a quality‐improvement project. The study was deemed exempt from review by the Beth Israel Medical Center Institutional Review Board.</p></section><section id="jhm2108-sec-0010"><h3 class="main">Setting</h3><p>Beth Israel Medical Center is an 856‐bed, urban, tertiary‐care teaching hospital with a capacity of 504 medical and surgical beds. In October 2009, 47.8% of inpatient laboratory tests (excluding the emergency department) were ordered as stat, according to an electronic audit of our institution's CPOE system, GE Centricity Enterprise (GE Medical Systems Information Technologies, Milwaukee, WI). Another audit using the same data query for the period of December 2009 revealed that 50 of 488 providers (attending physicians, nurse practitioners, physician assistants, fellows, and residents) accounted for 51% of total stat laboratory orders, and that Medicine and General Surgery residents accounted for 43 of these 50 providers. These findings prompted us to develop interventions that targeted high utilizers of stat laboratory orders, especially Medicine and General Surgery residents.</p></section><section id="jhm2108-sec-0011"><h3 class="main">Teaching Session</h3><p>Medicine and General Surgery residents were given a 1‐hour educational session at a teaching conference in January 2010. At this session, residents were instructed that ordering stat laboratory tests was appropriate when the results were needed urgently to make clinical decisions as quickly as possible. This session also explained the potential consequences associated with excessive stat laboratory orders and provided department‐specific data on current stat laboratory utilization.</p></section><section id="jhm2108-sec-0012"><h3 class="main">Individual Feedback</h3><p>From January to May 2010, a list of stat laboratory orders by provider was generated each month by the laboratory department's database. The top 10 providers who most frequently placed stat orders were identified and given individual feedback by their direct supervisors based on data from the prior month (feedback provided from February to June 2010). Medicine and General Surgery residents were counseled by their residency program directors, and nontrainee providers by their immediate supervising physicians. Feedback and counseling were given via brief individual meetings, phone calls, or e‐mail. Supervisors chose the method that ensured the most timely delivery of feedback. Feedback and counseling consisted of explaining the effort to reduce stat laboratory ordering and the rationale behind this, alerting providers that they were outliers, and encouraging them to change their behavior. No punitive consequences were discussed; the feedback sessions were purely informative in nature. When an individual was ranked again in the top 10 after receiving feedback, he or she received repeated feedback.</p></section><section id="jhm2108-sec-0013"><h3 class="main">Data Collection and Measured Outcomes</h3><p>We retrospectively collected data on monthly laboratory test orders by providers from September 2009 to June 2010. The data were extracted from the electronic medical record (EMR) system and included any inpatient laboratory orders at the institution. Laboratory orders placed in the emergency department were excluded. Providers were divided into nontrainees (attending physicians, nurse practitioners, and physician assistants) and trainee providers (residents and fellows). Trainee providers were further categorized by educational levels (postgraduate year [PGY]‐1 vs PGY‐2 or higher) and specialty (Medicine vs General Surgery vs other). Fellows in medical and surgical subspecialties were categorized as other.</p><p>The primary outcome measure was the proportion of stat orders out of total laboratory orders for individuals. The proportion of stat orders out of total orders was selected to assess individuals' tendency to utilize stat laboratory orders.</p></section><section id="jhm2108-sec-0014"><h3 class="main">Statistical Analysis</h3><p>In the first analysis, stat and total laboratory orders were aggregated for each provider. Providers who ordered &lt;10 laboratory tests during the study period were excluded. We calculated the proportion of stat out of total laboratory orders for each provider, and compared it by specialty, by educational level, and by feedback status. Median and interquartile range (IQR) were reported due to non‐normal distribution, and the Wilcoxon rank‐sum test was used for comparisons.</p><p>In the second analysis, we determined pre‐feedback and post‐feedback periods for providers who received feedback. The feedback month was defined as the month immediately after a provider was ranked in the top 10 for the first time during the intervention period. For each provider, stat orders and total laboratory orders during months before and after the feedback month, excluding the feedback month, were calculated. The change in the proportion of stat laboratory orders out of all orders from pre‐ to post‐feedback was then calculated for each provider for whom both pre‐ and post‐feedback data were available. Because providers may have utilized an unusually high proportion of stat orders during the months in which they were ranked in the top 10 (for example, due to being on rotations in which many orders are placed stat, such as the intensive care units), we conducted a sensitivity analysis excluding those months. Further, for comparison, we conducted the same analysis for providers who did not receive feedback and were ranked 11 to 30 in any month during the intervention period. In those providers, we considered the month immediately after a provider was ranked in the 11 to 30 range for the first time as the hypothetical feedback month. The proportional change in the stat laboratory ordering was analyzed using the paired Student <em>t</em> test.</p><p>In the third analysis, we calculated the proportion of stat laboratory orders each month for each provider. Individual provider data were excluded if total laboratory orders for the month were &lt;10. We then calculated the average proportion of stat orders for each specialty and educational level among trainee providers every month, and plotted and compared the trends.</p><p>All analyses were performed with JMP software version 9.0 (SAS Institute, Inc., Cary, NC). All statistical tests were 2‐sided, and <em>P</em> &lt; 0.05 was considered significant.</p></section></section><section id="jhm2108-sec-0015"><h3 class="main">RESULTS</h3><p>We identified 1045 providers who ordered 1 laboratory test from September 2009 to June 2010. Of those, 716 were nontrainee providers and 329 were trainee providers. Among the trainee providers, 126 were Medicine residents, 33 were General Surgery residents, and 103 were PGY‐1. A total of 772,734 laboratory tests were ordered during the study period, and 349,658 (45.2%) tests were ordered as stat. Of all stat orders, 179,901 (51.5%) were ordered by Medicine residents and 52,225 (14.9%) were ordered by General Surgery residents.</p><p>Thirty‐seven providers received individual feedback during the intervention period. This group consisted of 8 nontrainee providers (nurse practitioners and physician assistants), 21 Medicine residents (5 were PGY‐1), and 8 General Surgery residents (all PGY‐1). This group ordered a total of 84,435 stat laboratory tests from September 2009 to June 2010 and was responsible for 24.2% of all stat laboratory test orders at the institution.</p><section id="jhm2108-sec-0016"><h3 class="main">Provider Analysis</h3><p>After exclusion of providers who ordered &lt;10 laboratory tests from September 2009 to June 2010, a total of 807 providers remained. The median proportion of stat orders out of total orders was 40% among all providers and 41.6% for nontrainee providers (N = 500), 38.7% for Medicine residents (N = 125), 80.2% for General Surgery residents (N = 32), and 24.2% for other trainee providers (N = 150). The proportion of stat orders differed significantly by specialty and educational level, but also even among providers in the same specialty at the same educational level. Among PGY‐1 residents, the stat‐ordering proportion ranged from 6.9% to 49.1% for Medicine (N = 54) and 69.0% to 97.1% for General Surgery (N = 16). The proportion of stat orders was significantly higher among providers who received feedback compared with those who did not (median, 72.4% [IQR, 55.0%89.5%] vs 39.0% [IQR, 14.9%65.7%], <em>P</em> &lt; 0.001). When stratified by specialty and educational level, the statistical significance remained in nontrainee providers and trainee providers with higher educational level, but not in PGY‐1 residents (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>).</p><table id="jhm2108-tbl-0001"><caption><label>Table 1.</label><span class="description">Proportion of Stat Laboratory Orders by Provider, Comparison by Feedback Status</span></caption><thead><tr class="valign-bottom"><th class="text-align-left"> </th><th class="text-align-center rowsep" colspan="2">All Providers</th><th class="text-align-center rowsep" colspan="2">Feedback Given</th><th class="text-align-center rowsep" colspan="2">Feedback Not Given</th><th class="text-align-left"> </th></tr><tr class="valign-bottom rowsep"><th class="text-align-left"> </th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center"><em>P</em> Value<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0002">a</a></span></th></tr></thead><tfoot><tr><td colspan="8"><ul><li id="jhm2108-note-0001"><p>NOTE: Values for Stat % are given as median (IQR). <b>Abbreviations:</b> IQR, interquartile range; PGY, postgraduate year; Stat, immediately.</p></li><li id="jhm2108-note-0002"><label>a</label><p><em>P</em> value is for comparison between providers who received feedback vs those who did not.</p></li><li id="jhm2108-note-0003"><label>b</label><p>Nontrainee providers are attending physicians, nurse practitioners, and physician assistants.</p></li><li id="jhm2108-note-0004"><label>c</label><p>Trainee providers are residents and fellows.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">807</td><td class="text-align-center">40 (15.869.0)</td><td class="text-align-center">37</td><td class="text-align-center">72.4 (55.089.5)</td><td class="text-align-center">770</td><td class="text-align-center">39.0 (14.965.7)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0003">b</a></span></td><td class="text-align-center">500</td><td class="text-align-center">41.6 (13.571.5)</td><td class="text-align-center">8</td><td class="text-align-center">91.7 (64.097.5)</td><td class="text-align-center">492</td><td class="text-align-center">40.2 (13.270.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0004">c</a></span></td><td class="text-align-center">307</td><td class="text-align-center">37.8 (19.162.7)</td><td class="text-align-center">29</td><td class="text-align-center">69.3 (44.380.9)</td><td class="text-align-center">278</td><td class="text-align-center">35.1 (17.655.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">125</td><td class="text-align-center">38.7 (26.850.4)</td><td class="text-align-center">21</td><td class="text-align-center">58.8 (36.872.6)</td><td class="text-align-center">104</td><td class="text-align-center">36.1 (25.945.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">54</td><td class="text-align-center">28.1 (23.935.2)</td><td class="text-align-center">5</td><td class="text-align-center">32.0 (25.536.8)</td><td class="text-align-center">49</td><td class="text-align-center">27.9 (23.534.6)</td><td class="text-align-center">0.52</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">71</td><td class="text-align-center">46.5 (39.160.4)</td><td class="text-align-center">16</td><td class="text-align-center">63.9 (54.575.7)</td><td class="text-align-center">55</td><td class="text-align-center">45.1 (36.554.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General surgery</td><td class="text-align-center">32</td><td class="text-align-center">80.2 (69.690.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">24</td><td class="text-align-center">78.7 (67.987.4)</td><td class="text-align-center">&lt;0.05</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">16</td><td class="text-align-center">86.4 (79.191.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">8</td><td class="text-align-center">84.0 (73.289.1)</td><td class="text-align-center">0.25</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">16</td><td class="text-align-center">74.4 (65.485.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Other</td><td class="text-align-center">150</td><td class="text-align-center">24.2 (9.055.0)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">31</td><td class="text-align-center">28.2 (18.478.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 or higher</td><td class="text-align-center">119</td><td class="text-align-center">20.9 (5.651.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr></tbody></table><section id="jhm2108-sec-0017"><h3 class="main">Stat Ordering Pattern Change by Individual Feedback</h3><p>Among 37 providers who received individual feedback, 8 providers were ranked in the top 10 more than once and received repeated feedback. Twenty‐seven of 37 providers had both pre‐feedback and post‐feedback data and were included in the analysis. Of those, 7 were nontrainee providers, 16 were Medicine residents (5 were PGY‐1), and 4 were General Surgery residents (all PGY‐1). The proportion of stat laboratory orders per provider decreased by 15.7% (95% confidence interval [CI]: 5.6% to 25.9%, <em>P</em> = 0.004) after feedback (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>). The decrease remained significant after excluding the months in which providers were ranked in the top 10 (11.4%; 95% CI: 0.7% to 22.1%, <em>P</em> = 0.04).</p><table id="jhm2108-tbl-0002"><caption><label>Table 2.</label><span class="description">Stat Laboratory Ordering Practice Changes Among Providers Receiving Feedback and Those Not Receiving Feedback</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left" rowspan="2"> </th><th class="text-align-center rowsep" colspan="5">Top 10 Providers (Received Feedback)</th><th class="text-align-center rowsep" colspan="5">Providers Ranked in 1130 (No Feedback)</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center">Pre</th><th class="text-align-center">Post</th><th class="text-align-center">Pre</th><th class="text-align-center">Post</th></tr></thead><tfoot><tr><td colspan="11"><ul><li id="jhm2108-note-0005"><p>NOTE: <b>Abbreviations:</b> CI, confidence interval; PGY, postgraduate year; Stat, immediately.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">27</td><td class="text-align-center">71.2</td><td class="text-align-center">55.5</td><td class="text-align-center">15.7 (25.9 to 5.6)</td><td class="text-align-center">0.004</td><td class="text-align-center">39</td><td class="text-align-center">64.6</td><td class="text-align-center">60.2</td><td class="text-align-center">4.5 (11.0 to 2.1)</td><td class="text-align-center">0.18</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers</td><td class="text-align-center">7</td><td class="text-align-center">94.6</td><td class="text-align-center">73.2</td><td class="text-align-center">21.4 (46.9 to 4.1)</td><td class="text-align-center">0.09</td><td class="text-align-center">12</td><td class="text-align-center">84.4</td><td class="text-align-center">80.6</td><td class="text-align-center">3.8 (11.9 to 4.3)</td><td class="text-align-center">0.32</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers</td><td class="text-align-center">20</td><td class="text-align-center">63.0</td><td class="text-align-center">49.3</td><td class="text-align-center">13.7 (25.6 to 1.9)</td><td class="text-align-center">0.03</td><td class="text-align-center">27</td><td class="text-align-center">55.8</td><td class="text-align-center">51.1</td><td class="text-align-center">4.7 (13.9 to 4.4)</td><td class="text-align-center">0.30</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">16</td><td class="text-align-center">55.8</td><td class="text-align-center">45.0</td><td class="text-align-center">10.8 (23.3 to 1.6)</td><td class="text-align-center">0.08</td><td class="text-align-center">21</td><td class="text-align-center">46.2</td><td class="text-align-center">41.3</td><td class="text-align-center">4.8 (16.3 to 6.7)</td><td class="text-align-center">0.39</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General Surgery</td><td class="text-align-center">4</td><td class="text-align-center">91.9</td><td class="text-align-center">66.4</td><td class="text-align-center">25.4 (78.9 to 28.0)</td><td class="text-align-center">0.23</td><td class="text-align-center">6</td><td class="text-align-center">89.6</td><td class="text-align-center">85.2</td><td class="text-align-center">4.4 (20.5 to 11.6)</td><td class="text-align-center">0.51</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐1</td><td class="text-align-center">9</td><td class="text-align-center">58.9</td><td class="text-align-center">47.7</td><td class="text-align-center">11.2 (32.0 to 9.5)</td><td class="text-align-center">0.25</td><td class="text-align-center">15</td><td class="text-align-center">55.2</td><td class="text-align-center">49.2</td><td class="text-align-center">6.0 (18.9 to 6.9)</td><td class="text-align-center">0.33</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐2 or Higher</td><td class="text-align-center">11</td><td class="text-align-center">66.4</td><td class="text-align-center">50.6</td><td class="text-align-center">15.8 (32.7 to 1.1)</td><td class="text-align-center">0.06</td><td class="text-align-center">12</td><td class="text-align-center">56.6</td><td class="text-align-center">53.5</td><td class="text-align-center">3.1 (18.3 to 12.1)</td><td class="text-align-center">0.66</td></tr></tbody></table><p>In comparison, a total of 57 providers who did not receive feedback were in the 11 to 30 range during the intervention period. Three Obstetrics and Gynecology residents and 3 Family Medicine residents were excluded from the analysis to match specialty with providers who received feedback. Thirty‐nine of 51 providers had adequate data and were included in the analysis, comprising 12 nontrainee providers, 21 Medicine residents (10 were PGY‐1), and 6 General Surgery residents (5 were PGY‐1). Among them, the proportion of stat laboratory orders per provider did not change significantly, with a 4.5% decrease (95% CI: 2.1% to 11.0%, <em>P</em> = 0.18; Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>).</p></section><section id="jhm2108-sec-0018"><h3 class="main">Stat Ordering Trends Among Trainee Providers</h3><p>After exclusion of data for the month with &lt;10 total laboratory tests per provider, a total of 303 trainee providers remained, providing 2322 data points for analysis. Of the 303, 125 were Medicine residents (54 were PGY‐1), 32 were General Surgery residents (16 were PGY‐1), and 146 were others (31 were PGY‐1). The monthly trends for the average proportion of stat orders among those providers are shown in Figure <span class="ref-link"><a class="ref-link-fig" href="#jhm2108-fig-0001">1</a></span>. The decrease in the proportion of stat orders was observed after January 2010 in Medicine and General Surgery residents both in PGY‐1 and PGY‐2 or higher, but no change was observed in other trainee providers.</p><div id="jhm2108-fig-0001"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/jhm2108-fig-0001-m.png" width="996" height="1083" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Monthly trends for the average proportion of stat orders among those providers. Abbreviations: PGY, postgraduate year; stat, immediately.</figcaption></figure></div></section></section></section><section id="jhm2108-sec-0019"><h3 class="main">DISCUSSION</h3><p>We describe a series of interventions implemented at our institution to decrease the utilization of stat laboratory orders. Based on an audit of laboratory‐ordering data, we decided to target high utilizers of stat laboratory tests, especially Medicine and General Surgery residents. After presenting an educational session to those residents, we gave individual feedback to the highest utilizers of stat laboratory orders. Providers who received feedback decreased their utilization of stat laboratory orders, but the stat ordering pattern did not change among those who did not receive feedback.</p><p>The individual feedback intervention involved key stakeholders for resident and nontrainee provider education (directors of the Medicine and General Surgery residency programs and other direct clinical supervisors). The targeted feedback was delivered via direct supervisors and was provided more than once as needed, which are key factors for effective feedback in modifying behavior in professional practice.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0019">19</a>]</span> Allowing the supervisors to choose the most appropriate form of feedback for each individual (meetings, phone calls, or e‐mail) enabled timely and individually tailored feedback and contributed to successful implementation. We feel intervention had high educational value for residents, as it promoted residents' engagement in proper systems‐based practice, one of the 6 core competencies of the Accreditation Council for Graduate Medical Education (ACGME).</p><p>We utilized the EMR to obtain provider‐specific data for feedback and analysis. As previously suggested, the use of the EMR for audit and feedback was effective in providing timely, actionable, and individualized feedback with peer benchmarking.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0020">20</a>, <a class="ref-link-bib" href="#jhm2108-bib-0021">21</a>]</span> We used the raw number of stat laboratory orders for audit and the proportion of stat orders out of total orders to assess the individual behavioral patterns. Although the proportional use of stat orders is affected by patient acuity and workplace or rotation site, it also seems largely affected by provider's preference or practice patterns, as we saw the variance among providers of the same specialty and educational level. The changes in the stat ordering trends only seen among Medicine and General Surgery residents suggests that our interventions successfully decreased the overall utilization of stat laboratory orders among targeted providers, and it seems less likely that those decreases are due to changes in patient acuity, changes in rotation sites, or learning curve among trainee providers. When averaged over the 10‐month study period, as shown in Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>, the providers who received feedback ordered a higher proportion of stat tests than those who did not receive feedback, except for PGY‐1 residents. This suggests that although auditing based on the number of stat laboratory orders identified providers who tended to order more stat tests than others, it may not be a reliable indicator for PGY‐1 residents, whose number of laboratory orders highly fluctuates by rotation.</p><p>There are certain limitations to our study. First, we assumed that the top utilizers were inappropriately ordering stat laboratory tests. Because there is no clear consensus as to what constitutes appropriate stat testing,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> it was difficult, if not impossible, to determine which specific orders were inappropriate. However, high variability of the stat ordering pattern in the analysis provides some evidence that high stat utilizers customarily order more stat testing as compared with others. A recent study also revealed that the median stat ordering percentage was 35.9% among 52 US institutions.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>]</span> At our institution, 47.8% of laboratory tests were ordered stat prior to the intervention, higher than the benchmark, providing the rationale for our intervention.</p><p>Second, the intervention was conducted in a time‐series fashion and no randomization was employed. The comparison of providers who received feedback with those who did not is subject to selection bias, and the difference in the change in stat ordering pattern between these 2 groups may be partially due to variability of work location, rotation type, or acuity of patients. However, we performed a sensitivity analysis excluding the months when the providers were ranked in the top 10, assuming that they may have ordered an unusually high proportion of stat tests due to high acuity of patients (eg, rotation in the intensive care units) during those months. Robust results in this analysis support our contention that individual feedback was effective. In addition, we cannot completely rule out the possibility that the changes in stat ordering practice may be solely due to natural maturation effects within an academic year among trainee providers, especially PGY‐1 residents. However, relatively acute changes in the stat ordering trends only among targeted provider groups around January 2010, corresponding to the timing of interventions, suggest otherwise.</p><p>Third, we were not able to test if the intervention or decrease in stat orders adversely affected patient care. For example, if, after receiving feedback, providers did not order some tests stat that should have been ordered that way, this could have negatively affected patient care. Additionally, we did not evaluate whether reduction in stat laboratory orders improved timeliness of the reporting of stat laboratory results.</p><p>Lastly, the sustained effect and feasibility of this intervention were not tested. Past studies suggest educational interventions in laboratory ordering behavior would most likely need to be continued to maintain its effectiveness.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0022">22</a>, <a class="ref-link-bib" href="#jhm2108-bib-0023">23</a>]</span> Although we acknowledge that sustainability of this type of intervention may be difficult, we feel we have demonstrated that there is still value associated with giving personalized feedback.</p><p>This study has implications for future interventions and research. Use of automated, EMR‐based feedback on laboratory ordering performance may be effective in reducing excessive stat ordering and may obviate the need for time‐consuming efforts by supervisors. Development of quality indicators that more accurately assess stat ordering patterns, potentially adjusted for working sites and patient acuity, may be necessary. Studies that measure the impact of decreasing stat laboratory orders on turnaround times and cost may be of value.</p></section><section id="jhm2108-sec-0020"><h3 class="main">CONCLUSION</h3><p>At our urban, tertiary‐care teaching institution, stat ordering frequency was highly variable among providers. Targeted individual feedback to providers who ordered a large number of stat laboratory tests decreased their stat laboratory order utilization.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-files"> <div class="field field--name-field-article-files field--type-file field--label-above"> <div class="field__label">Files</div> <div class="field__items"> <div class="field__item"> <span class="file file--mime-application-msword file--x-office-document"> <a href="https://cdn.mdedge.com/files/s3fs-public/journals/supporting/jhm2108-sup-0001-suppinfo.doc" type="application/msword">Supplementary Information (1)</a></span> </div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="jhm2108-bib-0001"><cite class="journal" id="ref-cit1"><span class="author">Jahn M</span>. <span class="articleTitle">Turnaround time, part 2: stats too high, yet labs cope</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">1993</span>;<span class="vol">25</span>(<span class="issue">9</span>):<span class="pageFirst">33</span>–<span class="pageLast">38</span>. </cite></li><li id="jhm2108-bib-0002"><cite class="journal" id="ref-cit2"><span class="author">Valenstein P</span>. <span class="articleTitle">Laboratory turnaround time</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">676</span>–<span class="pageLast">688</span>. </cite></li><li id="jhm2108-bib-0003"><cite class="journal" id="ref-cit3"><span class="author">Blick KE</span>. <span class="articleTitle">No more STAT testing</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">2005</span>;<span class="vol">37</span>(<span class="issue">8</span>):<span class="pageFirst">22</span>, 24, 26. </cite></li><li id="jhm2108-bib-0004"><cite class="journal" id="ref-cit4"><span class="author">Lippi G</span>, <span class="author">Simundic AM</span>, <span class="author">Plebani M</span>. <span class="articleTitle">Phlebotomy, stat testing and laboratory organization: an intriguing relationship</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2012</span>;<span class="vol">50</span>(<span class="issue">12</span>):<span class="pageFirst">2065</span>–<span class="pageLast">2068</span>. </cite></li><li id="jhm2108-bib-0005"><cite class="journal" id="ref-cit5"><span class="author">Trisorio Liuzzi MP</span>, <span class="author">Attolini E</span>, <span class="author">Quaranta R</span>, et al. <span class="articleTitle">Laboratory request appropriateness in emergency: impact on hospital organization</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2006</span>;<span class="vol">44</span>(<span class="issue">6</span>):<span class="pageFirst">760</span>–<span class="pageLast">764</span>. </cite></li><li id="jhm2108-bib-0006"><cite class="other" id="ref-cit6"><span class="groupName">College of American Pathologists</span>.<span class="otherTitle">Definitions used in past Q‐PROBES studies (1991–2011)</span>. Available at: <span class="url">http://www.cap.org/apps/docs/q_probes/q‐probes_definitions.pdf</span>. Updated September 29, 2011. Accessed July 31, <span class="pubYear">2013</span>. </cite></li><li id="jhm2108-bib-0007"><cite class="journal" id="ref-cit7"><span class="author">Hilborne L</span>, <span class="author">Lee H</span>, <span class="author">Cathcart P</span>. <span class="articleTitle">Practice Parameter. STAT testing? A guideline for meeting clinician turnaround time requirements</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">671</span>–<span class="pageLast">675</span>. </cite></li><li id="jhm2108-bib-0008"><cite class="journal" id="ref-cit8"><span class="author">Howanitz PJ</span>, <span class="author">Steindel SJ</span>. <span class="articleTitle">Intralaboratory performance and laboratorians' expectations for stat turnaround times: a College of American Pathologists Q‐Probes study of four cerebrospinal fluid determinations</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">1991</span>;<span class="vol">115</span>(<span class="issue">10</span>):<span class="pageFirst">977</span>–<span class="pageLast">983</span>. </cite></li><li id="jhm2108-bib-0009"><cite class="journal" id="ref-cit9"><span class="author">Winkelman JW</span>, <span class="author">Tanasijevic MJ</span>, <span class="author">Wybenga DR</span>, <span class="author">Otten J</span>. <span class="articleTitle">How fast is fast enough for clinical laboratory turnaround time? Measurement of the interval between result entry and inquiries for reports</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1997</span>;<span class="vol">108</span>(<span class="issue">4</span>):<span class="pageFirst">400</span>–<span class="pageLast">405</span>. </cite></li><li id="jhm2108-bib-0010"><cite class="journal" id="ref-cit10"><span class="author">Fleisher M</span>, <span class="author">Schwartz MK</span>. <span class="articleTitle">Strategies of organization and service for the critical‐care laboratory</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1990</span>;<span class="vol">36</span>(<span class="issue">8</span>):<span class="pageFirst">1557</span>–<span class="pageLast">1561</span>. </cite></li><li id="jhm2108-bib-0011"><cite class="journal" id="ref-cit11"><span class="author">Hilborne LH</span>, <span class="author">Oye RK</span>, <span class="author">McArdle JE</span>, <span class="author">Repinski JA</span>, <span class="author">Rodgerson DO</span>. <span class="articleTitle">Evaluation of stat and routine turnaround times as a component of laboratory quality</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1989</span>;<span class="vol">91</span>(<span class="issue">3</span>):<span class="pageFirst">331</span>–<span class="pageLast">335</span>. </cite></li><li id="jhm2108-bib-0012"><cite class="journal" id="ref-cit12"><span class="author">Howanitz JH</span>, <span class="author">Howanitz PJ</span>. <span class="articleTitle">Laboratory results: Timeliness as a quality attribute and strategy</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">2001</span>;<span class="vol">116</span>(<span class="issue">3</span>):<span class="pageFirst">311</span>–<span class="pageLast">315</span>. </cite></li><li id="jhm2108-bib-0013"><cite class="journal" id="ref-cit13"><span class="author">Volmar KE</span>, <span class="author">Wilkinson DS</span>, <span class="author">Wagar EA</span>, <span class="author">Lehman CM</span>. <span class="articleTitle">Utilization of stat test priority in the clinical laboratory: a College of American Pathologists Q‐Probes study of 52 institutions</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">2013</span>;<span class="vol">137</span>(<span class="issue">2</span>):<span class="pageFirst">220</span>–<span class="pageLast">227</span>. </cite></li><li id="jhm2108-bib-0014"><cite class="journal" id="ref-cit14"><span class="author">Belsey R</span>. <span class="articleTitle">Controlling the use of stat testing</span>. <span class="journalTitle">Pathologist.</span> <span class="pubYear">1984</span>;<span class="vol">38</span>(<span class="issue">8</span>):<span class="pageFirst">474</span>–<span class="pageLast">477</span>. </cite></li><li id="jhm2108-bib-0015"><cite class="journal" id="ref-cit15"><span class="author">Burnett L</span>, <span class="author">Chesher D</span>, <span class="author">Burnett JR</span>. <span class="articleTitle">Optimizing the availability of ‘stat' laboratory tests using Shewhart ‘C' control charts</span>. <span class="journalTitle">Ann Clin Biochem.</span> <span class="pubYear">2002</span>;<span class="vol">39</span>(<span class="issue">part 2</span>):<span class="pageFirst">140</span>–<span class="pageLast">144</span>. </cite></li><li id="jhm2108-bib-0016"><cite class="journal" id="ref-cit16"><span class="author">Kilgore ML</span>, <span class="author">Steindel SJ</span>, <span class="author">Smith JA</span>. <span class="articleTitle">Evaluating stat testing options in an academic health center: therapeutic turnaround time and staff satisfaction</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1998</span>;<span class="vol">44</span>(<span class="issue">8</span>):<span class="pageFirst">1597</span>–<span class="pageLast">1603</span>. </cite></li><li id="jhm2108-bib-0017"><cite class="journal" id="ref-cit17"><span class="author">Hwang JI</span>, <span class="author">Park HA</span>, <span class="author">Bakken S</span>. <span class="articleTitle">Impact of a physician's order entry (POE) system on physicians' ordering patterns and patient length of stay</span>. <span class="journalTitle">Int J Med Inform.</span> <span class="pubYear">2002</span>;<span class="vol">65</span>(<span class="issue">3</span>):<span class="pageFirst">213</span>–<span class="pageLast">223</span>. </cite></li><li id="jhm2108-bib-0018"><cite class="journal" id="ref-cit18"><span class="author">Lifshitz MS</span>, <span class="author">Cresce RP</span>. <span class="articleTitle">Instrumentation for STAT analyses</span>. <span class="journalTitle">Clin Lab Med.</span> <span class="pubYear">1988</span>;<span class="vol">8</span>(<span class="issue">4</span>):<span class="pageFirst">689</span>–<span class="pageLast">697</span>. </cite></li><li id="jhm2108-bib-0019"><cite class="journal" id="ref-cit19"><span class="author">Ivers N</span>, <span class="author">Jamtvedt G</span>, <span class="author">Flottorp S</span>, et al. <span class="articleTitle">Audit and feedback: effects on professional practice and healthcare outcomes</span>. <span class="journalTitle">Cochrane Database Syst Rev.</span> <span class="pubYear">2012</span>;<span class="vol">6</span>:<span class="pageFirst">CD000259</span>. </cite></li><li id="jhm2108-bib-0020"><cite class="journal" id="ref-cit20"><span class="author">Landis Lewis Z</span>, <span class="author">Mello‐Thoms C</span>, <span class="author">Gadabu OJ</span>, <span class="author">Gillespie EM</span>, <span class="author">Douglas GP</span>, <span class="author">Crowley RS</span>. <span class="articleTitle">The feasibility of automating audit and feedback for ART guideline adherence in Malawi</span>. <span class="journalTitle">J Am Med Inform Assoc.</span> <span class="pubYear">2011</span>;<span class="vol">18</span>(<span class="issue">6</span>):<span class="pageFirst">868</span>–<span class="pageLast">874</span>. </cite></li><li id="jhm2108-bib-0021"><cite class="journal" id="ref-cit21"><span class="author">Gerber JS</span>, <span class="author">Prasad PA</span>, <span class="author">Fiks AG</span>, et al. <span class="articleTitle">Effect of an outpatient antimicrobial stewardship intervention on broad‐spectrum antibiotic prescribing by primary care pediatricians: a randomized trial</span>. <span class="journalTitle">JAMA.</span> <span class="pubYear">2013</span>;<span class="vol">309</span>(<span class="issue">22</span>):<span class="pageFirst">2345</span>–<span class="pageLast">2352</span>. </cite></li><li id="jhm2108-bib-0022"><cite class="journal" id="ref-cit22"><span class="author">Eisenberg JM</span>. <span class="articleTitle">An educational program to modify laboratory use by house staff</span>. <span class="journalTitle">J Med Educ.</span> <span class="pubYear">1977</span>;<span class="vol">52</span>(<span class="issue">7</span>):<span class="pageFirst">578</span>–<span class="pageLast">581</span>. </cite></li><li id="jhm2108-bib-0023"><cite class="journal" id="ref-cit23"><span class="author">Wong ET</span>, <span class="author">McCarron MM</span>, <span class="author">Shaw ST</span>. <span class="articleTitle">Ordering of laboratory tests in a teaching hospital: can it be improved?</span> <span class="journalTitle">JAMA.</span> <span class="pubYear">1983</span>;<span class="vol">249</span>(<span class="issue">22</span>):<span class="pageFirst">3076</span>–<span class="pageLast">3080</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/jhm2108.pdf" type="application/pdf">jhm2108.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 9(1)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">13-18</div> </div> </div> <div class="block block-layout-builder block-extra-field-blocknodearticlelinks"> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-sections"> <div class="field field--name-field-article-sections field--type-entity-reference field--label-above"> <div class="field__label">Sections</div> <div class="field__items"> <div class="field__item"><a href="/sections/original-research" hreflang="en">Original Research</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-above"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/atsushi-sorita-md" hreflang="en">Atsushi Sorita, MD</a></div> <div class="field__item"><a href="/authors/daniel-i-steinberg-md" hreflang="en">Daniel I. Steinberg, MD</a></div> <div class="field__item"><a href="/authors/michael-leitman-md" hreflang="en">Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/alfred-burger-md" hreflang="en">Alfred Burger, MD</a></div> <div class="field__item"><a href="/authors/gregg-husk-md" hreflang="en">Gregg Husk, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-inline clearfix"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/atsushi-sorita-md" hreflang="en">Atsushi Sorita, MD</a></div> <div class="field__item"><a href="/authors/daniel-i-steinberg-md" hreflang="en">Daniel I. Steinberg, MD</a></div> <div class="field__item"><a href="/authors/michael-leitman-md" hreflang="en">Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/alfred-burger-md" hreflang="en">Alfred Burger, MD</a></div> <div class="field__item"><a href="/authors/gregg-husk-md" hreflang="en">Gregg Husk, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-files"> <div class="field field--name-field-article-files field--type-file field--label-above"> <div class="field__label">Files</div> <div class="field__items"> <div class="field__item"> <span class="file file--mime-application-msword file--x-office-document"> <a href="https://cdn.mdedge.com/files/s3fs-public/journals/supporting/jhm2108-sup-0001-suppinfo.doc" type="application/msword">Supplementary Information (1)</a></span> </div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-files"> <div class="field field--name-field-article-files field--type-file field--label-above"> <div class="field__label">Files</div> <div class="field__items"> <div class="field__item"> <span class="file file--mime-application-msword file--x-office-document"> <a href="https://cdn.mdedge.com/files/s3fs-public/journals/supporting/jhm2108-sup-0001-suppinfo.doc" type="application/msword">Supplementary Information (1)</a></span> </div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/jhm2108.pdf" type="application/pdf">jhm2108.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/jhm2108.pdf" type="application/pdf">jhm2108.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="jhm2108-sec-0007"><p>Overuse of inpatient stat laboratory orders (stat is an abbreviation of the Latin word <em>statim</em>, meaning immediately, without delay; alternatively, some consider it an acronym for short turnaround time) is a major problem in the modern healthcare system.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0001">1</a>, <a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>, <a class="ref-link-bib" href="#jhm2108-bib-0003">3</a>, <a class="ref-link-bib" href="#jhm2108-bib-0004">4</a>, <a class="ref-link-bib" href="#jhm2108-bib-0005">5</a>]</span> Ordering laboratory tests stat is a common way to expedite processing, with expectation of results being reported within 1 hour from the time ordered, according to the College of American Pathologists.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0006">6</a>]</span> However, stat orders are also requested for convenience,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>]</span> to expedite discharge,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> or to meet expectation of turnaround times.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0008">8</a>, <a class="ref-link-bib" href="#jhm2108-bib-0009">9</a>, <a class="ref-link-bib" href="#jhm2108-bib-0010">10</a>]</span> Overuse of stat orders increases cost and may reduce the effectiveness of a system. Reduction of excessive stat order requests helps support safe and efficient patient care<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0011">11</a>, <a class="ref-link-bib" href="#jhm2108-bib-0012">12</a>]</span> and may reduce laboratory costs.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>, <a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>]</span></p><p>Several studies have examined interventions to optimize stat laboratory utilization.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>, <a class="ref-link-bib" href="#jhm2108-bib-0015">15</a>]</span> Potentially effective interventions include establishment of stat ordering guidelines, utilization of point‐of‐care testing, and prompt feedback via computerized physician order entry (CPOE) systems.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0016">16</a>, <a class="ref-link-bib" href="#jhm2108-bib-0017">17</a>, <a class="ref-link-bib" href="#jhm2108-bib-0018">18</a>]</span> However, limited evidence is available regarding the effectiveness of audit and feedback in reducing stat ordering frequency.</p><p>Our institution shared the challenge of a high frequency of stat laboratory test orders. An interdisciplinary working group comprising leadership in the medicine, surgery, informatics, laboratory medicine, and quality and patient safety departments was formed to approach this problem and identify potential interventions. The objectives of this study are to describe the patterns of stat orders at our institution as well as to assess the effectiveness of the targeted individual feedback intervention in reducing utilization of stat laboratory test orders.</p></section><section id="jhm2108-sec-0008"><h3 class="main">METHODS</h3><section id="jhm2108-sec-0009"><h3 class="main">Design</h3><p>This study is a retrospective analysis of administrative data for a quality‐improvement project. The study was deemed exempt from review by the Beth Israel Medical Center Institutional Review Board.</p></section><section id="jhm2108-sec-0010"><h3 class="main">Setting</h3><p>Beth Israel Medical Center is an 856‐bed, urban, tertiary‐care teaching hospital with a capacity of 504 medical and surgical beds. In October 2009, 47.8% of inpatient laboratory tests (excluding the emergency department) were ordered as stat, according to an electronic audit of our institution's CPOE system, GE Centricity Enterprise (GE Medical Systems Information Technologies, Milwaukee, WI). Another audit using the same data query for the period of December 2009 revealed that 50 of 488 providers (attending physicians, nurse practitioners, physician assistants, fellows, and residents) accounted for 51% of total stat laboratory orders, and that Medicine and General Surgery residents accounted for 43 of these 50 providers. These findings prompted us to develop interventions that targeted high utilizers of stat laboratory orders, especially Medicine and General Surgery residents.</p></section><section id="jhm2108-sec-0011"><h3 class="main">Teaching Session</h3><p>Medicine and General Surgery residents were given a 1‐hour educational session at a teaching conference in January 2010. At this session, residents were instructed that ordering stat laboratory tests was appropriate when the results were needed urgently to make clinical decisions as quickly as possible. This session also explained the potential consequences associated with excessive stat laboratory orders and provided department‐specific data on current stat laboratory utilization.</p></section><section id="jhm2108-sec-0012"><h3 class="main">Individual Feedback</h3><p>From January to May 2010, a list of stat laboratory orders by provider was generated each month by the laboratory department's database. The top 10 providers who most frequently placed stat orders were identified and given individual feedback by their direct supervisors based on data from the prior month (feedback provided from February to June 2010). Medicine and General Surgery residents were counseled by their residency program directors, and nontrainee providers by their immediate supervising physicians. Feedback and counseling were given via brief individual meetings, phone calls, or e‐mail. Supervisors chose the method that ensured the most timely delivery of feedback. Feedback and counseling consisted of explaining the effort to reduce stat laboratory ordering and the rationale behind this, alerting providers that they were outliers, and encouraging them to change their behavior. No punitive consequences were discussed; the feedback sessions were purely informative in nature. When an individual was ranked again in the top 10 after receiving feedback, he or she received repeated feedback.</p></section><section id="jhm2108-sec-0013"><h3 class="main">Data Collection and Measured Outcomes</h3><p>We retrospectively collected data on monthly laboratory test orders by providers from September 2009 to June 2010. The data were extracted from the electronic medical record (EMR) system and included any inpatient laboratory orders at the institution. Laboratory orders placed in the emergency department were excluded. Providers were divided into nontrainees (attending physicians, nurse practitioners, and physician assistants) and trainee providers (residents and fellows). Trainee providers were further categorized by educational levels (postgraduate year [PGY]‐1 vs PGY‐2 or higher) and specialty (Medicine vs General Surgery vs other). Fellows in medical and surgical subspecialties were categorized as other.</p><p>The primary outcome measure was the proportion of stat orders out of total laboratory orders for individuals. The proportion of stat orders out of total orders was selected to assess individuals' tendency to utilize stat laboratory orders.</p></section><section id="jhm2108-sec-0014"><h3 class="main">Statistical Analysis</h3><p>In the first analysis, stat and total laboratory orders were aggregated for each provider. Providers who ordered &lt;10 laboratory tests during the study period were excluded. We calculated the proportion of stat out of total laboratory orders for each provider, and compared it by specialty, by educational level, and by feedback status. Median and interquartile range (IQR) were reported due to non‐normal distribution, and the Wilcoxon rank‐sum test was used for comparisons.</p><p>In the second analysis, we determined pre‐feedback and post‐feedback periods for providers who received feedback. The feedback month was defined as the month immediately after a provider was ranked in the top 10 for the first time during the intervention period. For each provider, stat orders and total laboratory orders during months before and after the feedback month, excluding the feedback month, were calculated. The change in the proportion of stat laboratory orders out of all orders from pre‐ to post‐feedback was then calculated for each provider for whom both pre‐ and post‐feedback data were available. Because providers may have utilized an unusually high proportion of stat orders during the months in which they were ranked in the top 10 (for example, due to being on rotations in which many orders are placed stat, such as the intensive care units), we conducted a sensitivity analysis excluding those months. Further, for comparison, we conducted the same analysis for providers who did not receive feedback and were ranked 11 to 30 in any month during the intervention period. In those providers, we considered the month immediately after a provider was ranked in the 11 to 30 range for the first time as the hypothetical feedback month. The proportional change in the stat laboratory ordering was analyzed using the paired Student <em>t</em> test.</p><p>In the third analysis, we calculated the proportion of stat laboratory orders each month for each provider. Individual provider data were excluded if total laboratory orders for the month were &lt;10. We then calculated the average proportion of stat orders for each specialty and educational level among trainee providers every month, and plotted and compared the trends.</p><p>All analyses were performed with JMP software version 9.0 (SAS Institute, Inc., Cary, NC). All statistical tests were 2‐sided, and <em>P</em> &lt; 0.05 was considered significant.</p></section></section><section id="jhm2108-sec-0015"><h3 class="main">RESULTS</h3><p>We identified 1045 providers who ordered 1 laboratory test from September 2009 to June 2010. Of those, 716 were nontrainee providers and 329 were trainee providers. Among the trainee providers, 126 were Medicine residents, 33 were General Surgery residents, and 103 were PGY‐1. A total of 772,734 laboratory tests were ordered during the study period, and 349,658 (45.2%) tests were ordered as stat. Of all stat orders, 179,901 (51.5%) were ordered by Medicine residents and 52,225 (14.9%) were ordered by General Surgery residents.</p><p>Thirty‐seven providers received individual feedback during the intervention period. This group consisted of 8 nontrainee providers (nurse practitioners and physician assistants), 21 Medicine residents (5 were PGY‐1), and 8 General Surgery residents (all PGY‐1). This group ordered a total of 84,435 stat laboratory tests from September 2009 to June 2010 and was responsible for 24.2% of all stat laboratory test orders at the institution.</p><section id="jhm2108-sec-0016"><h3 class="main">Provider Analysis</h3><p>After exclusion of providers who ordered &lt;10 laboratory tests from September 2009 to June 2010, a total of 807 providers remained. The median proportion of stat orders out of total orders was 40% among all providers and 41.6% for nontrainee providers (N = 500), 38.7% for Medicine residents (N = 125), 80.2% for General Surgery residents (N = 32), and 24.2% for other trainee providers (N = 150). The proportion of stat orders differed significantly by specialty and educational level, but also even among providers in the same specialty at the same educational level. Among PGY‐1 residents, the stat‐ordering proportion ranged from 6.9% to 49.1% for Medicine (N = 54) and 69.0% to 97.1% for General Surgery (N = 16). The proportion of stat orders was significantly higher among providers who received feedback compared with those who did not (median, 72.4% [IQR, 55.0%89.5%] vs 39.0% [IQR, 14.9%65.7%], <em>P</em> &lt; 0.001). When stratified by specialty and educational level, the statistical significance remained in nontrainee providers and trainee providers with higher educational level, but not in PGY‐1 residents (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>).</p><table id="jhm2108-tbl-0001"><caption><label>Table 1.</label><span class="description">Proportion of Stat Laboratory Orders by Provider, Comparison by Feedback Status</span></caption><thead><tr class="valign-bottom"><th class="text-align-left"> </th><th class="text-align-center rowsep" colspan="2">All Providers</th><th class="text-align-center rowsep" colspan="2">Feedback Given</th><th class="text-align-center rowsep" colspan="2">Feedback Not Given</th><th class="text-align-left"> </th></tr><tr class="valign-bottom rowsep"><th class="text-align-left"> </th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center"><em>P</em> Value<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0002">a</a></span></th></tr></thead><tfoot><tr><td colspan="8"><ul><li id="jhm2108-note-0001"><p>NOTE: Values for Stat % are given as median (IQR). <b>Abbreviations:</b> IQR, interquartile range; PGY, postgraduate year; Stat, immediately.</p></li><li id="jhm2108-note-0002"><label>a</label><p><em>P</em> value is for comparison between providers who received feedback vs those who did not.</p></li><li id="jhm2108-note-0003"><label>b</label><p>Nontrainee providers are attending physicians, nurse practitioners, and physician assistants.</p></li><li id="jhm2108-note-0004"><label>c</label><p>Trainee providers are residents and fellows.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">807</td><td class="text-align-center">40 (15.869.0)</td><td class="text-align-center">37</td><td class="text-align-center">72.4 (55.089.5)</td><td class="text-align-center">770</td><td class="text-align-center">39.0 (14.965.7)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0003">b</a></span></td><td class="text-align-center">500</td><td class="text-align-center">41.6 (13.571.5)</td><td class="text-align-center">8</td><td class="text-align-center">91.7 (64.097.5)</td><td class="text-align-center">492</td><td class="text-align-center">40.2 (13.270.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0004">c</a></span></td><td class="text-align-center">307</td><td class="text-align-center">37.8 (19.162.7)</td><td class="text-align-center">29</td><td class="text-align-center">69.3 (44.380.9)</td><td class="text-align-center">278</td><td class="text-align-center">35.1 (17.655.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">125</td><td class="text-align-center">38.7 (26.850.4)</td><td class="text-align-center">21</td><td class="text-align-center">58.8 (36.872.6)</td><td class="text-align-center">104</td><td class="text-align-center">36.1 (25.945.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">54</td><td class="text-align-center">28.1 (23.935.2)</td><td class="text-align-center">5</td><td class="text-align-center">32.0 (25.536.8)</td><td class="text-align-center">49</td><td class="text-align-center">27.9 (23.534.6)</td><td class="text-align-center">0.52</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">71</td><td class="text-align-center">46.5 (39.160.4)</td><td class="text-align-center">16</td><td class="text-align-center">63.9 (54.575.7)</td><td class="text-align-center">55</td><td class="text-align-center">45.1 (36.554.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General surgery</td><td class="text-align-center">32</td><td class="text-align-center">80.2 (69.690.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">24</td><td class="text-align-center">78.7 (67.987.4)</td><td class="text-align-center">&lt;0.05</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">16</td><td class="text-align-center">86.4 (79.191.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">8</td><td class="text-align-center">84.0 (73.289.1)</td><td class="text-align-center">0.25</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">16</td><td class="text-align-center">74.4 (65.485.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Other</td><td class="text-align-center">150</td><td class="text-align-center">24.2 (9.055.0)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">31</td><td class="text-align-center">28.2 (18.478.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 or higher</td><td class="text-align-center">119</td><td class="text-align-center">20.9 (5.651.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr></tbody></table><section id="jhm2108-sec-0017"><h3 class="main">Stat Ordering Pattern Change by Individual Feedback</h3><p>Among 37 providers who received individual feedback, 8 providers were ranked in the top 10 more than once and received repeated feedback. Twenty‐seven of 37 providers had both pre‐feedback and post‐feedback data and were included in the analysis. Of those, 7 were nontrainee providers, 16 were Medicine residents (5 were PGY‐1), and 4 were General Surgery residents (all PGY‐1). The proportion of stat laboratory orders per provider decreased by 15.7% (95% confidence interval [CI]: 5.6% to 25.9%, <em>P</em> = 0.004) after feedback (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>). The decrease remained significant after excluding the months in which providers were ranked in the top 10 (11.4%; 95% CI: 0.7% to 22.1%, <em>P</em> = 0.04).</p><table id="jhm2108-tbl-0002"><caption><label>Table 2.</label><span class="description">Stat Laboratory Ordering Practice Changes Among Providers Receiving Feedback and Those Not Receiving Feedback</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left" rowspan="2"> </th><th class="text-align-center rowsep" colspan="5">Top 10 Providers (Received Feedback)</th><th class="text-align-center rowsep" colspan="5">Providers Ranked in 1130 (No Feedback)</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center">Pre</th><th class="text-align-center">Post</th><th class="text-align-center">Pre</th><th class="text-align-center">Post</th></tr></thead><tfoot><tr><td colspan="11"><ul><li id="jhm2108-note-0005"><p>NOTE: <b>Abbreviations:</b> CI, confidence interval; PGY, postgraduate year; Stat, immediately.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">27</td><td class="text-align-center">71.2</td><td class="text-align-center">55.5</td><td class="text-align-center">15.7 (25.9 to 5.6)</td><td class="text-align-center">0.004</td><td class="text-align-center">39</td><td class="text-align-center">64.6</td><td class="text-align-center">60.2</td><td class="text-align-center">4.5 (11.0 to 2.1)</td><td class="text-align-center">0.18</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers</td><td class="text-align-center">7</td><td class="text-align-center">94.6</td><td class="text-align-center">73.2</td><td class="text-align-center">21.4 (46.9 to 4.1)</td><td class="text-align-center">0.09</td><td class="text-align-center">12</td><td class="text-align-center">84.4</td><td class="text-align-center">80.6</td><td class="text-align-center">3.8 (11.9 to 4.3)</td><td class="text-align-center">0.32</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers</td><td class="text-align-center">20</td><td class="text-align-center">63.0</td><td class="text-align-center">49.3</td><td class="text-align-center">13.7 (25.6 to 1.9)</td><td class="text-align-center">0.03</td><td class="text-align-center">27</td><td class="text-align-center">55.8</td><td class="text-align-center">51.1</td><td class="text-align-center">4.7 (13.9 to 4.4)</td><td class="text-align-center">0.30</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">16</td><td class="text-align-center">55.8</td><td class="text-align-center">45.0</td><td class="text-align-center">10.8 (23.3 to 1.6)</td><td class="text-align-center">0.08</td><td class="text-align-center">21</td><td class="text-align-center">46.2</td><td class="text-align-center">41.3</td><td class="text-align-center">4.8 (16.3 to 6.7)</td><td class="text-align-center">0.39</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General Surgery</td><td class="text-align-center">4</td><td class="text-align-center">91.9</td><td class="text-align-center">66.4</td><td class="text-align-center">25.4 (78.9 to 28.0)</td><td class="text-align-center">0.23</td><td class="text-align-center">6</td><td class="text-align-center">89.6</td><td class="text-align-center">85.2</td><td class="text-align-center">4.4 (20.5 to 11.6)</td><td class="text-align-center">0.51</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐1</td><td class="text-align-center">9</td><td class="text-align-center">58.9</td><td class="text-align-center">47.7</td><td class="text-align-center">11.2 (32.0 to 9.5)</td><td class="text-align-center">0.25</td><td class="text-align-center">15</td><td class="text-align-center">55.2</td><td class="text-align-center">49.2</td><td class="text-align-center">6.0 (18.9 to 6.9)</td><td class="text-align-center">0.33</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐2 or Higher</td><td class="text-align-center">11</td><td class="text-align-center">66.4</td><td class="text-align-center">50.6</td><td class="text-align-center">15.8 (32.7 to 1.1)</td><td class="text-align-center">0.06</td><td class="text-align-center">12</td><td class="text-align-center">56.6</td><td class="text-align-center">53.5</td><td class="text-align-center">3.1 (18.3 to 12.1)</td><td class="text-align-center">0.66</td></tr></tbody></table><p>In comparison, a total of 57 providers who did not receive feedback were in the 11 to 30 range during the intervention period. Three Obstetrics and Gynecology residents and 3 Family Medicine residents were excluded from the analysis to match specialty with providers who received feedback. Thirty‐nine of 51 providers had adequate data and were included in the analysis, comprising 12 nontrainee providers, 21 Medicine residents (10 were PGY‐1), and 6 General Surgery residents (5 were PGY‐1). Among them, the proportion of stat laboratory orders per provider did not change significantly, with a 4.5% decrease (95% CI: 2.1% to 11.0%, <em>P</em> = 0.18; Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>).</p></section><section id="jhm2108-sec-0018"><h3 class="main">Stat Ordering Trends Among Trainee Providers</h3><p>After exclusion of data for the month with &lt;10 total laboratory tests per provider, a total of 303 trainee providers remained, providing 2322 data points for analysis. Of the 303, 125 were Medicine residents (54 were PGY‐1), 32 were General Surgery residents (16 were PGY‐1), and 146 were others (31 were PGY‐1). The monthly trends for the average proportion of stat orders among those providers are shown in Figure <span class="ref-link"><a class="ref-link-fig" href="#jhm2108-fig-0001">1</a></span>. The decrease in the proportion of stat orders was observed after January 2010 in Medicine and General Surgery residents both in PGY‐1 and PGY‐2 or higher, but no change was observed in other trainee providers.</p><div id="jhm2108-fig-0001"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/jhm2108-fig-0001-m.png" width="996" height="1083" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Monthly trends for the average proportion of stat orders among those providers. Abbreviations: PGY, postgraduate year; stat, immediately.</figcaption></figure></div></section></section></section><section id="jhm2108-sec-0019"><h3 class="main">DISCUSSION</h3><p>We describe a series of interventions implemented at our institution to decrease the utilization of stat laboratory orders. Based on an audit of laboratory‐ordering data, we decided to target high utilizers of stat laboratory tests, especially Medicine and General Surgery residents. After presenting an educational session to those residents, we gave individual feedback to the highest utilizers of stat laboratory orders. Providers who received feedback decreased their utilization of stat laboratory orders, but the stat ordering pattern did not change among those who did not receive feedback.</p><p>The individual feedback intervention involved key stakeholders for resident and nontrainee provider education (directors of the Medicine and General Surgery residency programs and other direct clinical supervisors). The targeted feedback was delivered via direct supervisors and was provided more than once as needed, which are key factors for effective feedback in modifying behavior in professional practice.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0019">19</a>]</span> Allowing the supervisors to choose the most appropriate form of feedback for each individual (meetings, phone calls, or e‐mail) enabled timely and individually tailored feedback and contributed to successful implementation. We feel intervention had high educational value for residents, as it promoted residents' engagement in proper systems‐based practice, one of the 6 core competencies of the Accreditation Council for Graduate Medical Education (ACGME).</p><p>We utilized the EMR to obtain provider‐specific data for feedback and analysis. As previously suggested, the use of the EMR for audit and feedback was effective in providing timely, actionable, and individualized feedback with peer benchmarking.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0020">20</a>, <a class="ref-link-bib" href="#jhm2108-bib-0021">21</a>]</span> We used the raw number of stat laboratory orders for audit and the proportion of stat orders out of total orders to assess the individual behavioral patterns. Although the proportional use of stat orders is affected by patient acuity and workplace or rotation site, it also seems largely affected by provider's preference or practice patterns, as we saw the variance among providers of the same specialty and educational level. The changes in the stat ordering trends only seen among Medicine and General Surgery residents suggests that our interventions successfully decreased the overall utilization of stat laboratory orders among targeted providers, and it seems less likely that those decreases are due to changes in patient acuity, changes in rotation sites, or learning curve among trainee providers. When averaged over the 10‐month study period, as shown in Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>, the providers who received feedback ordered a higher proportion of stat tests than those who did not receive feedback, except for PGY‐1 residents. This suggests that although auditing based on the number of stat laboratory orders identified providers who tended to order more stat tests than others, it may not be a reliable indicator for PGY‐1 residents, whose number of laboratory orders highly fluctuates by rotation.</p><p>There are certain limitations to our study. First, we assumed that the top utilizers were inappropriately ordering stat laboratory tests. Because there is no clear consensus as to what constitutes appropriate stat testing,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> it was difficult, if not impossible, to determine which specific orders were inappropriate. However, high variability of the stat ordering pattern in the analysis provides some evidence that high stat utilizers customarily order more stat testing as compared with others. A recent study also revealed that the median stat ordering percentage was 35.9% among 52 US institutions.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>]</span> At our institution, 47.8% of laboratory tests were ordered stat prior to the intervention, higher than the benchmark, providing the rationale for our intervention.</p><p>Second, the intervention was conducted in a time‐series fashion and no randomization was employed. The comparison of providers who received feedback with those who did not is subject to selection bias, and the difference in the change in stat ordering pattern between these 2 groups may be partially due to variability of work location, rotation type, or acuity of patients. However, we performed a sensitivity analysis excluding the months when the providers were ranked in the top 10, assuming that they may have ordered an unusually high proportion of stat tests due to high acuity of patients (eg, rotation in the intensive care units) during those months. Robust results in this analysis support our contention that individual feedback was effective. In addition, we cannot completely rule out the possibility that the changes in stat ordering practice may be solely due to natural maturation effects within an academic year among trainee providers, especially PGY‐1 residents. However, relatively acute changes in the stat ordering trends only among targeted provider groups around January 2010, corresponding to the timing of interventions, suggest otherwise.</p><p>Third, we were not able to test if the intervention or decrease in stat orders adversely affected patient care. For example, if, after receiving feedback, providers did not order some tests stat that should have been ordered that way, this could have negatively affected patient care. Additionally, we did not evaluate whether reduction in stat laboratory orders improved timeliness of the reporting of stat laboratory results.</p><p>Lastly, the sustained effect and feasibility of this intervention were not tested. Past studies suggest educational interventions in laboratory ordering behavior would most likely need to be continued to maintain its effectiveness.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0022">22</a>, <a class="ref-link-bib" href="#jhm2108-bib-0023">23</a>]</span> Although we acknowledge that sustainability of this type of intervention may be difficult, we feel we have demonstrated that there is still value associated with giving personalized feedback.</p><p>This study has implications for future interventions and research. Use of automated, EMR‐based feedback on laboratory ordering performance may be effective in reducing excessive stat ordering and may obviate the need for time‐consuming efforts by supervisors. Development of quality indicators that more accurately assess stat ordering patterns, potentially adjusted for working sites and patient acuity, may be necessary. Studies that measure the impact of decreasing stat laboratory orders on turnaround times and cost may be of value.</p></section><section id="jhm2108-sec-0020"><h3 class="main">CONCLUSION</h3><p>At our urban, tertiary‐care teaching institution, stat ordering frequency was highly variable among providers. Targeted individual feedback to providers who ordered a large number of stat laboratory tests decreased their stat laboratory order utilization.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="jhm2108-sec-0007"><p>Overuse of inpatient stat laboratory orders (stat is an abbreviation of the Latin word <em>statim</em>, meaning immediately, without delay; alternatively, some consider it an acronym for short turnaround time) is a major problem in the modern healthcare system.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0001">1</a>, <a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>, <a class="ref-link-bib" href="#jhm2108-bib-0003">3</a>, <a class="ref-link-bib" href="#jhm2108-bib-0004">4</a>, <a class="ref-link-bib" href="#jhm2108-bib-0005">5</a>]</span> Ordering laboratory tests stat is a common way to expedite processing, with expectation of results being reported within 1 hour from the time ordered, according to the College of American Pathologists.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0006">6</a>]</span> However, stat orders are also requested for convenience,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0002">2</a>]</span> to expedite discharge,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> or to meet expectation of turnaround times.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0008">8</a>, <a class="ref-link-bib" href="#jhm2108-bib-0009">9</a>, <a class="ref-link-bib" href="#jhm2108-bib-0010">10</a>]</span> Overuse of stat orders increases cost and may reduce the effectiveness of a system. Reduction of excessive stat order requests helps support safe and efficient patient care<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0011">11</a>, <a class="ref-link-bib" href="#jhm2108-bib-0012">12</a>]</span> and may reduce laboratory costs.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>, <a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>]</span></p><p>Several studies have examined interventions to optimize stat laboratory utilization.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0014">14</a>, <a class="ref-link-bib" href="#jhm2108-bib-0015">15</a>]</span> Potentially effective interventions include establishment of stat ordering guidelines, utilization of point‐of‐care testing, and prompt feedback via computerized physician order entry (CPOE) systems.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0016">16</a>, <a class="ref-link-bib" href="#jhm2108-bib-0017">17</a>, <a class="ref-link-bib" href="#jhm2108-bib-0018">18</a>]</span> However, limited evidence is available regarding the effectiveness of audit and feedback in reducing stat ordering frequency.</p><p>Our institution shared the challenge of a high frequency of stat laboratory test orders. An interdisciplinary working group comprising leadership in the medicine, surgery, informatics, laboratory medicine, and quality and patient safety departments was formed to approach this problem and identify potential interventions. The objectives of this study are to describe the patterns of stat orders at our institution as well as to assess the effectiveness of the targeted individual feedback intervention in reducing utilization of stat laboratory test orders.</p></section><section id="jhm2108-sec-0008"><h3 class="main">METHODS</h3><section id="jhm2108-sec-0009"><h3 class="main">Design</h3><p>This study is a retrospective analysis of administrative data for a quality‐improvement project. The study was deemed exempt from review by the Beth Israel Medical Center Institutional Review Board.</p></section><section id="jhm2108-sec-0010"><h3 class="main">Setting</h3><p>Beth Israel Medical Center is an 856‐bed, urban, tertiary‐care teaching hospital with a capacity of 504 medical and surgical beds. In October 2009, 47.8% of inpatient laboratory tests (excluding the emergency department) were ordered as stat, according to an electronic audit of our institution's CPOE system, GE Centricity Enterprise (GE Medical Systems Information Technologies, Milwaukee, WI). Another audit using the same data query for the period of December 2009 revealed that 50 of 488 providers (attending physicians, nurse practitioners, physician assistants, fellows, and residents) accounted for 51% of total stat laboratory orders, and that Medicine and General Surgery residents accounted for 43 of these 50 providers. These findings prompted us to develop interventions that targeted high utilizers of stat laboratory orders, especially Medicine and General Surgery residents.</p></section><section id="jhm2108-sec-0011"><h3 class="main">Teaching Session</h3><p>Medicine and General Surgery residents were given a 1‐hour educational session at a teaching conference in January 2010. At this session, residents were instructed that ordering stat laboratory tests was appropriate when the results were needed urgently to make clinical decisions as quickly as possible. This session also explained the potential consequences associated with excessive stat laboratory orders and provided department‐specific data on current stat laboratory utilization.</p></section><section id="jhm2108-sec-0012"><h3 class="main">Individual Feedback</h3><p>From January to May 2010, a list of stat laboratory orders by provider was generated each month by the laboratory department's database. The top 10 providers who most frequently placed stat orders were identified and given individual feedback by their direct supervisors based on data from the prior month (feedback provided from February to June 2010). Medicine and General Surgery residents were counseled by their residency program directors, and nontrainee providers by their immediate supervising physicians. Feedback and counseling were given via brief individual meetings, phone calls, or e‐mail. Supervisors chose the method that ensured the most timely delivery of feedback. Feedback and counseling consisted of explaining the effort to reduce stat laboratory ordering and the rationale behind this, alerting providers that they were outliers, and encouraging them to change their behavior. No punitive consequences were discussed; the feedback sessions were purely informative in nature. When an individual was ranked again in the top 10 after receiving feedback, he or she received repeated feedback.</p></section><section id="jhm2108-sec-0013"><h3 class="main">Data Collection and Measured Outcomes</h3><p>We retrospectively collected data on monthly laboratory test orders by providers from September 2009 to June 2010. The data were extracted from the electronic medical record (EMR) system and included any inpatient laboratory orders at the institution. Laboratory orders placed in the emergency department were excluded. Providers were divided into nontrainees (attending physicians, nurse practitioners, and physician assistants) and trainee providers (residents and fellows). Trainee providers were further categorized by educational levels (postgraduate year [PGY]‐1 vs PGY‐2 or higher) and specialty (Medicine vs General Surgery vs other). Fellows in medical and surgical subspecialties were categorized as other.</p><p>The primary outcome measure was the proportion of stat orders out of total laboratory orders for individuals. The proportion of stat orders out of total orders was selected to assess individuals' tendency to utilize stat laboratory orders.</p></section><section id="jhm2108-sec-0014"><h3 class="main">Statistical Analysis</h3><p>In the first analysis, stat and total laboratory orders were aggregated for each provider. Providers who ordered &lt;10 laboratory tests during the study period were excluded. We calculated the proportion of stat out of total laboratory orders for each provider, and compared it by specialty, by educational level, and by feedback status. Median and interquartile range (IQR) were reported due to non‐normal distribution, and the Wilcoxon rank‐sum test was used for comparisons.</p><p>In the second analysis, we determined pre‐feedback and post‐feedback periods for providers who received feedback. The feedback month was defined as the month immediately after a provider was ranked in the top 10 for the first time during the intervention period. For each provider, stat orders and total laboratory orders during months before and after the feedback month, excluding the feedback month, were calculated. The change in the proportion of stat laboratory orders out of all orders from pre‐ to post‐feedback was then calculated for each provider for whom both pre‐ and post‐feedback data were available. Because providers may have utilized an unusually high proportion of stat orders during the months in which they were ranked in the top 10 (for example, due to being on rotations in which many orders are placed stat, such as the intensive care units), we conducted a sensitivity analysis excluding those months. Further, for comparison, we conducted the same analysis for providers who did not receive feedback and were ranked 11 to 30 in any month during the intervention period. In those providers, we considered the month immediately after a provider was ranked in the 11 to 30 range for the first time as the hypothetical feedback month. The proportional change in the stat laboratory ordering was analyzed using the paired Student <em>t</em> test.</p><p>In the third analysis, we calculated the proportion of stat laboratory orders each month for each provider. Individual provider data were excluded if total laboratory orders for the month were &lt;10. We then calculated the average proportion of stat orders for each specialty and educational level among trainee providers every month, and plotted and compared the trends.</p><p>All analyses were performed with JMP software version 9.0 (SAS Institute, Inc., Cary, NC). All statistical tests were 2‐sided, and <em>P</em> &lt; 0.05 was considered significant.</p></section></section><section id="jhm2108-sec-0015"><h3 class="main">RESULTS</h3><p>We identified 1045 providers who ordered 1 laboratory test from September 2009 to June 2010. Of those, 716 were nontrainee providers and 329 were trainee providers. Among the trainee providers, 126 were Medicine residents, 33 were General Surgery residents, and 103 were PGY‐1. A total of 772,734 laboratory tests were ordered during the study period, and 349,658 (45.2%) tests were ordered as stat. Of all stat orders, 179,901 (51.5%) were ordered by Medicine residents and 52,225 (14.9%) were ordered by General Surgery residents.</p><p>Thirty‐seven providers received individual feedback during the intervention period. This group consisted of 8 nontrainee providers (nurse practitioners and physician assistants), 21 Medicine residents (5 were PGY‐1), and 8 General Surgery residents (all PGY‐1). This group ordered a total of 84,435 stat laboratory tests from September 2009 to June 2010 and was responsible for 24.2% of all stat laboratory test orders at the institution.</p><section id="jhm2108-sec-0016"><h3 class="main">Provider Analysis</h3><p>After exclusion of providers who ordered &lt;10 laboratory tests from September 2009 to June 2010, a total of 807 providers remained. The median proportion of stat orders out of total orders was 40% among all providers and 41.6% for nontrainee providers (N = 500), 38.7% for Medicine residents (N = 125), 80.2% for General Surgery residents (N = 32), and 24.2% for other trainee providers (N = 150). The proportion of stat orders differed significantly by specialty and educational level, but also even among providers in the same specialty at the same educational level. Among PGY‐1 residents, the stat‐ordering proportion ranged from 6.9% to 49.1% for Medicine (N = 54) and 69.0% to 97.1% for General Surgery (N = 16). The proportion of stat orders was significantly higher among providers who received feedback compared with those who did not (median, 72.4% [IQR, 55.0%89.5%] vs 39.0% [IQR, 14.9%65.7%], <em>P</em> &lt; 0.001). When stratified by specialty and educational level, the statistical significance remained in nontrainee providers and trainee providers with higher educational level, but not in PGY‐1 residents (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>).</p><table id="jhm2108-tbl-0001"><caption><label>Table 1.</label><span class="description">Proportion of Stat Laboratory Orders by Provider, Comparison by Feedback Status</span></caption><thead><tr class="valign-bottom"><th class="text-align-left"> </th><th class="text-align-center rowsep" colspan="2">All Providers</th><th class="text-align-center rowsep" colspan="2">Feedback Given</th><th class="text-align-center rowsep" colspan="2">Feedback Not Given</th><th class="text-align-left"> </th></tr><tr class="valign-bottom rowsep"><th class="text-align-left"> </th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center">N</th><th class="text-align-center">Stat %</th><th class="text-align-center"><em>P</em> Value<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0002">a</a></span></th></tr></thead><tfoot><tr><td colspan="8"><ul><li id="jhm2108-note-0001"><p>NOTE: Values for Stat % are given as median (IQR). <b>Abbreviations:</b> IQR, interquartile range; PGY, postgraduate year; Stat, immediately.</p></li><li id="jhm2108-note-0002"><label>a</label><p><em>P</em> value is for comparison between providers who received feedback vs those who did not.</p></li><li id="jhm2108-note-0003"><label>b</label><p>Nontrainee providers are attending physicians, nurse practitioners, and physician assistants.</p></li><li id="jhm2108-note-0004"><label>c</label><p>Trainee providers are residents and fellows.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">807</td><td class="text-align-center">40 (15.869.0)</td><td class="text-align-center">37</td><td class="text-align-center">72.4 (55.089.5)</td><td class="text-align-center">770</td><td class="text-align-center">39.0 (14.965.7)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0003">b</a></span></td><td class="text-align-center">500</td><td class="text-align-center">41.6 (13.571.5)</td><td class="text-align-center">8</td><td class="text-align-center">91.7 (64.097.5)</td><td class="text-align-center">492</td><td class="text-align-center">40.2 (13.270.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers<span class="ref-link"><a class="ref-link-note" href="#jhm2108-note-0004">c</a></span></td><td class="text-align-center">307</td><td class="text-align-center">37.8 (19.162.7)</td><td class="text-align-center">29</td><td class="text-align-center">69.3 (44.380.9)</td><td class="text-align-center">278</td><td class="text-align-center">35.1 (17.655.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">125</td><td class="text-align-center">38.7 (26.850.4)</td><td class="text-align-center">21</td><td class="text-align-center">58.8 (36.872.6)</td><td class="text-align-center">104</td><td class="text-align-center">36.1 (25.945.6)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">54</td><td class="text-align-center">28.1 (23.935.2)</td><td class="text-align-center">5</td><td class="text-align-center">32.0 (25.536.8)</td><td class="text-align-center">49</td><td class="text-align-center">27.9 (23.534.6)</td><td class="text-align-center">0.52</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">71</td><td class="text-align-center">46.5 (39.160.4)</td><td class="text-align-center">16</td><td class="text-align-center">63.9 (54.575.7)</td><td class="text-align-center">55</td><td class="text-align-center">45.1 (36.554.9)</td><td class="text-align-center">&lt;0.001</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General surgery</td><td class="text-align-center">32</td><td class="text-align-center">80.2 (69.690.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">24</td><td class="text-align-center">78.7 (67.987.4)</td><td class="text-align-center">&lt;0.05</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">16</td><td class="text-align-center">86.4 (79.191.1)</td><td class="text-align-center">8</td><td class="text-align-center">89.5 (79.392.7)</td><td class="text-align-center">8</td><td class="text-align-center">84.0 (73.289.1)</td><td class="text-align-center">0.25</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 and higher</td><td class="text-align-center">16</td><td class="text-align-center">74.4 (65.485.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Other</td><td class="text-align-center">150</td><td class="text-align-center">24.2 (9.055.0)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐1</td><td class="text-align-center">31</td><td class="text-align-center">28.2 (18.478.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="2">PGY‐2 or higher</td><td class="text-align-center">119</td><td class="text-align-center">20.9 (5.651.3)</td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td><td class="text-align-center"> </td></tr></tbody></table><section id="jhm2108-sec-0017"><h3 class="main">Stat Ordering Pattern Change by Individual Feedback</h3><p>Among 37 providers who received individual feedback, 8 providers were ranked in the top 10 more than once and received repeated feedback. Twenty‐seven of 37 providers had both pre‐feedback and post‐feedback data and were included in the analysis. Of those, 7 were nontrainee providers, 16 were Medicine residents (5 were PGY‐1), and 4 were General Surgery residents (all PGY‐1). The proportion of stat laboratory orders per provider decreased by 15.7% (95% confidence interval [CI]: 5.6% to 25.9%, <em>P</em> = 0.004) after feedback (Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>). The decrease remained significant after excluding the months in which providers were ranked in the top 10 (11.4%; 95% CI: 0.7% to 22.1%, <em>P</em> = 0.04).</p><table id="jhm2108-tbl-0002"><caption><label>Table 2.</label><span class="description">Stat Laboratory Ordering Practice Changes Among Providers Receiving Feedback and Those Not Receiving Feedback</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left" rowspan="2"> </th><th class="text-align-center rowsep" colspan="5">Top 10 Providers (Received Feedback)</th><th class="text-align-center rowsep" colspan="5">Providers Ranked in 1130 (No Feedback)</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th><th class="text-align-center" rowspan="2">N</th><th class="text-align-center rowsep" colspan="2">Mean Stat %</th><th class="text-align-center" rowspan="2">Mean Difference (95% CI)</th><th class="text-align-center" rowspan="2"><em>P</em> Value</th></tr><tr class="valign-bottom rowsep"><th class="text-align-center">Pre</th><th class="text-align-center">Post</th><th class="text-align-center">Pre</th><th class="text-align-center">Post</th></tr></thead><tfoot><tr><td colspan="11"><ul><li id="jhm2108-note-0005"><p>NOTE: <b>Abbreviations:</b> CI, confidence interval; PGY, postgraduate year; Stat, immediately.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Total</td><td class="text-align-center">27</td><td class="text-align-center">71.2</td><td class="text-align-center">55.5</td><td class="text-align-center">15.7 (25.9 to 5.6)</td><td class="text-align-center">0.004</td><td class="text-align-center">39</td><td class="text-align-center">64.6</td><td class="text-align-center">60.2</td><td class="text-align-center">4.5 (11.0 to 2.1)</td><td class="text-align-center">0.18</td></tr><tr class="valign-top"><td class="text-align-left">Nontrainee providers</td><td class="text-align-center">7</td><td class="text-align-center">94.6</td><td class="text-align-center">73.2</td><td class="text-align-center">21.4 (46.9 to 4.1)</td><td class="text-align-center">0.09</td><td class="text-align-center">12</td><td class="text-align-center">84.4</td><td class="text-align-center">80.6</td><td class="text-align-center">3.8 (11.9 to 4.3)</td><td class="text-align-center">0.32</td></tr><tr class="valign-top"><td class="text-align-left">Trainee providers</td><td class="text-align-center">20</td><td class="text-align-center">63.0</td><td class="text-align-center">49.3</td><td class="text-align-center">13.7 (25.6 to 1.9)</td><td class="text-align-center">0.03</td><td class="text-align-center">27</td><td class="text-align-center">55.8</td><td class="text-align-center">51.1</td><td class="text-align-center">4.7 (13.9 to 4.4)</td><td class="text-align-center">0.30</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">Medicine</td><td class="text-align-center">16</td><td class="text-align-center">55.8</td><td class="text-align-center">45.0</td><td class="text-align-center">10.8 (23.3 to 1.6)</td><td class="text-align-center">0.08</td><td class="text-align-center">21</td><td class="text-align-center">46.2</td><td class="text-align-center">41.3</td><td class="text-align-center">4.8 (16.3 to 6.7)</td><td class="text-align-center">0.39</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">General Surgery</td><td class="text-align-center">4</td><td class="text-align-center">91.9</td><td class="text-align-center">66.4</td><td class="text-align-center">25.4 (78.9 to 28.0)</td><td class="text-align-center">0.23</td><td class="text-align-center">6</td><td class="text-align-center">89.6</td><td class="text-align-center">85.2</td><td class="text-align-center">4.4 (20.5 to 11.6)</td><td class="text-align-center">0.51</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐1</td><td class="text-align-center">9</td><td class="text-align-center">58.9</td><td class="text-align-center">47.7</td><td class="text-align-center">11.2 (32.0 to 9.5)</td><td class="text-align-center">0.25</td><td class="text-align-center">15</td><td class="text-align-center">55.2</td><td class="text-align-center">49.2</td><td class="text-align-center">6.0 (18.9 to 6.9)</td><td class="text-align-center">0.33</td></tr><tr class="valign-top"><td class="text-align-left" indentlevel="1">PGY‐2 or Higher</td><td class="text-align-center">11</td><td class="text-align-center">66.4</td><td class="text-align-center">50.6</td><td class="text-align-center">15.8 (32.7 to 1.1)</td><td class="text-align-center">0.06</td><td class="text-align-center">12</td><td class="text-align-center">56.6</td><td class="text-align-center">53.5</td><td class="text-align-center">3.1 (18.3 to 12.1)</td><td class="text-align-center">0.66</td></tr></tbody></table><p>In comparison, a total of 57 providers who did not receive feedback were in the 11 to 30 range during the intervention period. Three Obstetrics and Gynecology residents and 3 Family Medicine residents were excluded from the analysis to match specialty with providers who received feedback. Thirty‐nine of 51 providers had adequate data and were included in the analysis, comprising 12 nontrainee providers, 21 Medicine residents (10 were PGY‐1), and 6 General Surgery residents (5 were PGY‐1). Among them, the proportion of stat laboratory orders per provider did not change significantly, with a 4.5% decrease (95% CI: 2.1% to 11.0%, <em>P</em> = 0.18; Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0002">2</a></span>).</p></section><section id="jhm2108-sec-0018"><h3 class="main">Stat Ordering Trends Among Trainee Providers</h3><p>After exclusion of data for the month with &lt;10 total laboratory tests per provider, a total of 303 trainee providers remained, providing 2322 data points for analysis. Of the 303, 125 were Medicine residents (54 were PGY‐1), 32 were General Surgery residents (16 were PGY‐1), and 146 were others (31 were PGY‐1). The monthly trends for the average proportion of stat orders among those providers are shown in Figure <span class="ref-link"><a class="ref-link-fig" href="#jhm2108-fig-0001">1</a></span>. The decrease in the proportion of stat orders was observed after January 2010 in Medicine and General Surgery residents both in PGY‐1 and PGY‐2 or higher, but no change was observed in other trainee providers.</p><div id="jhm2108-fig-0001"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/jhm2108-fig-0001-m.png" width="996" height="1083" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Monthly trends for the average proportion of stat orders among those providers. Abbreviations: PGY, postgraduate year; stat, immediately.</figcaption></figure></div></section></section></section><section id="jhm2108-sec-0019"><h3 class="main">DISCUSSION</h3><p>We describe a series of interventions implemented at our institution to decrease the utilization of stat laboratory orders. Based on an audit of laboratory‐ordering data, we decided to target high utilizers of stat laboratory tests, especially Medicine and General Surgery residents. After presenting an educational session to those residents, we gave individual feedback to the highest utilizers of stat laboratory orders. Providers who received feedback decreased their utilization of stat laboratory orders, but the stat ordering pattern did not change among those who did not receive feedback.</p><p>The individual feedback intervention involved key stakeholders for resident and nontrainee provider education (directors of the Medicine and General Surgery residency programs and other direct clinical supervisors). The targeted feedback was delivered via direct supervisors and was provided more than once as needed, which are key factors for effective feedback in modifying behavior in professional practice.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0019">19</a>]</span> Allowing the supervisors to choose the most appropriate form of feedback for each individual (meetings, phone calls, or e‐mail) enabled timely and individually tailored feedback and contributed to successful implementation. We feel intervention had high educational value for residents, as it promoted residents' engagement in proper systems‐based practice, one of the 6 core competencies of the Accreditation Council for Graduate Medical Education (ACGME).</p><p>We utilized the EMR to obtain provider‐specific data for feedback and analysis. As previously suggested, the use of the EMR for audit and feedback was effective in providing timely, actionable, and individualized feedback with peer benchmarking.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0020">20</a>, <a class="ref-link-bib" href="#jhm2108-bib-0021">21</a>]</span> We used the raw number of stat laboratory orders for audit and the proportion of stat orders out of total orders to assess the individual behavioral patterns. Although the proportional use of stat orders is affected by patient acuity and workplace or rotation site, it also seems largely affected by provider's preference or practice patterns, as we saw the variance among providers of the same specialty and educational level. The changes in the stat ordering trends only seen among Medicine and General Surgery residents suggests that our interventions successfully decreased the overall utilization of stat laboratory orders among targeted providers, and it seems less likely that those decreases are due to changes in patient acuity, changes in rotation sites, or learning curve among trainee providers. When averaged over the 10‐month study period, as shown in Table <span class="ref-link"><a class="ref-link-tbl" href="#jhm2108-tbl-0001">1</a></span>, the providers who received feedback ordered a higher proportion of stat tests than those who did not receive feedback, except for PGY‐1 residents. This suggests that although auditing based on the number of stat laboratory orders identified providers who tended to order more stat tests than others, it may not be a reliable indicator for PGY‐1 residents, whose number of laboratory orders highly fluctuates by rotation.</p><p>There are certain limitations to our study. First, we assumed that the top utilizers were inappropriately ordering stat laboratory tests. Because there is no clear consensus as to what constitutes appropriate stat testing,<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0007">7</a>]</span> it was difficult, if not impossible, to determine which specific orders were inappropriate. However, high variability of the stat ordering pattern in the analysis provides some evidence that high stat utilizers customarily order more stat testing as compared with others. A recent study also revealed that the median stat ordering percentage was 35.9% among 52 US institutions.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0013">13</a>]</span> At our institution, 47.8% of laboratory tests were ordered stat prior to the intervention, higher than the benchmark, providing the rationale for our intervention.</p><p>Second, the intervention was conducted in a time‐series fashion and no randomization was employed. The comparison of providers who received feedback with those who did not is subject to selection bias, and the difference in the change in stat ordering pattern between these 2 groups may be partially due to variability of work location, rotation type, or acuity of patients. However, we performed a sensitivity analysis excluding the months when the providers were ranked in the top 10, assuming that they may have ordered an unusually high proportion of stat tests due to high acuity of patients (eg, rotation in the intensive care units) during those months. Robust results in this analysis support our contention that individual feedback was effective. In addition, we cannot completely rule out the possibility that the changes in stat ordering practice may be solely due to natural maturation effects within an academic year among trainee providers, especially PGY‐1 residents. However, relatively acute changes in the stat ordering trends only among targeted provider groups around January 2010, corresponding to the timing of interventions, suggest otherwise.</p><p>Third, we were not able to test if the intervention or decrease in stat orders adversely affected patient care. For example, if, after receiving feedback, providers did not order some tests stat that should have been ordered that way, this could have negatively affected patient care. Additionally, we did not evaluate whether reduction in stat laboratory orders improved timeliness of the reporting of stat laboratory results.</p><p>Lastly, the sustained effect and feasibility of this intervention were not tested. Past studies suggest educational interventions in laboratory ordering behavior would most likely need to be continued to maintain its effectiveness.<span class="ref-link">[<a class="ref-link-bib" href="#jhm2108-bib-0022">22</a>, <a class="ref-link-bib" href="#jhm2108-bib-0023">23</a>]</span> Although we acknowledge that sustainability of this type of intervention may be difficult, we feel we have demonstrated that there is still value associated with giving personalized feedback.</p><p>This study has implications for future interventions and research. Use of automated, EMR‐based feedback on laboratory ordering performance may be effective in reducing excessive stat ordering and may obviate the need for time‐consuming efforts by supervisors. Development of quality indicators that more accurately assess stat ordering patterns, potentially adjusted for working sites and patient acuity, may be necessary. Studies that measure the impact of decreasing stat laboratory orders on turnaround times and cost may be of value.</p></section><section id="jhm2108-sec-0020"><h3 class="main">CONCLUSION</h3><p>At our urban, tertiary‐care teaching institution, stat ordering frequency was highly variable among providers. Targeted individual feedback to providers who ordered a large number of stat laboratory tests decreased their stat laboratory order utilization.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="jhm2108-bib-0001"><cite class="journal" id="ref-cit1"><span class="author">Jahn M</span>. <span class="articleTitle">Turnaround time, part 2: stats too high, yet labs cope</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">1993</span>;<span class="vol">25</span>(<span class="issue">9</span>):<span class="pageFirst">33</span>–<span class="pageLast">38</span>. </cite></li><li id="jhm2108-bib-0002"><cite class="journal" id="ref-cit2"><span class="author">Valenstein P</span>. <span class="articleTitle">Laboratory turnaround time</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">676</span>–<span class="pageLast">688</span>. </cite></li><li id="jhm2108-bib-0003"><cite class="journal" id="ref-cit3"><span class="author">Blick KE</span>. <span class="articleTitle">No more STAT testing</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">2005</span>;<span class="vol">37</span>(<span class="issue">8</span>):<span class="pageFirst">22</span>, 24, 26. </cite></li><li id="jhm2108-bib-0004"><cite class="journal" id="ref-cit4"><span class="author">Lippi G</span>, <span class="author">Simundic AM</span>, <span class="author">Plebani M</span>. <span class="articleTitle">Phlebotomy, stat testing and laboratory organization: an intriguing relationship</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2012</span>;<span class="vol">50</span>(<span class="issue">12</span>):<span class="pageFirst">2065</span>–<span class="pageLast">2068</span>. </cite></li><li id="jhm2108-bib-0005"><cite class="journal" id="ref-cit5"><span class="author">Trisorio Liuzzi MP</span>, <span class="author">Attolini E</span>, <span class="author">Quaranta R</span>, et al. <span class="articleTitle">Laboratory request appropriateness in emergency: impact on hospital organization</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2006</span>;<span class="vol">44</span>(<span class="issue">6</span>):<span class="pageFirst">760</span>–<span class="pageLast">764</span>. </cite></li><li id="jhm2108-bib-0006"><cite class="other" id="ref-cit6"><span class="groupName">College of American Pathologists</span>.<span class="otherTitle">Definitions used in past Q‐PROBES studies (1991–2011)</span>. Available at: <span class="url">http://www.cap.org/apps/docs/q_probes/q‐probes_definitions.pdf</span>. Updated September 29, 2011. Accessed July 31, <span class="pubYear">2013</span>. </cite></li><li id="jhm2108-bib-0007"><cite class="journal" id="ref-cit7"><span class="author">Hilborne L</span>, <span class="author">Lee H</span>, <span class="author">Cathcart P</span>. <span class="articleTitle">Practice Parameter. STAT testing? A guideline for meeting clinician turnaround time requirements</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">671</span>–<span class="pageLast">675</span>. </cite></li><li id="jhm2108-bib-0008"><cite class="journal" id="ref-cit8"><span class="author">Howanitz PJ</span>, <span class="author">Steindel SJ</span>. <span class="articleTitle">Intralaboratory performance and laboratorians' expectations for stat turnaround times: a College of American Pathologists Q‐Probes study of four cerebrospinal fluid determinations</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">1991</span>;<span class="vol">115</span>(<span class="issue">10</span>):<span class="pageFirst">977</span>–<span class="pageLast">983</span>. </cite></li><li id="jhm2108-bib-0009"><cite class="journal" id="ref-cit9"><span class="author">Winkelman JW</span>, <span class="author">Tanasijevic MJ</span>, <span class="author">Wybenga DR</span>, <span class="author">Otten J</span>. <span class="articleTitle">How fast is fast enough for clinical laboratory turnaround time? Measurement of the interval between result entry and inquiries for reports</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1997</span>;<span class="vol">108</span>(<span class="issue">4</span>):<span class="pageFirst">400</span>–<span class="pageLast">405</span>. </cite></li><li id="jhm2108-bib-0010"><cite class="journal" id="ref-cit10"><span class="author">Fleisher M</span>, <span class="author">Schwartz MK</span>. <span class="articleTitle">Strategies of organization and service for the critical‐care laboratory</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1990</span>;<span class="vol">36</span>(<span class="issue">8</span>):<span class="pageFirst">1557</span>–<span class="pageLast">1561</span>. </cite></li><li id="jhm2108-bib-0011"><cite class="journal" id="ref-cit11"><span class="author">Hilborne LH</span>, <span class="author">Oye RK</span>, <span class="author">McArdle JE</span>, <span class="author">Repinski JA</span>, <span class="author">Rodgerson DO</span>. <span class="articleTitle">Evaluation of stat and routine turnaround times as a component of laboratory quality</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1989</span>;<span class="vol">91</span>(<span class="issue">3</span>):<span class="pageFirst">331</span>–<span class="pageLast">335</span>. </cite></li><li id="jhm2108-bib-0012"><cite class="journal" id="ref-cit12"><span class="author">Howanitz JH</span>, <span class="author">Howanitz PJ</span>. <span class="articleTitle">Laboratory results: Timeliness as a quality attribute and strategy</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">2001</span>;<span class="vol">116</span>(<span class="issue">3</span>):<span class="pageFirst">311</span>–<span class="pageLast">315</span>. </cite></li><li id="jhm2108-bib-0013"><cite class="journal" id="ref-cit13"><span class="author">Volmar KE</span>, <span class="author">Wilkinson DS</span>, <span class="author">Wagar EA</span>, <span class="author">Lehman CM</span>. <span class="articleTitle">Utilization of stat test priority in the clinical laboratory: a College of American Pathologists Q‐Probes study of 52 institutions</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">2013</span>;<span class="vol">137</span>(<span class="issue">2</span>):<span class="pageFirst">220</span>–<span class="pageLast">227</span>. </cite></li><li id="jhm2108-bib-0014"><cite class="journal" id="ref-cit14"><span class="author">Belsey R</span>. <span class="articleTitle">Controlling the use of stat testing</span>. <span class="journalTitle">Pathologist.</span> <span class="pubYear">1984</span>;<span class="vol">38</span>(<span class="issue">8</span>):<span class="pageFirst">474</span>–<span class="pageLast">477</span>. </cite></li><li id="jhm2108-bib-0015"><cite class="journal" id="ref-cit15"><span class="author">Burnett L</span>, <span class="author">Chesher D</span>, <span class="author">Burnett JR</span>. <span class="articleTitle">Optimizing the availability of ‘stat' laboratory tests using Shewhart ‘C' control charts</span>. <span class="journalTitle">Ann Clin Biochem.</span> <span class="pubYear">2002</span>;<span class="vol">39</span>(<span class="issue">part 2</span>):<span class="pageFirst">140</span>–<span class="pageLast">144</span>. </cite></li><li id="jhm2108-bib-0016"><cite class="journal" id="ref-cit16"><span class="author">Kilgore ML</span>, <span class="author">Steindel SJ</span>, <span class="author">Smith JA</span>. <span class="articleTitle">Evaluating stat testing options in an academic health center: therapeutic turnaround time and staff satisfaction</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1998</span>;<span class="vol">44</span>(<span class="issue">8</span>):<span class="pageFirst">1597</span>–<span class="pageLast">1603</span>. </cite></li><li id="jhm2108-bib-0017"><cite class="journal" id="ref-cit17"><span class="author">Hwang JI</span>, <span class="author">Park HA</span>, <span class="author">Bakken S</span>. <span class="articleTitle">Impact of a physician's order entry (POE) system on physicians' ordering patterns and patient length of stay</span>. <span class="journalTitle">Int J Med Inform.</span> <span class="pubYear">2002</span>;<span class="vol">65</span>(<span class="issue">3</span>):<span class="pageFirst">213</span>–<span class="pageLast">223</span>. </cite></li><li id="jhm2108-bib-0018"><cite class="journal" id="ref-cit18"><span class="author">Lifshitz MS</span>, <span class="author">Cresce RP</span>. <span class="articleTitle">Instrumentation for STAT analyses</span>. <span class="journalTitle">Clin Lab Med.</span> <span class="pubYear">1988</span>;<span class="vol">8</span>(<span class="issue">4</span>):<span class="pageFirst">689</span>–<span class="pageLast">697</span>. </cite></li><li id="jhm2108-bib-0019"><cite class="journal" id="ref-cit19"><span class="author">Ivers N</span>, <span class="author">Jamtvedt G</span>, <span class="author">Flottorp S</span>, et al. <span class="articleTitle">Audit and feedback: effects on professional practice and healthcare outcomes</span>. <span class="journalTitle">Cochrane Database Syst Rev.</span> <span class="pubYear">2012</span>;<span class="vol">6</span>:<span class="pageFirst">CD000259</span>. </cite></li><li id="jhm2108-bib-0020"><cite class="journal" id="ref-cit20"><span class="author">Landis Lewis Z</span>, <span class="author">Mello‐Thoms C</span>, <span class="author">Gadabu OJ</span>, <span class="author">Gillespie EM</span>, <span class="author">Douglas GP</span>, <span class="author">Crowley RS</span>. <span class="articleTitle">The feasibility of automating audit and feedback for ART guideline adherence in Malawi</span>. <span class="journalTitle">J Am Med Inform Assoc.</span> <span class="pubYear">2011</span>;<span class="vol">18</span>(<span class="issue">6</span>):<span class="pageFirst">868</span>–<span class="pageLast">874</span>. </cite></li><li id="jhm2108-bib-0021"><cite class="journal" id="ref-cit21"><span class="author">Gerber JS</span>, <span class="author">Prasad PA</span>, <span class="author">Fiks AG</span>, et al. <span class="articleTitle">Effect of an outpatient antimicrobial stewardship intervention on broad‐spectrum antibiotic prescribing by primary care pediatricians: a randomized trial</span>. <span class="journalTitle">JAMA.</span> <span class="pubYear">2013</span>;<span class="vol">309</span>(<span class="issue">22</span>):<span class="pageFirst">2345</span>–<span class="pageLast">2352</span>. </cite></li><li id="jhm2108-bib-0022"><cite class="journal" id="ref-cit22"><span class="author">Eisenberg JM</span>. <span class="articleTitle">An educational program to modify laboratory use by house staff</span>. <span class="journalTitle">J Med Educ.</span> <span class="pubYear">1977</span>;<span class="vol">52</span>(<span class="issue">7</span>):<span class="pageFirst">578</span>–<span class="pageLast">581</span>. </cite></li><li id="jhm2108-bib-0023"><cite class="journal" id="ref-cit23"><span class="author">Wong ET</span>, <span class="author">McCarron MM</span>, <span class="author">Shaw ST</span>. <span class="articleTitle">Ordering of laboratory tests in a teaching hospital: can it be improved?</span> <span class="journalTitle">JAMA.</span> <span class="pubYear">1983</span>;<span class="vol">249</span>(<span class="issue">22</span>):<span class="pageFirst">3076</span>–<span class="pageLast">3080</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="jhm2108-bib-0001"><cite class="journal" id="ref-cit1"><span class="author">Jahn M</span>. <span class="articleTitle">Turnaround time, part 2: stats too high, yet labs cope</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">1993</span>;<span class="vol">25</span>(<span class="issue">9</span>):<span class="pageFirst">33</span>–<span class="pageLast">38</span>. </cite></li><li id="jhm2108-bib-0002"><cite class="journal" id="ref-cit2"><span class="author">Valenstein P</span>. <span class="articleTitle">Laboratory turnaround time</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">676</span>–<span class="pageLast">688</span>. </cite></li><li id="jhm2108-bib-0003"><cite class="journal" id="ref-cit3"><span class="author">Blick KE</span>. <span class="articleTitle">No more STAT testing</span>. <span class="journalTitle">MLO Med Lab Obs.</span> <span class="pubYear">2005</span>;<span class="vol">37</span>(<span class="issue">8</span>):<span class="pageFirst">22</span>, 24, 26. </cite></li><li id="jhm2108-bib-0004"><cite class="journal" id="ref-cit4"><span class="author">Lippi G</span>, <span class="author">Simundic AM</span>, <span class="author">Plebani M</span>. <span class="articleTitle">Phlebotomy, stat testing and laboratory organization: an intriguing relationship</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2012</span>;<span class="vol">50</span>(<span class="issue">12</span>):<span class="pageFirst">2065</span>–<span class="pageLast">2068</span>. </cite></li><li id="jhm2108-bib-0005"><cite class="journal" id="ref-cit5"><span class="author">Trisorio Liuzzi MP</span>, <span class="author">Attolini E</span>, <span class="author">Quaranta R</span>, et al. <span class="articleTitle">Laboratory request appropriateness in emergency: impact on hospital organization</span>. <span class="journalTitle">Clin Chem Lab Med.</span> <span class="pubYear">2006</span>;<span class="vol">44</span>(<span class="issue">6</span>):<span class="pageFirst">760</span>–<span class="pageLast">764</span>. </cite></li><li id="jhm2108-bib-0006"><cite class="other" id="ref-cit6"><span class="groupName">College of American Pathologists</span>.<span class="otherTitle">Definitions used in past Q‐PROBES studies (1991–2011)</span>. Available at: <span class="url">http://www.cap.org/apps/docs/q_probes/q‐probes_definitions.pdf</span>. Updated September 29, 2011. Accessed July 31, <span class="pubYear">2013</span>. </cite></li><li id="jhm2108-bib-0007"><cite class="journal" id="ref-cit7"><span class="author">Hilborne L</span>, <span class="author">Lee H</span>, <span class="author">Cathcart P</span>. <span class="articleTitle">Practice Parameter. STAT testing? A guideline for meeting clinician turnaround time requirements</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1996</span>;<span class="vol">105</span>(<span class="issue">6</span>):<span class="pageFirst">671</span>–<span class="pageLast">675</span>. </cite></li><li id="jhm2108-bib-0008"><cite class="journal" id="ref-cit8"><span class="author">Howanitz PJ</span>, <span class="author">Steindel SJ</span>. <span class="articleTitle">Intralaboratory performance and laboratorians' expectations for stat turnaround times: a College of American Pathologists Q‐Probes study of four cerebrospinal fluid determinations</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">1991</span>;<span class="vol">115</span>(<span class="issue">10</span>):<span class="pageFirst">977</span>–<span class="pageLast">983</span>. </cite></li><li id="jhm2108-bib-0009"><cite class="journal" id="ref-cit9"><span class="author">Winkelman JW</span>, <span class="author">Tanasijevic MJ</span>, <span class="author">Wybenga DR</span>, <span class="author">Otten J</span>. <span class="articleTitle">How fast is fast enough for clinical laboratory turnaround time? Measurement of the interval between result entry and inquiries for reports</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1997</span>;<span class="vol">108</span>(<span class="issue">4</span>):<span class="pageFirst">400</span>–<span class="pageLast">405</span>. </cite></li><li id="jhm2108-bib-0010"><cite class="journal" id="ref-cit10"><span class="author">Fleisher M</span>, <span class="author">Schwartz MK</span>. <span class="articleTitle">Strategies of organization and service for the critical‐care laboratory</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1990</span>;<span class="vol">36</span>(<span class="issue">8</span>):<span class="pageFirst">1557</span>–<span class="pageLast">1561</span>. </cite></li><li id="jhm2108-bib-0011"><cite class="journal" id="ref-cit11"><span class="author">Hilborne LH</span>, <span class="author">Oye RK</span>, <span class="author">McArdle JE</span>, <span class="author">Repinski JA</span>, <span class="author">Rodgerson DO</span>. <span class="articleTitle">Evaluation of stat and routine turnaround times as a component of laboratory quality</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">1989</span>;<span class="vol">91</span>(<span class="issue">3</span>):<span class="pageFirst">331</span>–<span class="pageLast">335</span>. </cite></li><li id="jhm2108-bib-0012"><cite class="journal" id="ref-cit12"><span class="author">Howanitz JH</span>, <span class="author">Howanitz PJ</span>. <span class="articleTitle">Laboratory results: Timeliness as a quality attribute and strategy</span>. <span class="journalTitle">Am J Clin Pathol.</span> <span class="pubYear">2001</span>;<span class="vol">116</span>(<span class="issue">3</span>):<span class="pageFirst">311</span>–<span class="pageLast">315</span>. </cite></li><li id="jhm2108-bib-0013"><cite class="journal" id="ref-cit13"><span class="author">Volmar KE</span>, <span class="author">Wilkinson DS</span>, <span class="author">Wagar EA</span>, <span class="author">Lehman CM</span>. <span class="articleTitle">Utilization of stat test priority in the clinical laboratory: a College of American Pathologists Q‐Probes study of 52 institutions</span>. <span class="journalTitle">Arch Pathol Lab Med.</span> <span class="pubYear">2013</span>;<span class="vol">137</span>(<span class="issue">2</span>):<span class="pageFirst">220</span>–<span class="pageLast">227</span>. </cite></li><li id="jhm2108-bib-0014"><cite class="journal" id="ref-cit14"><span class="author">Belsey R</span>. <span class="articleTitle">Controlling the use of stat testing</span>. <span class="journalTitle">Pathologist.</span> <span class="pubYear">1984</span>;<span class="vol">38</span>(<span class="issue">8</span>):<span class="pageFirst">474</span>–<span class="pageLast">477</span>. </cite></li><li id="jhm2108-bib-0015"><cite class="journal" id="ref-cit15"><span class="author">Burnett L</span>, <span class="author">Chesher D</span>, <span class="author">Burnett JR</span>. <span class="articleTitle">Optimizing the availability of ‘stat' laboratory tests using Shewhart ‘C' control charts</span>. <span class="journalTitle">Ann Clin Biochem.</span> <span class="pubYear">2002</span>;<span class="vol">39</span>(<span class="issue">part 2</span>):<span class="pageFirst">140</span>–<span class="pageLast">144</span>. </cite></li><li id="jhm2108-bib-0016"><cite class="journal" id="ref-cit16"><span class="author">Kilgore ML</span>, <span class="author">Steindel SJ</span>, <span class="author">Smith JA</span>. <span class="articleTitle">Evaluating stat testing options in an academic health center: therapeutic turnaround time and staff satisfaction</span>. <span class="journalTitle">Clin Chem.</span> <span class="pubYear">1998</span>;<span class="vol">44</span>(<span class="issue">8</span>):<span class="pageFirst">1597</span>–<span class="pageLast">1603</span>. </cite></li><li id="jhm2108-bib-0017"><cite class="journal" id="ref-cit17"><span class="author">Hwang JI</span>, <span class="author">Park HA</span>, <span class="author">Bakken S</span>. <span class="articleTitle">Impact of a physician's order entry (POE) system on physicians' ordering patterns and patient length of stay</span>. <span class="journalTitle">Int J Med Inform.</span> <span class="pubYear">2002</span>;<span class="vol">65</span>(<span class="issue">3</span>):<span class="pageFirst">213</span>–<span class="pageLast">223</span>. </cite></li><li id="jhm2108-bib-0018"><cite class="journal" id="ref-cit18"><span class="author">Lifshitz MS</span>, <span class="author">Cresce RP</span>. <span class="articleTitle">Instrumentation for STAT analyses</span>. <span class="journalTitle">Clin Lab Med.</span> <span class="pubYear">1988</span>;<span class="vol">8</span>(<span class="issue">4</span>):<span class="pageFirst">689</span>–<span class="pageLast">697</span>. </cite></li><li id="jhm2108-bib-0019"><cite class="journal" id="ref-cit19"><span class="author">Ivers N</span>, <span class="author">Jamtvedt G</span>, <span class="author">Flottorp S</span>, et al. <span class="articleTitle">Audit and feedback: effects on professional practice and healthcare outcomes</span>. <span class="journalTitle">Cochrane Database Syst Rev.</span> <span class="pubYear">2012</span>;<span class="vol">6</span>:<span class="pageFirst">CD000259</span>. </cite></li><li id="jhm2108-bib-0020"><cite class="journal" id="ref-cit20"><span class="author">Landis Lewis Z</span>, <span class="author">Mello‐Thoms C</span>, <span class="author">Gadabu OJ</span>, <span class="author">Gillespie EM</span>, <span class="author">Douglas GP</span>, <span class="author">Crowley RS</span>. <span class="articleTitle">The feasibility of automating audit and feedback for ART guideline adherence in Malawi</span>. <span class="journalTitle">J Am Med Inform Assoc.</span> <span class="pubYear">2011</span>;<span class="vol">18</span>(<span class="issue">6</span>):<span class="pageFirst">868</span>–<span class="pageLast">874</span>. </cite></li><li id="jhm2108-bib-0021"><cite class="journal" id="ref-cit21"><span class="author">Gerber JS</span>, <span class="author">Prasad PA</span>, <span class="author">Fiks AG</span>, et al. <span class="articleTitle">Effect of an outpatient antimicrobial stewardship intervention on broad‐spectrum antibiotic prescribing by primary care pediatricians: a randomized trial</span>. <span class="journalTitle">JAMA.</span> <span class="pubYear">2013</span>;<span class="vol">309</span>(<span class="issue">22</span>):<span class="pageFirst">2345</span>–<span class="pageLast">2352</span>. </cite></li><li id="jhm2108-bib-0022"><cite class="journal" id="ref-cit22"><span class="author">Eisenberg JM</span>. <span class="articleTitle">An educational program to modify laboratory use by house staff</span>. <span class="journalTitle">J Med Educ.</span> <span class="pubYear">1977</span>;<span class="vol">52</span>(<span class="issue">7</span>):<span class="pageFirst">578</span>–<span class="pageLast">581</span>. </cite></li><li id="jhm2108-bib-0023"><cite class="journal" id="ref-cit23"><span class="author">Wong ET</span>, <span class="author">McCarron MM</span>, <span class="author">Shaw ST</span>. <span class="articleTitle">Ordering of laboratory tests in a teaching hospital: can it be improved?</span> <span class="journalTitle">JAMA.</span> <span class="pubYear">1983</span>;<span class="vol">249</span>(<span class="issue">22</span>):<span class="pageFirst">3076</span>–<span class="pageLast">3080</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 9(1)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 9(1)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">13-18</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">13-18</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-type"> <div class="field field--name-field-article-type field--type-entity-reference field--label-above"> <div class="field__label">Article Type</div> <div class="field__item"><a href="/article-type/article" hreflang="en">Article</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">The assessment of stat laboratory test ordering practice and impact of targeted individual feedback in an urban teaching hospital</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">The assessment of stat laboratory test ordering practice and impact of targeted individual feedback in an urban teaching hospital</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-sections"> <div class="field field--name-field-article-sections field--type-entity-reference field--label-above"> <div class="field__label">Sections</div> <div class="field__items"> <div class="field__item"><a href="/sections/original-research" hreflang="en">Original Research</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-source"> <div class="clearfix text-formatted field field--name-field-article-source field--type-text-long field--label-above"> <div class="field__label">Article Source</div> <div class="field__item"><p>© 2013 Society of Hospital Medicine</p></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-disallow-ads"> <div class="field field--name-field-article-disallow-ads field--type-boolean field--label-above"> <div class="field__label">Disallow All Ads</div> <div class="field__item"></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-author-contact"> <div class="field field--name-field-article-author-contact field--type-entity-reference field--label-above"> <div class="field__label">Corresponding Author</div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-contact"> <div class="field field--name-field-article-contact field--type-string-long field--label-above"> <div class="field__label">Correspondence Location</div> <div class="field__item">Address for correspondence and reprint requests: Latha Sivaprasad, MD, Senior Vice President of Medical Affairs and Chief Medical Officer, Rhode Island Hospital/Hasbro Children&#039;s Hospital, 593 Eddy St, Providence, RI 02903; Telephone: 401.444.7284; Fax: 401.444.4218; E‐mail: sivaprasadlatha@yahoo.com</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-gating"> <div class="field field--name-field-article-gating field--type-list-string field--label-above"> <div class="field__label">Content Gating</div> <div class="field__item">No Gating (article Unlocked/Free)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-cme-enabled"> <div class="field field--name-field-article-cme-enabled field--type-boolean field--label-above"> <div class="field__label">Alternative CME</div> <div class="field__item"></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-teaser-media"> <div class="field field--name-field-article-teaser-media field--type-entity-reference field--label-above"> <div class="field__label">Teaser Media</div> <div class="field__item"><article> <div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/article_teasers/jhm2108-fig-0001-m.png" width="996" height="1083" typeof="foaf:Image" /> </div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> </div> </div> </article> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf-media"> <div class="field field--name-field-article-pdf-media field--type-entity-reference field--label-above"> <div class="field__label">Article PDF Media</div> <div class="field__item"><article> <div> <div class="field field--name-field-media-document field--type-file field--label-visually_hidden"> <div class="field__label visually-hidden">Document</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/jhm2108.pdf" type="application/pdf">jhm2108.pdf</a></span> </div> </div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> </div> </div> </article> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-media-files"> <div class="field field--name-field-article-media-files field--type-entity-reference field--label-above"> <div class="field__label">Media Files</div> <div class="field__items"> <div class="field__item"><article> <div> <div class="field field--name-field-media-document field--type-file field--label-visually_hidden"> <div class="field__label visually-hidden">Document</div> <div class="field__item"> <span class="file file--mime-application-msword file--x-office-document"> <a href="https://cdn.mdedge.com/files/s3fs-public/journals/supporting/jhm2108-sup-0001-suppinfo.doc" type="application/msword">Supplementary Information (1)</a></span> </div> </div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> </div> </div> </article> </div> </div> </div> </div> </div> </div> Thu, 12 Dec 2013 05:00:00 +0000 Content Migration 128133 at https://ma1.mdedge.com https://ma1.mdedge.com/content/stat-laboratory-order-feedback#comments Outcomes for Inpatient Gainsharing https://ma1.mdedge.com/content/outcomes-inpatient-gainsharing <span property="schema:name" class="field field--name-title field--type-string field--label-hidden">Outcomes for Inpatient Gainsharing</span> <span rel="schema:author" class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/users/content-migration" typeof="schema:Person" property="schema:name" datatype="">Content Migration</span></span> <span property="schema:dateCreated" content="2010-08-17T04:00:00+00:00" class="field field--name-created field--type-created field--label-hidden">Tue, 08/17/2010 - 00:00</span> <div class="layout layout--onecol"> <div class="layout__region layout__region--content"> <div class="block block-layout-builder block-field-blocknodearticlefield-article-type"> <div class="field field--name-field-article-type field--type-entity-reference field--label-above"> <div class="field__label">Article Type</div> <div class="field__item"><a href="/article-type/article" hreflang="en">Article</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlechanged"> <div class="field field--name-changed field--type-changed field--label-inline clearfix"> <div class="field__label">Changed</div> <div class="field__item">Sun, 05/28/2017 - 20:04</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">Quality and financial outcomes from gainsharing for inpatient admissions: A three‐year experience<link href="#fn1" /></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-inline clearfix"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/i-michael-leitman-md" hreflang="en">I. Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/ruth-levin-mpa" hreflang="en">Ruth Levin, MPA</a></div> <div class="field__item"><a href="/authors/michael-j-lipp-md" hreflang="en">Michael J. Lipp, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> <div class="field__item"><a href="/authors/christine-j-karalakulasingam-md" hreflang="en">Christine J. Karalakulasingam, MD</a></div> <div class="field__item"><a href="/authors/david-s-bernard-md" hreflang="en">David S. Bernard, MD</a></div> <div class="field__item"><a href="/authors/patricia-friedmann-ms" hreflang="en">Patricia Friedmann, MS</a></div> <div class="field__item"><a href="/authors/david-j-shulkin-md" hreflang="en">David J. Shulkin, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="sec1-bdy-1"><p>Hospitals are challenged to improve quality while reducing costs, yet traditional methods of cost containment have had limited success in aligning the goals of hospitals and physicians. Physicians directly control more than 80% of total medical costs.<a href="#bib1" rel="references:#bib1">1</a> The current fee‐for‐service system encourages procedures and the use of hospital resources. Without the proper incentives to gain active participation and collaboration of the medical staff in improving the efficiency of care, the ability to manage medical costs and improve hospital operational and financial performance is hampered. A further challenge is to encourage physicians to improve the quality of care and maintain safe medical practice. While several examples of pay‐for‐performance (P4P) have previously been attempted to increase efficiency, gainsharing offers real opportunities to achieve these outcomes.</p><p>Previous reports regarding the results of gainsharing programs describe its use in outpatient settings and its limited ability to reduce costs for inpatient care for surgical implants such as coronary stents<a href="#bib2" rel="references:#bib2">2</a> or orthopedic prostheses.<a href="#bib3" rel="references:#bib3">3</a> The present study represents the largest series to date using a gainsharing model in a comprehensive program of inpatient care at a tertiary care medical center.</p></section><section id="sec1-1"><h3 class="main">Patients and Methods</h3><p>Beth Israel Medical Center is a 1000‐bed tertiary care university‐affiliated teaching hospital, located in New York City. The hospital serves a large and ethnically diverse community predominantly located in the lower east side of Manhattan and discharged about 50,000 patients per year during the study period of July 2006 through June 2009.</p><p>Applied Medical Software, Inc. (AMS, Collingswood, NJ) analyzed hospital data for case mix and severity. To establish best practice norms (BPNs), AMS used inpatient discharge data (UB‐92) to determine costs by APR‐DRG's<a href="#bib4" rel="references:#bib4">4</a> during calendar year 2005, prior to the inception of the program to establish BPNs. Costs were allocated into specific areas listed in Table <a href="#tbl1" rel="references:#tbl1">1</a>. A minimum of 10 cases was necessary in each DRG. Cost outliers (as defined by the mean cost of the APR DRG plus 3 standard deviations) were excluded. These data were used to establish a baseline for each physician and a BPN, which was set at the top 25th percentile for each specific APR DRG. BPNs were determined after exclusions using the following criteria:</p><ul><li><label>1</label><p>Each eligible physician had to have at least 10 admissions within their specialty;</p></li><li><label>2</label><p>Each eligible DRG had to have at least 5 qualifying physicians within a medical specialty;</p></li><li><label>3</label><p>Each eligible APR DRG had to have at least 3 qualifying admissions;</p></li><li><label>4</label><p>If the above criteria are met, the BPN was set at the mean of the top 25th percentile of physicians (25% of the physicians with the lowest costs).</p></li></ul><p> </p><table id="tbl1"><caption><label>Table 1.</label><span class="description">Hospital Cost Allocation Areas in the Gainsharing Program</span></caption><thead></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-15"><p><b>Abbreviations:</b> CCU, coronary care unit; ICU, intensive care unit.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Per diem hospital bed cost</td><td class="text-align-left">Pharmacy</td></tr><tr class="valign-top"><td class="text-align-left">Critical care (ICU and CCU)</td><td class="text-align-left">Laboratory</td></tr><tr class="valign-top"><td class="text-align-left">Medical surgical supplies and implants</td><td class="text-align-left">Cardiopulmonary care</td></tr><tr class="valign-top"><td class="text-align-left">Operating room costs</td><td class="text-align-left">Blood bank</td></tr><tr class="valign-top"><td class="text-align-left">Radiology</td><td class="text-align-left">Intravenous therapy</td></tr></tbody></table><p>Once BPNs were determined, patients were grouped by physician and compared to the BPN for a particular APR DRG. All patients of participating physicians with qualifying APR DRGs were included in the analysis reports summarizing these results, computed quarterly and distributed to each physician. Obstetrical and psychiatric admissions were excluded in the program. APR DRG data for each physician was compared from year to year to determine whether an individual physician demonstrated measurable improvement in performance.</p><p>The gainsharing program was implemented in 2006. Physician participation was voluntary. Payments were made to physicians without any risk or penalties from participation. Incentives were based on individual performance. Incentives for nonsurgical admissions were intended to offset the loss of physician income related to more efficient medical management and a reduced hospital length of stay (LOS). Income for surgical admissions was intended to reward physicians for efficient preoperative and postoperative care.</p><p>The methodology provides financial incentives for physicians for each hospital discharge in 2 ways:</p><ul><li><label>1</label><p>Improvement in costs per case against their own historical performance;</p></li><li><label>2</label><p>Cost per case performance compared to BPN.</p></li></ul><p> </p><p>In the first year of the gainsharing program, two thirds of the total allowable incentive payments were allocated to physicians' improvement, with one third based on a performance metric. Payments for improvement were phased out over the first 3 years of the gainsharing program, with payments focused fully on performance in Year 3. Cases were adjusted for case‐mix and severity of illness (four levels of APR DRG). Physicians were not penalized for any cases in which costs greatly exceeded BPN. A floor was placed at the BPN and no additional financial incentives were paid for surpassing it. Baselines and BPNs were recalculated yearly.</p><p>A key aspect of the gainsharing program was the establishment of specific quality parameters (Table <a href="#tbl2" rel="references:#tbl2">2</a>) that need to be met before any incentive payments were made. A committee regularly reviewed the quality performance data of each physician to determine eligibility for payments. Physicians were considered to be ineligible for incentive compensation until the next measurement period if there was evidence of failure to adequately meet these measures. At least 80% compliance with core measures (minimum 5 discharges in each domain) was expected. Infectious complication rates were to remain not more than 1 standard deviation above National Healthcare Safety Network rates during the same time period. In addition, payments were withheld from physicians if it was found that the standard of care was not met for any morbidity or mortality that was peer reviewed or if there were any significant patient complaints. Readmission rates were expected to remain at or below the baseline established during the previous 12 months by DRG.</p><table id="tbl2"><caption><label>Table 2.</label><span class="description">Quality Factors Used to Determine Physician Payment in Gainsharing Program</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Quality Measure</th><th class="text-align-left">Goal</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-23"><p><b>Abbreviations:</b> ACEI, Angiotensin converting enzyme inhibitor; AMI, Acute myocardial infarction; ARB, Angiotensin II receptor blockers; CHF, Congestive heart failure; HCAHPS, Hospital consumer assessment of healthcare providers and systems; LVSD, left ventricular systolic dysfunction; NHSN, Center for Disease Control (CDC) National Healthcare Safety Network.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Readmissions within 7 days for the same or related diagnosis</td><td class="text-align-left">Decrease, or less than 10% of discharges</td></tr><tr class="valign-top"><td class="text-align-left">Documentationquality and timeliness of medical record and related documentation including date, time, and sign all chart entries</td><td class="text-align-left">No more than 20% of average monthly discharged medical records incomplete for more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Consultation with social work/discharge planner within 24 hours of admission for appropriate pts</td><td class="text-align-left">&gt;80% of all appropriate cases</td></tr><tr class="valign-top"><td class="text-align-left">Timely switch from intravenous to oral antibiotics in accordance with hospital policy (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Unanticipated return to the operating room</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Patient complaints</td><td class="text-align-left">Decrease</td></tr><tr class="valign-top"><td class="text-align-left">Patient satisfaction (HCAHPS)</td><td class="text-align-left">&gt;75% physician domain</td></tr><tr class="valign-top"><td class="text-align-left">Ventilator associated pneumonia</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Central line associated blood stream infections</td><td class="text-align-left">Decrease or &lt; 5 per 1000 catheter days.</td></tr><tr class="valign-top"><td class="text-align-left">Surgical site infections</td><td class="text-align-left">Decrease or within 1 standard deviation of NHSN</td></tr><tr class="valign-top"><td class="text-align-left">Antibiotic prophylaxis (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Inpatient mortality</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Medication errors</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Delinquent medical records</td><td class="text-align-left">&lt;5 charts delinquent more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Falls with injury</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">AMI: aspirin on arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ACEI or ARB for LVSD (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Adult smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ Beta blocker prescribed at arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: discharge instructions (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: Left ventricular function assessment (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: ACEI or ARB for left ventricular systolic dysfunction (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Pneumonia: O2 assessment, pneumococcal vaccine, blood culture and sensitivity before first antibiotic, smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr></tbody></table><p>Employed and private practice community physicians were both eligible for the gainsharing program. Physician participation in the program was voluntary. All patients admitted to the Medical Center received notification on admission about the program. The aggregate costs by DRG were calculated quarterly. Savings over the previous yearif anywere calculated. A total of 20% of the savings was used to administer the program and for incentive payments to physicians.</p><p>From July 1, 2006 through September 2008, only commercial managed care cases were eligible for this program. As a result of the approval of the gainsharing program as a demonstration project by the Centers for Medicare and Medicaid Services (CMS), Medicare cases were added to the program starting October 1, 2008.</p></section><section id="sec1-2"><h3 class="main">Physician Payment Calculation Methodology</h3><section id="sec2-1"><h3 class="main">Performance Incentive</h3><p>The performance incentive was intended to reward demonstrated levels of performance. Accordingly, a physician's share in hospital savings was in proportion to the relationship between their individual performance and the BPN. This computation was the same for both surgical and medical admissions. The following equation illustrates the computation of performance incentives for participating physicians: <displayeditem class="mathematics" id="di-ueqn-1" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-1"><mediaresource alt="equation image" href="tex2gif-ueqn-1.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\displaystyle{\rm 90{th}\ Percentile\ BPN\ Cost}{\hbox{-}}{\rm Physician's\ Actual\ Cost} \over \displaystyle{\rm 90{th}\ Percentile\ Cost}{\hbox{-}}{\rm Best\ Practice\ Norm\ Cost }\right\}\cr {\rm X}\cr {\rm Maximum\ Performance\ Incentive}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>This computation was made at the specific severity level for each hospital discharge. Payment for the performance incentive was made only to physicians at or below the 90th percentile of physicians.</p></section><section id="sec2-2"><h3 class="main">Improvement Incentive</h3><p>The improvement incentive was intended to encourage positive change. No payments were made from the improvement incentive unless an individual physician demonstrated measurable improvement in operational performance for either surgical or medical admissions. However, because physicians who admitted nonsurgical cases experienced reduced income as they help the hospital to improve operational performance, the methodology for calculating the improvement incentive was different for medical as opposed to surgical cases, as shown below.</p><p>For Medical DRGs:</p><p>For each severity level the following is calculated: <displayeditem class="mathematics" id="di-ueqn-2" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-2"><mediaresource alt="equation image" href="tex2gif-ueqn-2.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\matrix{{\rm Base\ Year\ Case\ Mix\ Adjusted\ ALOS}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ ALOS}}\right\}\cr {\rm X}\cr {\rm Per\ Diem}\cr {\rm X}\cr {\rm Rate\ year\ Admissions}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>For Surgical DRGs: <displayeditem class="mathematics" id="di-ueqn-3" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-3"><mediaresource alt="equation image" href="tex2gif-ueqn-3.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ {\left\{\matrix{ {\rm Base\ Year\ Case\ Mix\ Adjusted\ Cost}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ Cost}}\right\}\over \matrix{\left\{{\rm 90{th}\ Percentile\ Base\ Year\ Cost - Best\ Practice\ Cost}\right\}\cr {\rm X}\cr {\rm Case\ Mix\ Adjusted\ Maximum}\cr {\rm Improvement\ Incentive}\cr {\rm X}\cr {\rm Rate\ Year\ Admissions}}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>Cost savings were calculated quarterly and defined as the cost per case before the gainsharing program began minus the actual case cost by APR DRG. Student's <em>t</em>‐test was used for continuous data and the categorical data trends were analyzed using Mantel‐Haenszel Chi‐Square.</p><p>At least every 6 months, all participating physicians received case‐specific and cost‐centered data about their discharges. They also received a careful explanation of opportunities for financial or quality improvement.</p></section></section><section id="sec1-3"><h3 class="main">Results</h3><p>Over the 3‐year period, 184 physicians enrolled, representing 54% of those eligible. The remainder of physicians either decided not to enroll or were not eligible due to inadequate number of index DRG cases or excluded diagnoses. Payer mix was 27% Medicare and 48% of the discharges were commercial and managed care. The remaining cases were a combination of Medicaid and self‐pay. A total of 29,535 commercial and managed care discharges were evaluated from participating physicians (58%) and 20,360 similar discharges from non‐participating physicians. This number of admissions accounted for 29% of all hospital discharges during this time period. Surgical admissions accounted for 43% and nonsurgical admissions for 57%. The distribution of patients by service is shown in Table <a href="#tbl3" rel="references:#tbl3">3</a>. Pulmonary and cardiology diagnoses were the most frequent reasons for medical admissions. General and head and neck surgery were the most frequent surgical admissions. During the time period of the gainsharing program, the medical center saved $25.1 million for costs attributed to these cases. Participating physicians saved $6.9 million more than non‐participating physicians (<em>P</em> = 0.02, Figure <a href="#fig1" rel="references:#fig1">1</a>), but all discharges demonstrated cost savings during the study period. Cost savings (Figure <a href="#fig2" rel="references:#fig2">2</a>) resulted from savings in medical/surgical supplies and implants (35%), daily hospital costs, (28%), intensive care unit costs (16%) and coronary care unit costs (15%), and operating room costs (8%). Reduction in cost from reduced magnetic resonance imaging (MRI) use was not statistically significant. There were minimal increases in costs due to computed tomography (CT) scan use, cardiopulmonary care, laboratory use, pharmacy and blood bank, but none of these reached statistical significance.</p><div id="fig1"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig001_195.jpg" width="650" height="492" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Cumulative cost savings (in millions of $ dollars) for participating physicians (PAR) and non‐participating physicians (Non‐Par) year 2006 to 2009 (P = 0.02).</figcaption></figure></div><div id="fig2"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 2"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig002_113.jpg" width="650" height="412" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 2 </div> </div> </article><figcaption>Savings ($ dollars) by cost center. MSI, medical surgical supplies and implants; AP, hospital daily costs; ICU, intensive care unit; CCU, coronary care unit; OR, operating room charges; MRI, magnetic resonance imaging; CT, CT scan; CPL, cardiopulmonary lab; CCL, clinical laboratory; DRU, pharmacy; BLD, blood bank.</figcaption></figure></div><table id="tbl3"><caption><label>Table 3.</label><span class="description">Distribution of Cases Among Services for Physicians Participating in Gainsharing</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Admissions by Service</th><th class="text-align-left">Number (%)</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-37"><p><b>Abbreviation:</b> ENT, ear, nose, throat.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Cardiology</td><td class="text-align-char" data-align-char="(">4512 (15.3)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedic surgery</td><td class="text-align-char" data-align-char="(">3994 (13.5)</td></tr><tr class="valign-top"><td class="text-align-left">Gastroenterology</td><td class="text-align-char" data-align-char="(">3214 (10.9)</td></tr><tr class="valign-top"><td class="text-align-left">General surgery</td><td class="text-align-char" data-align-char="(">2908 (9.8)</td></tr><tr class="valign-top"><td class="text-align-left">Cardiovascular surgery</td><td class="text-align-char" data-align-char="(">2432 (8.2)</td></tr><tr class="valign-top"><td class="text-align-left">Pulmonary</td><td class="text-align-char" data-align-char="(">2212 (7.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurology</td><td class="text-align-char" data-align-char="(">2064 (7.0)</td></tr><tr class="valign-top"><td class="text-align-left">Oncology</td><td class="text-align-char" data-align-char="(">1217 (4.1)</td></tr><tr class="valign-top"><td class="text-align-left">Infectious disease</td><td class="text-align-char" data-align-char="(">1171 (4.0)</td></tr><tr class="valign-top"><td class="text-align-left">Endocrinology</td><td class="text-align-char" data-align-char="(">906 (3.1)</td></tr><tr class="valign-top"><td class="text-align-left">Nephrology</td><td class="text-align-char" data-align-char="(">826 (2.8)</td></tr><tr class="valign-top"><td class="text-align-left">Open heart surgery</td><td class="text-align-char" data-align-char="(">656 (2.2)</td></tr><tr class="valign-top"><td class="text-align-left">Interventional cardiology</td><td class="text-align-char" data-align-char="(">624 (2.1)</td></tr><tr class="valign-top"><td class="text-align-left">Gynecological surgery</td><td class="text-align-char" data-align-char="(">450 (1.5)</td></tr><tr class="valign-top"><td class="text-align-left">Urological surgery</td><td class="text-align-char" data-align-char="(">326 (1.1)</td></tr><tr class="valign-top"><td class="text-align-left">ENT surgery</td><td class="text-align-char" data-align-char="(">289 (1.0)</td></tr><tr class="valign-top"><td class="text-align-left">Obstetrics without delivery</td><td class="text-align-char" data-align-char="(">261 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Hematology</td><td class="text-align-char" data-align-char="(">253 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedicsnonsurgical</td><td class="text-align-char" data-align-char="(">241 (0.8)</td></tr><tr class="valign-top"><td class="text-align-left">Rehabilitation</td><td class="text-align-char" data-align-char="(">204 (0.7)</td></tr><tr class="valign-top"><td class="text-align-left">Otolaryngology</td><td class="text-align-char" data-align-char="(">183 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">Rheumatology</td><td class="text-align-char" data-align-char="(">165 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">General medicine</td><td class="text-align-char" data-align-char="(">162 (0.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurological surgery</td><td class="text-align-char" data-align-char="(">112 (0.4)</td></tr><tr class="valign-top"><td class="text-align-left">Urology</td><td class="text-align-char" data-align-char="(">101 (0.3)</td></tr><tr class="valign-top"><td class="text-align-left">Dermatology</td><td class="text-align-char" data-align-char="(">52 (0.2)</td></tr><tr class="valign-top"><td class="text-align-left">Grand total</td><td class="text-align-char" data-align-char="(">29535 (100.0)</td></tr></tbody></table><p>Hospital LOS decreased 9.8% from baseline among participating doctors, while LOS decreased 9.0% among non‐participating physicians; this difference was not statistically significant (<em>P</em> = 0.6). Participating physicians reduced costs by an average of $7,871 per quarter, compared to a reduction in costs by $3,018 for admissions by non‐participating physicians (<em>P</em> &lt; 0.0001). The average savings per admission for the participating physicians were $1,835, and for non‐participating physicians were $1,107, a difference of $728 per admission. Overall, cost savings during the three year period averaged $105,000 per physician who participated in the program and $67,000 per physician who did not (<em>P</em> &lt; 0.05). There was not a statistical difference in savings between medical and surgical admissions (<em>P</em> = 0.24).</p><p>Deviations from quality thresholds were identified during this time period. Some or all of the gainsharing income was withheld from 8% of participating physicians due to quality issues, incomplete medical records, or administrative reasons. Payouts to participating physicians averaged $1,866 quarterly (range $0‐$27,631). Overall, 9.4% of the hospital savings was directly paid to the participating physicians. Compliance with core measures improved in the following domains from year 2006 to 2009; acute myocardial infarction 94% to 98%, congestive heart failure 76% to 93%, pneumonia 88% to 97%, and surgical care improvement project 90% to 97%, (<em>P</em> = 0.17). There was no measurable increase in 30‐day mortality or readmission by APR‐DRG. The number of incomplete medical records decreased from an average of 43% of the total number of records in the second quarter of 2006 to 30% in the second quarter of 2009 (<em>P</em> &lt; 0.0001). Other quality indicators remained statistically unchanged.</p></section><section id="sec1-4"><h3 class="main">Discussion</h3><p>The promise of gainsharing may motivate physicians to decrease hospital costs while maintaining quality medical care, since it aligns physician and hospital incentives. Providing a reward to physicians creates positive reinforcement, which is more effective than warnings against poor performing physicians (carrot vs. stick).<a href="#bib5" rel="references:#bib5">5</a>, <a href="#bib6" rel="references:#bib6">6</a> This study is the first and largest of its kind to show the results of a gainsharing program for inpatient medical and surgical admissions and demonstrates that significant cost savings may be achieved. This is similar to previous studies that have shown positive outcomes for pay‐for‐performance programs.<a href="#bib7" rel="references:#bib7">7</a></p><p>Participating physicians in the present study accumulated almost $7 million more in savings than non‐participating physicians. Over time this difference has increased, possibly due to a learning curve in educating participating physicians and the way in which information about their performance is given back to them. A significant portion of the hospital's cost savings was through improvements in documentation and completion of medical records. While there was an actual reduction in average length of stay (ALOS), better documentation may also have contributed to adjusting the severity level within each DRG.</p><p>Using financial incentives to positively impact on physician behavior is not new. One program in a community‐based hospitalist group reported similar improvements in medical record documentation, as well as improvements in physician meeting attendance and quality goals.<a href="#bib8" rel="references:#bib8">8</a> Another study found that such hospital programs noted improved physician engagement and commitment to best practices and to improving the quality of care.<a href="#bib9" rel="references:#bib9">9</a></p><p>There is significant experience in the outpatient setting using pay‐for‐performance programs to enhance quality. Millett et al.<a href="#bib10" rel="references:#bib10">10</a> demonstrated a reduction in smoking among patients with diabetes in a program in the United Kingdom. Another study in Rochester, New York that used pay‐for‐performance incentives demonstrated better diabetes management.<a href="#bib11" rel="references:#bib11">11</a> Mandel and Kotagal<a href="#bib12" rel="references:#bib12">12</a> demonstrated improved asthma care utilizing a quality incentive program.</p><p>The use of financial motivation for physicians, as part of a hospital pay‐for‐performance program, has been shown to lead to improvements in quality performance scores when compared to non pay‐for‐performance hospitals.<a href="#bib13" rel="references:#bib13">13</a> Berthiaume demonstrated decreased costs and improvements in risk‐adjusted complications and risk‐adjusted LOS in patents admitted for acute coronary intervention in a pay‐for‐performance program.<a href="#bib14" rel="references:#bib14">14</a> Quality initiatives were integral for the gainsharing program, since measures such as surgical site infections may increase LOS and hospital costs. Core measures related to the care of patients with acute myocardial infarction, heart failure, pneumonia, and surgical prophylaxis steadily improved since the initiation of the gainsharing program. Gainsharing programs also enhance physician compliance with administrative responsibilities such as the completion of medical records.</p><p>One unexpected finding of our study was that there was a cost savings per admission even in the patients of physicians who did not participate in the gainsharing program. While the participating physicians showed statistically significant improvements in cost savings, savings were found in both groups. This raises the question as to whether these cost reductions could have been impacted by other factors such as new labor or vendor contracts, better documentation, improved operating room utilization and improved and timely documentation in the medical record. Another possibility is the Hawthorne effect on physicians, who altered their behavior with knowledge that process and outcome measurement were being measured. Physicians who voluntarily sign up for a gainsharing program would be expected to be more committed to the success of this program than physicians who decide to opt out. While this might appear to be a selection bias it does illustrate the point that motivated physicians are more likely to positively change their practice behaviors. However, one might suggest that financial savings directly attributed to the gainsharing program was not the $25.1 million saved during the 3 years overall, but the difference between participating and non‐participating physicians, or $6.9 million.</p><p>While the motivation to complete medical records was significant (gainsharing dollars were withheld from doctors with more than 5 incomplete charts for more than 30 days) it was not the only reason why the number of delinquent chart percentage decreased during the study period. While the improvement was significant, there are still more opportunities to reduce the number of incomplete charts. Hospital regulatory inspections and periodic physician education were also likely to have reduced the number of incomplete inpatient charts during this time period and may do so in the future.<a href="#bib15" rel="references:#bib15">15</a></p><p>The program focused on the physician activities that have the greatest impact on hospital costs. While optimizing laboratory, blood bank, and pharmacy management decreased hospital costs; we found that improvements in patient LOS, days in an intensive care unit, and management of surgical implants had the greatest impact on costs. Orthopedic surgeons began to use different implants, and all surgeons refrained from opening disposable surgical supplies until needed. Patients in intensive care unit beds stable for transfer were moved to regular medical/surgical rooms earlier. Since the program helped physicians understand the importance of LOS, many physicians increased their rounding on weekends and considered LOS implications before ordering diagnostic procedures that could be performed as an outpatient. Nurses, physician extenders such as physician assistants, and social workers have played an important role in streamlining patient care and hospital discharge; however, they were not directly rewarded under this program.</p><p>There are challenges to aligning the incentives of internists compared to procedure‐based specialists. This may be that the result of surgeons receiving payment for bundled care and thus the incentives are already aligned. The incentive of the program for internists, who get paid for each per daily visit, was intended to overcome the lost income resulting from an earlier discharge. Moreover, in the present study, only the discharging physician received incentive payments for each case. Patient care is undoubtedly a team effort and many physicians (radiologists, anesthesiologists, pathologists, emergency medicine physicians, consultant specialty physicians, etc.) are clearly left out in the present gainsharing program. Aligning the incentives of these physicians might be necessary. Furthermore, the actions of other members of the medical team and consultants, by their behaviors, could limit the incentive payments for the discharging physician. The discharging physician is often unable to control the transfer of a patient from a high‐cost or severity unit, or improve the timeliness of consulting physicians. Previous authors have raised the issue as to whether a physician should be prevented from payment because of the actions of another member of the medical team.<a href="#bib16" rel="references:#bib16">16</a></p><p>Ensuring a fair and transparent system is important in any pay‐for‐performance program. The present gainsharing program required sophisticated data analysis, which added to the costs of the program. To implement such a program, data must be clear and understandable, segregated by DRG and severity adjusted. But should the highest reward payments go to those who perform the best or improve the most? In the present study, some physicians were consistently unable to meet quality benchmarks. This may be related to several factors, 1 of which might be a particular physician's case mix. Some authors have raised concerns that pay‐for‐performance programs may unfairly impact physicians who care for more challenging or patients from disadvantaged socioeconomic circumstances.<a href="#bib17" rel="references:#bib17">17</a> Other authors have questioned whether widespread implementation of such a program could potentially increase healthcare disparities in the community.<a href="#bib18" rel="references:#bib18">18</a> It has been suggested by Greene and Nash that for a program to be successful, physicians who feel they provide good care yet but are not rewarded should be given an independent review.<a href="#bib16" rel="references:#bib16">16</a> Such a process is important to prevent resentment among physicians who are unable to meet benchmarks for payment, despite hard work.<a href="#bib19" rel="references:#bib19">19</a> Conversely, other studies have found that many physicians who receive payments in a pay‐for‐performance system do not necessarily consciously make improvement to enhance financial performance.<a href="#bib20" rel="references:#bib20">20</a> Only 54% of eligible physicians participated in the present gainsharing program. This is likely due to lack of understanding about the program, misperceptions about the ethics of such programs, perceived possible negative patient outcome, conflict of interest and mistrust.<a href="#bib21" rel="references:#bib21">21</a>, <a href="#bib22" rel="references:#bib22">22</a> This underscores the importance of providing understandable performance results, education, and a physician champion to help facilitate communication and enhanced outcomes. What is clear is that the perception by participating physicians is that this program is worthwhile as the number of participating physicians has steadily increased and it has become an incentive for new providers to choose this medical center over others.</p><p>In conclusion, the results of the present study show that physicians can help hospitals reduce inpatients costs while maintaining or improving hospital quality. Improvements in patient LOS, implant costs, overall costs per admission, and medical record completion were noted. Further work is needed to improve physician education and better understand the impact of uneven physician case mix. Further efforts are necessary to allow other members of the health care team to participate and benefit from gainsharing.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="bib1"><cite class="journal" id="ref-cit1"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib2"><cite class="journal" id="ref-cit2"><span class="author">Ketcham JD</span>,<span class="author">Furukawa MF</span>.<span class="articleTitle">Hospital‐physician gainsharing in cardiology</span>.<span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2008</span>;<span class="vol">27</span>(<span class="issue">3</span>):<span class="pageFirst">803</span>–<span class="pageLast">812</span>. </cite></li><li id="bib3"><cite class="journal" id="ref-cit3"><span class="author">Dirschl DR</span>,<span class="author">Goodroe J</span>,<span class="author">Thornton DM</span>,<span class="author">Eiland GW</span>.<span class="articleTitle">AOA Symposium. Gainsharing in orthopaedics: passing fancy or wave of the future?</span><span class="journalTitle">J Bone Joint Surg Am.</span><span class="pubYear">2007</span>;<span class="vol">89</span>(<span class="issue">9</span>):<span class="pageFirst">2075</span>–<span class="pageLast">2083</span>. </cite></li><li id="bib4"><cite class="book" id="ref-cit4"><span class="otherTitle">All Patient Defined Diagnosis Related Groups™ ‐ 3M Health Information Systems</span>,<span class="publisherLoc">St Paul, MN</span>. </cite></li><li id="bib5"><cite class="journal" id="ref-cit5"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib6"><cite class="journal" id="ref-cit6"><span class="author">Doyon C</span>.<span class="articleTitle">Best practices in record completion</span>.<span class="journalTitle">J Med Pract Manage.</span><span class="pubYear">2004</span>;<span class="vol">20</span>(<span class="issue">1</span>):<span class="pageFirst">18</span>–<span class="pageLast">22</span>. </cite></li><li id="bib7"><cite class="journal" id="ref-cit7"><span class="author">Curtin K</span>,<span class="author">Beckman H</span>,<span class="author">Pankow G</span>, et al.<span class="articleTitle">Return on investment in pay for performance: a diabetes case study</span>.<span class="journalTitle">J Healthc Manag.</span><span class="pubYear">2006</span>;<span class="vol">51</span>(<span class="issue">6</span>):<span class="pageFirst">365</span>–<span class="pageLast">374</span>; discussion 375‐376. </cite></li><li id="bib8"><cite class="journal" id="ref-cit8"><span class="author">Collier VU</span>.<span class="articleTitle">Use of pay for performance in a community hospital private hospitalists group: a preliminary report</span>.<span class="journalTitle">Trans Am Clin Climatol Assoc.</span><span class="pubYear">2007</span>;<span class="vol">188</span>:<span class="pageFirst">263</span>–<span class="pageLast">272</span>. </cite></li><li id="bib9"><cite class="journal" id="ref-cit9"><span class="author">Williams J</span>.<span class="articleTitle">Making the grade with pay for performance: 7 lessons from best‐performing hospitals</span>.<span class="journalTitle">Healthc Financ Manage.</span><span class="pubYear">2006</span>;<span class="vol">60</span>(<span class="issue">12</span>):<span class="pageFirst">79</span>–<span class="pageLast">85</span>. </cite></li><li id="bib10"><cite class="journal" id="ref-cit10"><span class="author">Millett C</span>,<span class="author">Gray J</span>,<span class="author">Saxena S</span>,<span class="author">Netuveli G</span>,<span class="author">Majeed A</span>.<span class="articleTitle">Impact of a pay‐for‐performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes</span>.<span class="journalTitle">CMAJ.</span><span class="pubYear">2007</span>;<span class="vol">176</span>(<span class="issue">12</span>):<span class="pageFirst">1705</span>–<span class="pageLast">1710</span>. </cite></li><li id="bib11"><cite class="journal" id="ref-cit11"><span class="author">Young GJ</span>,<span class="author">Meterko M</span>,<span class="author">Beckman H</span>, et al,<span class="articleTitle">Effects of paying physicians based on their relative performance for quality</span>.<span class="journalTitle">J Gen Intern Med.</span><span class="pubYear">2007</span>;<span class="vol">22</span>(<span class="issue">6</span>):<span class="pageFirst">872</span>–<span class="pageLast">876</span>. </cite></li><li id="bib12"><cite class="journal" id="ref-cit12"><span class="author">Mandel KE</span>,<span class="author">Kotagal UR</span>.<span class="articleTitle">Pay for performance alone cannot drive quality</span>.<span class="journalTitle">Arch Pediatr Adolesc Med.</span><span class="pubYear">2007</span>;<span class="vol">161</span>(<span class="issue">7</span>):<span class="pageFirst">650</span>–<span class="pageLast">655</span>. </cite></li><li id="bib13"><cite class="journal" id="ref-cit13"><span class="author">Grossbart SR</span>.<span class="articleTitle">What's the return? Assessing the effect of “pay‐for‐performance” initiatives on the quality of care delivery</span>.<span class="journalTitle">Med Care Res Rev.</span><span class="pubYear">2006</span>;<span class="vol">63</span>(<span class="issue">1 suppl</span>)( ):<span class="pageFirst">29S</span>–<span class="pageLast">48S</span>. </cite></li><li id="bib14"><cite class="journal" id="ref-cit14"><span class="author">Berthiaume JT</span>,<span class="author">Chung RS</span>,<span class="author">Ryskina KL</span>,<span class="author">Walsh J</span>,<span class="author">Legorrets AP</span>.<span class="articleTitle">Aligning financial incentives with “Get With the Guidelines” to improve cardiovascular care</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2004</span>;<span class="vol">10</span>(<span class="issue">7 pt 2</span>):<span class="pageFirst">501</span>–<span class="pageLast">504</span>. </cite></li><li id="bib15"><cite class="journal" id="ref-cit15"><span class="author">Rogliano J</span>.<span class="articleTitle">Sampling best practices. Managing delinquent records</span>.<span class="journalTitle">J AHIMA.</span><span class="pubYear">1997</span>;<span class="vol">68</span>(<span class="issue">8</span>):<span class="pageFirst">28</span>,30. </cite></li><li id="bib16"><cite class="journal" id="ref-cit16"><span class="author">Greene SE</span>,<span class="author">Nash DB</span>.<span class="articleTitle">Pay for performance: an overview of the literature</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2009</span>;<span class="vol">24</span>;<span class="pageFirst">140</span>–<span class="pageLast">163</span>. </cite></li><li id="bib17"><cite class="journal" id="ref-cit17"><span class="author">McMahon LF</span>,<span class="author">Hofer TP</span>,<span class="author">Hayward RA</span>.<span class="articleTitle">Physician‐level P4P:DOA? Can quality‐based payments be resuscitated?</span><span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2007</span>;<span class="vol">13</span>(<span class="issue">5</span>):<span class="pageFirst">233</span>–<span class="pageLast">236</span>. </cite></li><li id="bib18"><cite class="journal" id="ref-cit18"><span class="author">Casalino LP</span>,<span class="author">Elster A</span>,<span class="author">Eisenberg A</span>, et al.<span class="articleTitle">Will pay for performance and quality reporting affect health care disparities?</span><span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2007</span>;<span class="vol">26</span>(<span class="issue">3</span>):<span class="pageFirst">w405</span>–<span class="pageLast">w414</span>. </cite></li><li id="bib19"><cite class="journal" id="ref-cit19"><span class="author">Campbell SM</span>,<span class="author">McDonald R</span>,<span class="author">Lester H</span>.<span class="articleTitle">The experience of pay for performance in English family practice: a qualitative study</span>.<span class="journalTitle">Ann Fam Med.</span><span class="pubYear">2008</span>;<span class="vol">8</span>(<span class="issue">3</span>):<span class="pageFirst">228</span>–<span class="pageLast">234</span>. </cite></li><li id="bib20"><cite class="journal" id="ref-cit20"><span class="author">Teleki SS</span>,<span class="author">Damberg CL</span>,<span class="author">Pham C.</span>, et al.<span class="articleTitle">Will financial incentives stimulate quality improvement? Reactions from frontline physicians</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2006</span>;<span class="vol">21</span>(<span class="issue">6</span>):<span class="pageFirst">367</span>–<span class="pageLast">374</span>. </cite></li><li id="bib21"><cite class="journal" id="ref-cit21"><span class="author">Pierce RG</span>,<span class="author">Bozic KJ</span>,<span class="author">Bradford DS</span>.<span class="articleTitle">Pay for performance in orthopedic surgery</span>.<span class="journalTitle">Clin Orthop Relat Res.</span><span class="pubYear">2007</span>;<span class="vol">457</span>:<span class="pageFirst">87</span>–<span class="pageLast">95</span>. </cite></li><li id="bib22"><cite class="journal" id="ref-cit22"><span class="author">Seidel RL</span>,<span class="author">Baumgarten DA</span>.<span class="articleTitle">Pay for performance survey of diagnostic radiology faculty and trainees</span>.<span class="journalTitle">J Am Coll Radiol.</span><span class="pubYear">2007</span>;<span class="vol">4</span>(<span class="issue">6</span>):<span class="pageFirst">411</span>–<span class="pageLast">415</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/788_ftp.pdf" type="application/pdf">788_ftp.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 5(9)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">501-507</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-legacy-keywords"> <div class="field field--name-field-article-legacy-keywords field--type-string-long field--label-above"> <div class="field__label">Legacy Keywords</div> <div class="field__item">core measures, financial outcome, gainsharing, healthcare delivery systems, hospital costs, pay‐for‐performance, physician incentives, quality</div> </div> </div> <div class="block block-layout-builder block-extra-field-blocknodearticlelinks"> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-sections"> <div class="field field--name-field-article-sections field--type-entity-reference field--label-above"> <div class="field__label">Sections</div> <div class="field__items"> <div class="field__item"><a href="/sections/original-research" hreflang="en">Original Research</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-above"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/i-michael-leitman-md" hreflang="en">I. Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/ruth-levin-mpa" hreflang="en">Ruth Levin, MPA</a></div> <div class="field__item"><a href="/authors/michael-j-lipp-md" hreflang="en">Michael J. Lipp, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> <div class="field__item"><a href="/authors/christine-j-karalakulasingam-md" hreflang="en">Christine J. Karalakulasingam, MD</a></div> <div class="field__item"><a href="/authors/david-s-bernard-md" hreflang="en">David S. Bernard, MD</a></div> <div class="field__item"><a href="/authors/patricia-friedmann-ms" hreflang="en">Patricia Friedmann, MS</a></div> <div class="field__item"><a href="/authors/david-j-shulkin-md" hreflang="en">David J. Shulkin, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-authors"> <div class="field field--name-field-article-authors field--type-entity-reference field--label-inline clearfix"> <div class="field__label">Author(s)</div> <div class="field__items"> <div class="field__item"><a href="/authors/i-michael-leitman-md" hreflang="en">I. Michael Leitman, MD</a></div> <div class="field__item"><a href="/authors/ruth-levin-mpa" hreflang="en">Ruth Levin, MPA</a></div> <div class="field__item"><a href="/authors/michael-j-lipp-md" hreflang="en">Michael J. Lipp, MD</a></div> <div class="field__item"><a href="/authors/latha-sivaprasad-md" hreflang="en">Latha Sivaprasad, MD</a></div> <div class="field__item"><a href="/authors/christine-j-karalakulasingam-md" hreflang="en">Christine J. Karalakulasingam, MD</a></div> <div class="field__item"><a href="/authors/david-s-bernard-md" hreflang="en">David S. Bernard, MD</a></div> <div class="field__item"><a href="/authors/patricia-friedmann-ms" hreflang="en">Patricia Friedmann, MS</a></div> <div class="field__item"><a href="/authors/david-j-shulkin-md" hreflang="en">David J. Shulkin, MD</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/788_ftp.pdf" type="application/pdf">788_ftp.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf"> <div class="field field--name-field-article-pdf field--type-file field--label-above"> <div class="field__label">Article PDF</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/788_ftp.pdf" type="application/pdf">788_ftp.pdf</a></span> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="sec1-bdy-1"><p>Hospitals are challenged to improve quality while reducing costs, yet traditional methods of cost containment have had limited success in aligning the goals of hospitals and physicians. Physicians directly control more than 80% of total medical costs.<a href="#bib1" rel="references:#bib1">1</a> The current fee‐for‐service system encourages procedures and the use of hospital resources. Without the proper incentives to gain active participation and collaboration of the medical staff in improving the efficiency of care, the ability to manage medical costs and improve hospital operational and financial performance is hampered. A further challenge is to encourage physicians to improve the quality of care and maintain safe medical practice. While several examples of pay‐for‐performance (P4P) have previously been attempted to increase efficiency, gainsharing offers real opportunities to achieve these outcomes.</p><p>Previous reports regarding the results of gainsharing programs describe its use in outpatient settings and its limited ability to reduce costs for inpatient care for surgical implants such as coronary stents<a href="#bib2" rel="references:#bib2">2</a> or orthopedic prostheses.<a href="#bib3" rel="references:#bib3">3</a> The present study represents the largest series to date using a gainsharing model in a comprehensive program of inpatient care at a tertiary care medical center.</p></section><section id="sec1-1"><h3 class="main">Patients and Methods</h3><p>Beth Israel Medical Center is a 1000‐bed tertiary care university‐affiliated teaching hospital, located in New York City. The hospital serves a large and ethnically diverse community predominantly located in the lower east side of Manhattan and discharged about 50,000 patients per year during the study period of July 2006 through June 2009.</p><p>Applied Medical Software, Inc. (AMS, Collingswood, NJ) analyzed hospital data for case mix and severity. To establish best practice norms (BPNs), AMS used inpatient discharge data (UB‐92) to determine costs by APR‐DRG's<a href="#bib4" rel="references:#bib4">4</a> during calendar year 2005, prior to the inception of the program to establish BPNs. Costs were allocated into specific areas listed in Table <a href="#tbl1" rel="references:#tbl1">1</a>. A minimum of 10 cases was necessary in each DRG. Cost outliers (as defined by the mean cost of the APR DRG plus 3 standard deviations) were excluded. These data were used to establish a baseline for each physician and a BPN, which was set at the top 25th percentile for each specific APR DRG. BPNs were determined after exclusions using the following criteria:</p><ul><li><label>1</label><p>Each eligible physician had to have at least 10 admissions within their specialty;</p></li><li><label>2</label><p>Each eligible DRG had to have at least 5 qualifying physicians within a medical specialty;</p></li><li><label>3</label><p>Each eligible APR DRG had to have at least 3 qualifying admissions;</p></li><li><label>4</label><p>If the above criteria are met, the BPN was set at the mean of the top 25th percentile of physicians (25% of the physicians with the lowest costs).</p></li></ul><p> </p><table id="tbl1"><caption><label>Table 1.</label><span class="description">Hospital Cost Allocation Areas in the Gainsharing Program</span></caption><thead></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-15"><p><b>Abbreviations:</b> CCU, coronary care unit; ICU, intensive care unit.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Per diem hospital bed cost</td><td class="text-align-left">Pharmacy</td></tr><tr class="valign-top"><td class="text-align-left">Critical care (ICU and CCU)</td><td class="text-align-left">Laboratory</td></tr><tr class="valign-top"><td class="text-align-left">Medical surgical supplies and implants</td><td class="text-align-left">Cardiopulmonary care</td></tr><tr class="valign-top"><td class="text-align-left">Operating room costs</td><td class="text-align-left">Blood bank</td></tr><tr class="valign-top"><td class="text-align-left">Radiology</td><td class="text-align-left">Intravenous therapy</td></tr></tbody></table><p>Once BPNs were determined, patients were grouped by physician and compared to the BPN for a particular APR DRG. All patients of participating physicians with qualifying APR DRGs were included in the analysis reports summarizing these results, computed quarterly and distributed to each physician. Obstetrical and psychiatric admissions were excluded in the program. APR DRG data for each physician was compared from year to year to determine whether an individual physician demonstrated measurable improvement in performance.</p><p>The gainsharing program was implemented in 2006. Physician participation was voluntary. Payments were made to physicians without any risk or penalties from participation. Incentives were based on individual performance. Incentives for nonsurgical admissions were intended to offset the loss of physician income related to more efficient medical management and a reduced hospital length of stay (LOS). Income for surgical admissions was intended to reward physicians for efficient preoperative and postoperative care.</p><p>The methodology provides financial incentives for physicians for each hospital discharge in 2 ways:</p><ul><li><label>1</label><p>Improvement in costs per case against their own historical performance;</p></li><li><label>2</label><p>Cost per case performance compared to BPN.</p></li></ul><p> </p><p>In the first year of the gainsharing program, two thirds of the total allowable incentive payments were allocated to physicians' improvement, with one third based on a performance metric. Payments for improvement were phased out over the first 3 years of the gainsharing program, with payments focused fully on performance in Year 3. Cases were adjusted for case‐mix and severity of illness (four levels of APR DRG). Physicians were not penalized for any cases in which costs greatly exceeded BPN. A floor was placed at the BPN and no additional financial incentives were paid for surpassing it. Baselines and BPNs were recalculated yearly.</p><p>A key aspect of the gainsharing program was the establishment of specific quality parameters (Table <a href="#tbl2" rel="references:#tbl2">2</a>) that need to be met before any incentive payments were made. A committee regularly reviewed the quality performance data of each physician to determine eligibility for payments. Physicians were considered to be ineligible for incentive compensation until the next measurement period if there was evidence of failure to adequately meet these measures. At least 80% compliance with core measures (minimum 5 discharges in each domain) was expected. Infectious complication rates were to remain not more than 1 standard deviation above National Healthcare Safety Network rates during the same time period. In addition, payments were withheld from physicians if it was found that the standard of care was not met for any morbidity or mortality that was peer reviewed or if there were any significant patient complaints. Readmission rates were expected to remain at or below the baseline established during the previous 12 months by DRG.</p><table id="tbl2"><caption><label>Table 2.</label><span class="description">Quality Factors Used to Determine Physician Payment in Gainsharing Program</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Quality Measure</th><th class="text-align-left">Goal</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-23"><p><b>Abbreviations:</b> ACEI, Angiotensin converting enzyme inhibitor; AMI, Acute myocardial infarction; ARB, Angiotensin II receptor blockers; CHF, Congestive heart failure; HCAHPS, Hospital consumer assessment of healthcare providers and systems; LVSD, left ventricular systolic dysfunction; NHSN, Center for Disease Control (CDC) National Healthcare Safety Network.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Readmissions within 7 days for the same or related diagnosis</td><td class="text-align-left">Decrease, or less than 10% of discharges</td></tr><tr class="valign-top"><td class="text-align-left">Documentationquality and timeliness of medical record and related documentation including date, time, and sign all chart entries</td><td class="text-align-left">No more than 20% of average monthly discharged medical records incomplete for more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Consultation with social work/discharge planner within 24 hours of admission for appropriate pts</td><td class="text-align-left">&gt;80% of all appropriate cases</td></tr><tr class="valign-top"><td class="text-align-left">Timely switch from intravenous to oral antibiotics in accordance with hospital policy (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Unanticipated return to the operating room</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Patient complaints</td><td class="text-align-left">Decrease</td></tr><tr class="valign-top"><td class="text-align-left">Patient satisfaction (HCAHPS)</td><td class="text-align-left">&gt;75% physician domain</td></tr><tr class="valign-top"><td class="text-align-left">Ventilator associated pneumonia</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Central line associated blood stream infections</td><td class="text-align-left">Decrease or &lt; 5 per 1000 catheter days.</td></tr><tr class="valign-top"><td class="text-align-left">Surgical site infections</td><td class="text-align-left">Decrease or within 1 standard deviation of NHSN</td></tr><tr class="valign-top"><td class="text-align-left">Antibiotic prophylaxis (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Inpatient mortality</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Medication errors</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Delinquent medical records</td><td class="text-align-left">&lt;5 charts delinquent more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Falls with injury</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">AMI: aspirin on arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ACEI or ARB for LVSD (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Adult smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ Beta blocker prescribed at arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: discharge instructions (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: Left ventricular function assessment (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: ACEI or ARB for left ventricular systolic dysfunction (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Pneumonia: O2 assessment, pneumococcal vaccine, blood culture and sensitivity before first antibiotic, smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr></tbody></table><p>Employed and private practice community physicians were both eligible for the gainsharing program. Physician participation in the program was voluntary. All patients admitted to the Medical Center received notification on admission about the program. The aggregate costs by DRG were calculated quarterly. Savings over the previous yearif anywere calculated. A total of 20% of the savings was used to administer the program and for incentive payments to physicians.</p><p>From July 1, 2006 through September 2008, only commercial managed care cases were eligible for this program. As a result of the approval of the gainsharing program as a demonstration project by the Centers for Medicare and Medicaid Services (CMS), Medicare cases were added to the program starting October 1, 2008.</p></section><section id="sec1-2"><h3 class="main">Physician Payment Calculation Methodology</h3><section id="sec2-1"><h3 class="main">Performance Incentive</h3><p>The performance incentive was intended to reward demonstrated levels of performance. Accordingly, a physician's share in hospital savings was in proportion to the relationship between their individual performance and the BPN. This computation was the same for both surgical and medical admissions. The following equation illustrates the computation of performance incentives for participating physicians: <displayeditem class="mathematics" id="di-ueqn-1" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-1"><mediaresource alt="equation image" href="tex2gif-ueqn-1.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\displaystyle{\rm 90{th}\ Percentile\ BPN\ Cost}{\hbox{-}}{\rm Physician's\ Actual\ Cost} \over \displaystyle{\rm 90{th}\ Percentile\ Cost}{\hbox{-}}{\rm Best\ Practice\ Norm\ Cost }\right\}\cr {\rm X}\cr {\rm Maximum\ Performance\ Incentive}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>This computation was made at the specific severity level for each hospital discharge. Payment for the performance incentive was made only to physicians at or below the 90th percentile of physicians.</p></section><section id="sec2-2"><h3 class="main">Improvement Incentive</h3><p>The improvement incentive was intended to encourage positive change. No payments were made from the improvement incentive unless an individual physician demonstrated measurable improvement in operational performance for either surgical or medical admissions. However, because physicians who admitted nonsurgical cases experienced reduced income as they help the hospital to improve operational performance, the methodology for calculating the improvement incentive was different for medical as opposed to surgical cases, as shown below.</p><p>For Medical DRGs:</p><p>For each severity level the following is calculated: <displayeditem class="mathematics" id="di-ueqn-2" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-2"><mediaresource alt="equation image" href="tex2gif-ueqn-2.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\matrix{{\rm Base\ Year\ Case\ Mix\ Adjusted\ ALOS}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ ALOS}}\right\}\cr {\rm X}\cr {\rm Per\ Diem}\cr {\rm X}\cr {\rm Rate\ year\ Admissions}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>For Surgical DRGs: <displayeditem class="mathematics" id="di-ueqn-3" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-3"><mediaresource alt="equation image" href="tex2gif-ueqn-3.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ {\left\{\matrix{ {\rm Base\ Year\ Case\ Mix\ Adjusted\ Cost}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ Cost}}\right\}\over \matrix{\left\{{\rm 90{th}\ Percentile\ Base\ Year\ Cost - Best\ Practice\ Cost}\right\}\cr {\rm X}\cr {\rm Case\ Mix\ Adjusted\ Maximum}\cr {\rm Improvement\ Incentive}\cr {\rm X}\cr {\rm Rate\ Year\ Admissions}}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>Cost savings were calculated quarterly and defined as the cost per case before the gainsharing program began minus the actual case cost by APR DRG. Student's <em>t</em>‐test was used for continuous data and the categorical data trends were analyzed using Mantel‐Haenszel Chi‐Square.</p><p>At least every 6 months, all participating physicians received case‐specific and cost‐centered data about their discharges. They also received a careful explanation of opportunities for financial or quality improvement.</p></section></section><section id="sec1-3"><h3 class="main">Results</h3><p>Over the 3‐year period, 184 physicians enrolled, representing 54% of those eligible. The remainder of physicians either decided not to enroll or were not eligible due to inadequate number of index DRG cases or excluded diagnoses. Payer mix was 27% Medicare and 48% of the discharges were commercial and managed care. The remaining cases were a combination of Medicaid and self‐pay. A total of 29,535 commercial and managed care discharges were evaluated from participating physicians (58%) and 20,360 similar discharges from non‐participating physicians. This number of admissions accounted for 29% of all hospital discharges during this time period. Surgical admissions accounted for 43% and nonsurgical admissions for 57%. The distribution of patients by service is shown in Table <a href="#tbl3" rel="references:#tbl3">3</a>. Pulmonary and cardiology diagnoses were the most frequent reasons for medical admissions. General and head and neck surgery were the most frequent surgical admissions. During the time period of the gainsharing program, the medical center saved $25.1 million for costs attributed to these cases. Participating physicians saved $6.9 million more than non‐participating physicians (<em>P</em> = 0.02, Figure <a href="#fig1" rel="references:#fig1">1</a>), but all discharges demonstrated cost savings during the study period. Cost savings (Figure <a href="#fig2" rel="references:#fig2">2</a>) resulted from savings in medical/surgical supplies and implants (35%), daily hospital costs, (28%), intensive care unit costs (16%) and coronary care unit costs (15%), and operating room costs (8%). Reduction in cost from reduced magnetic resonance imaging (MRI) use was not statistically significant. There were minimal increases in costs due to computed tomography (CT) scan use, cardiopulmonary care, laboratory use, pharmacy and blood bank, but none of these reached statistical significance.</p><div id="fig1"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig001_195.jpg" width="650" height="492" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Cumulative cost savings (in millions of $ dollars) for participating physicians (PAR) and non‐participating physicians (Non‐Par) year 2006 to 2009 (P = 0.02).</figcaption></figure></div><div id="fig2"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 2"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig002_113.jpg" width="650" height="412" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 2 </div> </div> </article><figcaption>Savings ($ dollars) by cost center. MSI, medical surgical supplies and implants; AP, hospital daily costs; ICU, intensive care unit; CCU, coronary care unit; OR, operating room charges; MRI, magnetic resonance imaging; CT, CT scan; CPL, cardiopulmonary lab; CCL, clinical laboratory; DRU, pharmacy; BLD, blood bank.</figcaption></figure></div><table id="tbl3"><caption><label>Table 3.</label><span class="description">Distribution of Cases Among Services for Physicians Participating in Gainsharing</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Admissions by Service</th><th class="text-align-left">Number (%)</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-37"><p><b>Abbreviation:</b> ENT, ear, nose, throat.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Cardiology</td><td class="text-align-char" data-align-char="(">4512 (15.3)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedic surgery</td><td class="text-align-char" data-align-char="(">3994 (13.5)</td></tr><tr class="valign-top"><td class="text-align-left">Gastroenterology</td><td class="text-align-char" data-align-char="(">3214 (10.9)</td></tr><tr class="valign-top"><td class="text-align-left">General surgery</td><td class="text-align-char" data-align-char="(">2908 (9.8)</td></tr><tr class="valign-top"><td class="text-align-left">Cardiovascular surgery</td><td class="text-align-char" data-align-char="(">2432 (8.2)</td></tr><tr class="valign-top"><td class="text-align-left">Pulmonary</td><td class="text-align-char" data-align-char="(">2212 (7.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurology</td><td class="text-align-char" data-align-char="(">2064 (7.0)</td></tr><tr class="valign-top"><td class="text-align-left">Oncology</td><td class="text-align-char" data-align-char="(">1217 (4.1)</td></tr><tr class="valign-top"><td class="text-align-left">Infectious disease</td><td class="text-align-char" data-align-char="(">1171 (4.0)</td></tr><tr class="valign-top"><td class="text-align-left">Endocrinology</td><td class="text-align-char" data-align-char="(">906 (3.1)</td></tr><tr class="valign-top"><td class="text-align-left">Nephrology</td><td class="text-align-char" data-align-char="(">826 (2.8)</td></tr><tr class="valign-top"><td class="text-align-left">Open heart surgery</td><td class="text-align-char" data-align-char="(">656 (2.2)</td></tr><tr class="valign-top"><td class="text-align-left">Interventional cardiology</td><td class="text-align-char" data-align-char="(">624 (2.1)</td></tr><tr class="valign-top"><td class="text-align-left">Gynecological surgery</td><td class="text-align-char" data-align-char="(">450 (1.5)</td></tr><tr class="valign-top"><td class="text-align-left">Urological surgery</td><td class="text-align-char" data-align-char="(">326 (1.1)</td></tr><tr class="valign-top"><td class="text-align-left">ENT surgery</td><td class="text-align-char" data-align-char="(">289 (1.0)</td></tr><tr class="valign-top"><td class="text-align-left">Obstetrics without delivery</td><td class="text-align-char" data-align-char="(">261 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Hematology</td><td class="text-align-char" data-align-char="(">253 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedicsnonsurgical</td><td class="text-align-char" data-align-char="(">241 (0.8)</td></tr><tr class="valign-top"><td class="text-align-left">Rehabilitation</td><td class="text-align-char" data-align-char="(">204 (0.7)</td></tr><tr class="valign-top"><td class="text-align-left">Otolaryngology</td><td class="text-align-char" data-align-char="(">183 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">Rheumatology</td><td class="text-align-char" data-align-char="(">165 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">General medicine</td><td class="text-align-char" data-align-char="(">162 (0.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurological surgery</td><td class="text-align-char" data-align-char="(">112 (0.4)</td></tr><tr class="valign-top"><td class="text-align-left">Urology</td><td class="text-align-char" data-align-char="(">101 (0.3)</td></tr><tr class="valign-top"><td class="text-align-left">Dermatology</td><td class="text-align-char" data-align-char="(">52 (0.2)</td></tr><tr class="valign-top"><td class="text-align-left">Grand total</td><td class="text-align-char" data-align-char="(">29535 (100.0)</td></tr></tbody></table><p>Hospital LOS decreased 9.8% from baseline among participating doctors, while LOS decreased 9.0% among non‐participating physicians; this difference was not statistically significant (<em>P</em> = 0.6). Participating physicians reduced costs by an average of $7,871 per quarter, compared to a reduction in costs by $3,018 for admissions by non‐participating physicians (<em>P</em> &lt; 0.0001). The average savings per admission for the participating physicians were $1,835, and for non‐participating physicians were $1,107, a difference of $728 per admission. Overall, cost savings during the three year period averaged $105,000 per physician who participated in the program and $67,000 per physician who did not (<em>P</em> &lt; 0.05). There was not a statistical difference in savings between medical and surgical admissions (<em>P</em> = 0.24).</p><p>Deviations from quality thresholds were identified during this time period. Some or all of the gainsharing income was withheld from 8% of participating physicians due to quality issues, incomplete medical records, or administrative reasons. Payouts to participating physicians averaged $1,866 quarterly (range $0‐$27,631). Overall, 9.4% of the hospital savings was directly paid to the participating physicians. Compliance with core measures improved in the following domains from year 2006 to 2009; acute myocardial infarction 94% to 98%, congestive heart failure 76% to 93%, pneumonia 88% to 97%, and surgical care improvement project 90% to 97%, (<em>P</em> = 0.17). There was no measurable increase in 30‐day mortality or readmission by APR‐DRG. The number of incomplete medical records decreased from an average of 43% of the total number of records in the second quarter of 2006 to 30% in the second quarter of 2009 (<em>P</em> &lt; 0.0001). Other quality indicators remained statistically unchanged.</p></section><section id="sec1-4"><h3 class="main">Discussion</h3><p>The promise of gainsharing may motivate physicians to decrease hospital costs while maintaining quality medical care, since it aligns physician and hospital incentives. Providing a reward to physicians creates positive reinforcement, which is more effective than warnings against poor performing physicians (carrot vs. stick).<a href="#bib5" rel="references:#bib5">5</a>, <a href="#bib6" rel="references:#bib6">6</a> This study is the first and largest of its kind to show the results of a gainsharing program for inpatient medical and surgical admissions and demonstrates that significant cost savings may be achieved. This is similar to previous studies that have shown positive outcomes for pay‐for‐performance programs.<a href="#bib7" rel="references:#bib7">7</a></p><p>Participating physicians in the present study accumulated almost $7 million more in savings than non‐participating physicians. Over time this difference has increased, possibly due to a learning curve in educating participating physicians and the way in which information about their performance is given back to them. A significant portion of the hospital's cost savings was through improvements in documentation and completion of medical records. While there was an actual reduction in average length of stay (ALOS), better documentation may also have contributed to adjusting the severity level within each DRG.</p><p>Using financial incentives to positively impact on physician behavior is not new. One program in a community‐based hospitalist group reported similar improvements in medical record documentation, as well as improvements in physician meeting attendance and quality goals.<a href="#bib8" rel="references:#bib8">8</a> Another study found that such hospital programs noted improved physician engagement and commitment to best practices and to improving the quality of care.<a href="#bib9" rel="references:#bib9">9</a></p><p>There is significant experience in the outpatient setting using pay‐for‐performance programs to enhance quality. Millett et al.<a href="#bib10" rel="references:#bib10">10</a> demonstrated a reduction in smoking among patients with diabetes in a program in the United Kingdom. Another study in Rochester, New York that used pay‐for‐performance incentives demonstrated better diabetes management.<a href="#bib11" rel="references:#bib11">11</a> Mandel and Kotagal<a href="#bib12" rel="references:#bib12">12</a> demonstrated improved asthma care utilizing a quality incentive program.</p><p>The use of financial motivation for physicians, as part of a hospital pay‐for‐performance program, has been shown to lead to improvements in quality performance scores when compared to non pay‐for‐performance hospitals.<a href="#bib13" rel="references:#bib13">13</a> Berthiaume demonstrated decreased costs and improvements in risk‐adjusted complications and risk‐adjusted LOS in patents admitted for acute coronary intervention in a pay‐for‐performance program.<a href="#bib14" rel="references:#bib14">14</a> Quality initiatives were integral for the gainsharing program, since measures such as surgical site infections may increase LOS and hospital costs. Core measures related to the care of patients with acute myocardial infarction, heart failure, pneumonia, and surgical prophylaxis steadily improved since the initiation of the gainsharing program. Gainsharing programs also enhance physician compliance with administrative responsibilities such as the completion of medical records.</p><p>One unexpected finding of our study was that there was a cost savings per admission even in the patients of physicians who did not participate in the gainsharing program. While the participating physicians showed statistically significant improvements in cost savings, savings were found in both groups. This raises the question as to whether these cost reductions could have been impacted by other factors such as new labor or vendor contracts, better documentation, improved operating room utilization and improved and timely documentation in the medical record. Another possibility is the Hawthorne effect on physicians, who altered their behavior with knowledge that process and outcome measurement were being measured. Physicians who voluntarily sign up for a gainsharing program would be expected to be more committed to the success of this program than physicians who decide to opt out. While this might appear to be a selection bias it does illustrate the point that motivated physicians are more likely to positively change their practice behaviors. However, one might suggest that financial savings directly attributed to the gainsharing program was not the $25.1 million saved during the 3 years overall, but the difference between participating and non‐participating physicians, or $6.9 million.</p><p>While the motivation to complete medical records was significant (gainsharing dollars were withheld from doctors with more than 5 incomplete charts for more than 30 days) it was not the only reason why the number of delinquent chart percentage decreased during the study period. While the improvement was significant, there are still more opportunities to reduce the number of incomplete charts. Hospital regulatory inspections and periodic physician education were also likely to have reduced the number of incomplete inpatient charts during this time period and may do so in the future.<a href="#bib15" rel="references:#bib15">15</a></p><p>The program focused on the physician activities that have the greatest impact on hospital costs. While optimizing laboratory, blood bank, and pharmacy management decreased hospital costs; we found that improvements in patient LOS, days in an intensive care unit, and management of surgical implants had the greatest impact on costs. Orthopedic surgeons began to use different implants, and all surgeons refrained from opening disposable surgical supplies until needed. Patients in intensive care unit beds stable for transfer were moved to regular medical/surgical rooms earlier. Since the program helped physicians understand the importance of LOS, many physicians increased their rounding on weekends and considered LOS implications before ordering diagnostic procedures that could be performed as an outpatient. Nurses, physician extenders such as physician assistants, and social workers have played an important role in streamlining patient care and hospital discharge; however, they were not directly rewarded under this program.</p><p>There are challenges to aligning the incentives of internists compared to procedure‐based specialists. This may be that the result of surgeons receiving payment for bundled care and thus the incentives are already aligned. The incentive of the program for internists, who get paid for each per daily visit, was intended to overcome the lost income resulting from an earlier discharge. Moreover, in the present study, only the discharging physician received incentive payments for each case. Patient care is undoubtedly a team effort and many physicians (radiologists, anesthesiologists, pathologists, emergency medicine physicians, consultant specialty physicians, etc.) are clearly left out in the present gainsharing program. Aligning the incentives of these physicians might be necessary. Furthermore, the actions of other members of the medical team and consultants, by their behaviors, could limit the incentive payments for the discharging physician. The discharging physician is often unable to control the transfer of a patient from a high‐cost or severity unit, or improve the timeliness of consulting physicians. Previous authors have raised the issue as to whether a physician should be prevented from payment because of the actions of another member of the medical team.<a href="#bib16" rel="references:#bib16">16</a></p><p>Ensuring a fair and transparent system is important in any pay‐for‐performance program. The present gainsharing program required sophisticated data analysis, which added to the costs of the program. To implement such a program, data must be clear and understandable, segregated by DRG and severity adjusted. But should the highest reward payments go to those who perform the best or improve the most? In the present study, some physicians were consistently unable to meet quality benchmarks. This may be related to several factors, 1 of which might be a particular physician's case mix. Some authors have raised concerns that pay‐for‐performance programs may unfairly impact physicians who care for more challenging or patients from disadvantaged socioeconomic circumstances.<a href="#bib17" rel="references:#bib17">17</a> Other authors have questioned whether widespread implementation of such a program could potentially increase healthcare disparities in the community.<a href="#bib18" rel="references:#bib18">18</a> It has been suggested by Greene and Nash that for a program to be successful, physicians who feel they provide good care yet but are not rewarded should be given an independent review.<a href="#bib16" rel="references:#bib16">16</a> Such a process is important to prevent resentment among physicians who are unable to meet benchmarks for payment, despite hard work.<a href="#bib19" rel="references:#bib19">19</a> Conversely, other studies have found that many physicians who receive payments in a pay‐for‐performance system do not necessarily consciously make improvement to enhance financial performance.<a href="#bib20" rel="references:#bib20">20</a> Only 54% of eligible physicians participated in the present gainsharing program. This is likely due to lack of understanding about the program, misperceptions about the ethics of such programs, perceived possible negative patient outcome, conflict of interest and mistrust.<a href="#bib21" rel="references:#bib21">21</a>, <a href="#bib22" rel="references:#bib22">22</a> This underscores the importance of providing understandable performance results, education, and a physician champion to help facilitate communication and enhanced outcomes. What is clear is that the perception by participating physicians is that this program is worthwhile as the number of participating physicians has steadily increased and it has become an incentive for new providers to choose this medical center over others.</p><p>In conclusion, the results of the present study show that physicians can help hospitals reduce inpatients costs while maintaining or improving hospital quality. Improvements in patient LOS, implant costs, overall costs per admission, and medical record completion were noted. Further work is needed to improve physician education and better understand the impact of uneven physician case mix. Further efforts are necessary to allow other members of the health care team to participate and benefit from gainsharing.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-body"> <div class="clearfix text-formatted field field--name-field-body field--type-text-long field--label-hidden field__item"><section id="sec1-bdy-1"><p>Hospitals are challenged to improve quality while reducing costs, yet traditional methods of cost containment have had limited success in aligning the goals of hospitals and physicians. Physicians directly control more than 80% of total medical costs.<a href="#bib1" rel="references:#bib1">1</a> The current fee‐for‐service system encourages procedures and the use of hospital resources. Without the proper incentives to gain active participation and collaboration of the medical staff in improving the efficiency of care, the ability to manage medical costs and improve hospital operational and financial performance is hampered. A further challenge is to encourage physicians to improve the quality of care and maintain safe medical practice. While several examples of pay‐for‐performance (P4P) have previously been attempted to increase efficiency, gainsharing offers real opportunities to achieve these outcomes.</p><p>Previous reports regarding the results of gainsharing programs describe its use in outpatient settings and its limited ability to reduce costs for inpatient care for surgical implants such as coronary stents<a href="#bib2" rel="references:#bib2">2</a> or orthopedic prostheses.<a href="#bib3" rel="references:#bib3">3</a> The present study represents the largest series to date using a gainsharing model in a comprehensive program of inpatient care at a tertiary care medical center.</p></section><section id="sec1-1"><h3 class="main">Patients and Methods</h3><p>Beth Israel Medical Center is a 1000‐bed tertiary care university‐affiliated teaching hospital, located in New York City. The hospital serves a large and ethnically diverse community predominantly located in the lower east side of Manhattan and discharged about 50,000 patients per year during the study period of July 2006 through June 2009.</p><p>Applied Medical Software, Inc. (AMS, Collingswood, NJ) analyzed hospital data for case mix and severity. To establish best practice norms (BPNs), AMS used inpatient discharge data (UB‐92) to determine costs by APR‐DRG's<a href="#bib4" rel="references:#bib4">4</a> during calendar year 2005, prior to the inception of the program to establish BPNs. Costs were allocated into specific areas listed in Table <a href="#tbl1" rel="references:#tbl1">1</a>. A minimum of 10 cases was necessary in each DRG. Cost outliers (as defined by the mean cost of the APR DRG plus 3 standard deviations) were excluded. These data were used to establish a baseline for each physician and a BPN, which was set at the top 25th percentile for each specific APR DRG. BPNs were determined after exclusions using the following criteria:</p><ul><li><label>1</label><p>Each eligible physician had to have at least 10 admissions within their specialty;</p></li><li><label>2</label><p>Each eligible DRG had to have at least 5 qualifying physicians within a medical specialty;</p></li><li><label>3</label><p>Each eligible APR DRG had to have at least 3 qualifying admissions;</p></li><li><label>4</label><p>If the above criteria are met, the BPN was set at the mean of the top 25th percentile of physicians (25% of the physicians with the lowest costs).</p></li></ul><p> </p><table id="tbl1"><caption><label>Table 1.</label><span class="description">Hospital Cost Allocation Areas in the Gainsharing Program</span></caption><thead></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-15"><p><b>Abbreviations:</b> CCU, coronary care unit; ICU, intensive care unit.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Per diem hospital bed cost</td><td class="text-align-left">Pharmacy</td></tr><tr class="valign-top"><td class="text-align-left">Critical care (ICU and CCU)</td><td class="text-align-left">Laboratory</td></tr><tr class="valign-top"><td class="text-align-left">Medical surgical supplies and implants</td><td class="text-align-left">Cardiopulmonary care</td></tr><tr class="valign-top"><td class="text-align-left">Operating room costs</td><td class="text-align-left">Blood bank</td></tr><tr class="valign-top"><td class="text-align-left">Radiology</td><td class="text-align-left">Intravenous therapy</td></tr></tbody></table><p>Once BPNs were determined, patients were grouped by physician and compared to the BPN for a particular APR DRG. All patients of participating physicians with qualifying APR DRGs were included in the analysis reports summarizing these results, computed quarterly and distributed to each physician. Obstetrical and psychiatric admissions were excluded in the program. APR DRG data for each physician was compared from year to year to determine whether an individual physician demonstrated measurable improvement in performance.</p><p>The gainsharing program was implemented in 2006. Physician participation was voluntary. Payments were made to physicians without any risk or penalties from participation. Incentives were based on individual performance. Incentives for nonsurgical admissions were intended to offset the loss of physician income related to more efficient medical management and a reduced hospital length of stay (LOS). Income for surgical admissions was intended to reward physicians for efficient preoperative and postoperative care.</p><p>The methodology provides financial incentives for physicians for each hospital discharge in 2 ways:</p><ul><li><label>1</label><p>Improvement in costs per case against their own historical performance;</p></li><li><label>2</label><p>Cost per case performance compared to BPN.</p></li></ul><p> </p><p>In the first year of the gainsharing program, two thirds of the total allowable incentive payments were allocated to physicians' improvement, with one third based on a performance metric. Payments for improvement were phased out over the first 3 years of the gainsharing program, with payments focused fully on performance in Year 3. Cases were adjusted for case‐mix and severity of illness (four levels of APR DRG). Physicians were not penalized for any cases in which costs greatly exceeded BPN. A floor was placed at the BPN and no additional financial incentives were paid for surpassing it. Baselines and BPNs were recalculated yearly.</p><p>A key aspect of the gainsharing program was the establishment of specific quality parameters (Table <a href="#tbl2" rel="references:#tbl2">2</a>) that need to be met before any incentive payments were made. A committee regularly reviewed the quality performance data of each physician to determine eligibility for payments. Physicians were considered to be ineligible for incentive compensation until the next measurement period if there was evidence of failure to adequately meet these measures. At least 80% compliance with core measures (minimum 5 discharges in each domain) was expected. Infectious complication rates were to remain not more than 1 standard deviation above National Healthcare Safety Network rates during the same time period. In addition, payments were withheld from physicians if it was found that the standard of care was not met for any morbidity or mortality that was peer reviewed or if there were any significant patient complaints. Readmission rates were expected to remain at or below the baseline established during the previous 12 months by DRG.</p><table id="tbl2"><caption><label>Table 2.</label><span class="description">Quality Factors Used to Determine Physician Payment in Gainsharing Program</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Quality Measure</th><th class="text-align-left">Goal</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-23"><p><b>Abbreviations:</b> ACEI, Angiotensin converting enzyme inhibitor; AMI, Acute myocardial infarction; ARB, Angiotensin II receptor blockers; CHF, Congestive heart failure; HCAHPS, Hospital consumer assessment of healthcare providers and systems; LVSD, left ventricular systolic dysfunction; NHSN, Center for Disease Control (CDC) National Healthcare Safety Network.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Readmissions within 7 days for the same or related diagnosis</td><td class="text-align-left">Decrease, or less than 10% of discharges</td></tr><tr class="valign-top"><td class="text-align-left">Documentationquality and timeliness of medical record and related documentation including date, time, and sign all chart entries</td><td class="text-align-left">No more than 20% of average monthly discharged medical records incomplete for more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Consultation with social work/discharge planner within 24 hours of admission for appropriate pts</td><td class="text-align-left">&gt;80% of all appropriate cases</td></tr><tr class="valign-top"><td class="text-align-left">Timely switch from intravenous to oral antibiotics in accordance with hospital policy (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Unanticipated return to the operating room</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Patient complaints</td><td class="text-align-left">Decrease</td></tr><tr class="valign-top"><td class="text-align-left">Patient satisfaction (HCAHPS)</td><td class="text-align-left">&gt;75% physician domain</td></tr><tr class="valign-top"><td class="text-align-left">Ventilator associated pneumonia</td><td class="text-align-left">Decrease or &lt; 5%</td></tr><tr class="valign-top"><td class="text-align-left">Central line associated blood stream infections</td><td class="text-align-left">Decrease or &lt; 5 per 1000 catheter days.</td></tr><tr class="valign-top"><td class="text-align-left">Surgical site infections</td><td class="text-align-left">Decrease or within 1 standard deviation of NHSN</td></tr><tr class="valign-top"><td class="text-align-left">Antibiotic prophylaxis (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Inpatient mortality</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Medication errors</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">Delinquent medical records</td><td class="text-align-left">&lt;5 charts delinquent more than 30 days</td></tr><tr class="valign-top"><td class="text-align-left">Falls with injury</td><td class="text-align-left">Decrease or &lt;1%</td></tr><tr class="valign-top"><td class="text-align-left">AMI: aspirin on arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ACEI or ARB for LVSD (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Adult smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">AMI‐ Beta blocker prescribed at arrival and discharge (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: discharge instructions (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: Left ventricular function assessment (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: ACEI or ARB for left ventricular systolic dysfunction (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">CHF: smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr><tr class="valign-top"><td class="text-align-left">Pneumonia: O2 assessment, pneumococcal vaccine, blood culture and sensitivity before first antibiotic, smoking cessation counseling (%)</td><td class="text-align-char" data-align-char=".">&gt;80</td></tr></tbody></table><p>Employed and private practice community physicians were both eligible for the gainsharing program. Physician participation in the program was voluntary. All patients admitted to the Medical Center received notification on admission about the program. The aggregate costs by DRG were calculated quarterly. Savings over the previous yearif anywere calculated. A total of 20% of the savings was used to administer the program and for incentive payments to physicians.</p><p>From July 1, 2006 through September 2008, only commercial managed care cases were eligible for this program. As a result of the approval of the gainsharing program as a demonstration project by the Centers for Medicare and Medicaid Services (CMS), Medicare cases were added to the program starting October 1, 2008.</p></section><section id="sec1-2"><h3 class="main">Physician Payment Calculation Methodology</h3><section id="sec2-1"><h3 class="main">Performance Incentive</h3><p>The performance incentive was intended to reward demonstrated levels of performance. Accordingly, a physician's share in hospital savings was in proportion to the relationship between their individual performance and the BPN. This computation was the same for both surgical and medical admissions. The following equation illustrates the computation of performance incentives for participating physicians: <displayeditem class="mathematics" id="di-ueqn-1" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-1"><mediaresource alt="equation image" href="tex2gif-ueqn-1.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\displaystyle{\rm 90{th}\ Percentile\ BPN\ Cost}{\hbox{-}}{\rm Physician's\ Actual\ Cost} \over \displaystyle{\rm 90{th}\ Percentile\ Cost}{\hbox{-}}{\rm Best\ Practice\ Norm\ Cost }\right\}\cr {\rm X}\cr {\rm Maximum\ Performance\ Incentive}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>This computation was made at the specific severity level for each hospital discharge. Payment for the performance incentive was made only to physicians at or below the 90th percentile of physicians.</p></section><section id="sec2-2"><h3 class="main">Improvement Incentive</h3><p>The improvement incentive was intended to encourage positive change. No payments were made from the improvement incentive unless an individual physician demonstrated measurable improvement in operational performance for either surgical or medical admissions. However, because physicians who admitted nonsurgical cases experienced reduced income as they help the hospital to improve operational performance, the methodology for calculating the improvement incentive was different for medical as opposed to surgical cases, as shown below.</p><p>For Medical DRGs:</p><p>For each severity level the following is calculated: <displayeditem class="mathematics" id="di-ueqn-2" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-2"><mediaresource alt="equation image" href="tex2gif-ueqn-2.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ \matrix{\left\{\matrix{{\rm Base\ Year\ Case\ Mix\ Adjusted\ ALOS}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ ALOS}}\right\}\cr {\rm X}\cr {\rm Per\ Diem}\cr {\rm X}\cr {\rm Rate\ year\ Admissions}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>For Surgical DRGs: <displayeditem class="mathematics" id="di-ueqn-3" numbered="no"><mediaresourcegroup><mediaresource alt="equation image" href="urn:x-wiley:15535592:media:JHM788:tex2gif-ueqn-3"><mediaresource alt="equation image" href="tex2gif-ueqn-3.gif" mimetype="image/gif" rendition="webOriginal"><mediaresource alt="TeX code" mimetype="application/x-tex"><data><!--[CDATA[$$ {\left\{\matrix{ {\rm Base\ Year\ Case\ Mix\ Adjusted\ Cost}{\hbox{-}}{\rm Rate\ Year}\cr {\rm Case\ Mix\ Adjusted\ Cost}}\right\}\over \matrix{\left\{{\rm 90{th}\ Percentile\ Base\ Year\ Cost - Best\ Practice\ Cost}\right\}\cr {\rm X}\cr {\rm Case\ Mix\ Adjusted\ Maximum}\cr {\rm Improvement\ Incentive}\cr {\rm X}\cr {\rm Rate\ Year\ Admissions}}} $$]]--></data></mediaresource></mediaresource></mediaresource></mediaresourcegroup></displayeditem></p><p>Cost savings were calculated quarterly and defined as the cost per case before the gainsharing program began minus the actual case cost by APR DRG. Student's <em>t</em>‐test was used for continuous data and the categorical data trends were analyzed using Mantel‐Haenszel Chi‐Square.</p><p>At least every 6 months, all participating physicians received case‐specific and cost‐centered data about their discharges. They also received a careful explanation of opportunities for financial or quality improvement.</p></section></section><section id="sec1-3"><h3 class="main">Results</h3><p>Over the 3‐year period, 184 physicians enrolled, representing 54% of those eligible. The remainder of physicians either decided not to enroll or were not eligible due to inadequate number of index DRG cases or excluded diagnoses. Payer mix was 27% Medicare and 48% of the discharges were commercial and managed care. The remaining cases were a combination of Medicaid and self‐pay. A total of 29,535 commercial and managed care discharges were evaluated from participating physicians (58%) and 20,360 similar discharges from non‐participating physicians. This number of admissions accounted for 29% of all hospital discharges during this time period. Surgical admissions accounted for 43% and nonsurgical admissions for 57%. The distribution of patients by service is shown in Table <a href="#tbl3" rel="references:#tbl3">3</a>. Pulmonary and cardiology diagnoses were the most frequent reasons for medical admissions. General and head and neck surgery were the most frequent surgical admissions. During the time period of the gainsharing program, the medical center saved $25.1 million for costs attributed to these cases. Participating physicians saved $6.9 million more than non‐participating physicians (<em>P</em> = 0.02, Figure <a href="#fig1" rel="references:#fig1">1</a>), but all discharges demonstrated cost savings during the study period. Cost savings (Figure <a href="#fig2" rel="references:#fig2">2</a>) resulted from savings in medical/surgical supplies and implants (35%), daily hospital costs, (28%), intensive care unit costs (16%) and coronary care unit costs (15%), and operating room costs (8%). Reduction in cost from reduced magnetic resonance imaging (MRI) use was not statistically significant. There were minimal increases in costs due to computed tomography (CT) scan use, cardiopulmonary care, laboratory use, pharmacy and blood bank, but none of these reached statistical significance.</p><div id="fig1"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 1"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig001_195.jpg" width="650" height="492" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 1 </div> </div> </article><figcaption>Cumulative cost savings (in millions of $ dollars) for participating physicians (PAR) and non‐participating physicians (Non‐Par) year 2006 to 2009 (P = 0.02).</figcaption></figure></div><div id="fig2"><figure role="group" class="caption caption-drupal-media"><article class="media media--type-image media--view-mode-full-width colorbox" data-alt-text="" data-credit="Figure 2"><div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/journals/mfig002_113.jpg" width="650" height="412" typeof="foaf:Image" /></div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> Figure 2 </div> </div> </article><figcaption>Savings ($ dollars) by cost center. MSI, medical surgical supplies and implants; AP, hospital daily costs; ICU, intensive care unit; CCU, coronary care unit; OR, operating room charges; MRI, magnetic resonance imaging; CT, CT scan; CPL, cardiopulmonary lab; CCL, clinical laboratory; DRU, pharmacy; BLD, blood bank.</figcaption></figure></div><table id="tbl3"><caption><label>Table 3.</label><span class="description">Distribution of Cases Among Services for Physicians Participating in Gainsharing</span></caption><thead><tr class="valign-bottom rowsep"><th class="text-align-left">Admissions by Service</th><th class="text-align-left">Number (%)</th></tr></thead><tfoot><tr><td colspan="2"><ul><li id="note-p-37"><p><b>Abbreviation:</b> ENT, ear, nose, throat.</p></li></ul></td></tr></tfoot><tbody class="valign-top"><tr class="valign-top"><td class="text-align-left">Cardiology</td><td class="text-align-char" data-align-char="(">4512 (15.3)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedic surgery</td><td class="text-align-char" data-align-char="(">3994 (13.5)</td></tr><tr class="valign-top"><td class="text-align-left">Gastroenterology</td><td class="text-align-char" data-align-char="(">3214 (10.9)</td></tr><tr class="valign-top"><td class="text-align-left">General surgery</td><td class="text-align-char" data-align-char="(">2908 (9.8)</td></tr><tr class="valign-top"><td class="text-align-left">Cardiovascular surgery</td><td class="text-align-char" data-align-char="(">2432 (8.2)</td></tr><tr class="valign-top"><td class="text-align-left">Pulmonary</td><td class="text-align-char" data-align-char="(">2212 (7.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurology</td><td class="text-align-char" data-align-char="(">2064 (7.0)</td></tr><tr class="valign-top"><td class="text-align-left">Oncology</td><td class="text-align-char" data-align-char="(">1217 (4.1)</td></tr><tr class="valign-top"><td class="text-align-left">Infectious disease</td><td class="text-align-char" data-align-char="(">1171 (4.0)</td></tr><tr class="valign-top"><td class="text-align-left">Endocrinology</td><td class="text-align-char" data-align-char="(">906 (3.1)</td></tr><tr class="valign-top"><td class="text-align-left">Nephrology</td><td class="text-align-char" data-align-char="(">826 (2.8)</td></tr><tr class="valign-top"><td class="text-align-left">Open heart surgery</td><td class="text-align-char" data-align-char="(">656 (2.2)</td></tr><tr class="valign-top"><td class="text-align-left">Interventional cardiology</td><td class="text-align-char" data-align-char="(">624 (2.1)</td></tr><tr class="valign-top"><td class="text-align-left">Gynecological surgery</td><td class="text-align-char" data-align-char="(">450 (1.5)</td></tr><tr class="valign-top"><td class="text-align-left">Urological surgery</td><td class="text-align-char" data-align-char="(">326 (1.1)</td></tr><tr class="valign-top"><td class="text-align-left">ENT surgery</td><td class="text-align-char" data-align-char="(">289 (1.0)</td></tr><tr class="valign-top"><td class="text-align-left">Obstetrics without delivery</td><td class="text-align-char" data-align-char="(">261 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Hematology</td><td class="text-align-char" data-align-char="(">253 (0.9)</td></tr><tr class="valign-top"><td class="text-align-left">Orthopedicsnonsurgical</td><td class="text-align-char" data-align-char="(">241 (0.8)</td></tr><tr class="valign-top"><td class="text-align-left">Rehabilitation</td><td class="text-align-char" data-align-char="(">204 (0.7)</td></tr><tr class="valign-top"><td class="text-align-left">Otolaryngology</td><td class="text-align-char" data-align-char="(">183 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">Rheumatology</td><td class="text-align-char" data-align-char="(">165 (0.6)</td></tr><tr class="valign-top"><td class="text-align-left">General medicine</td><td class="text-align-char" data-align-char="(">162 (0.5)</td></tr><tr class="valign-top"><td class="text-align-left">Neurological surgery</td><td class="text-align-char" data-align-char="(">112 (0.4)</td></tr><tr class="valign-top"><td class="text-align-left">Urology</td><td class="text-align-char" data-align-char="(">101 (0.3)</td></tr><tr class="valign-top"><td class="text-align-left">Dermatology</td><td class="text-align-char" data-align-char="(">52 (0.2)</td></tr><tr class="valign-top"><td class="text-align-left">Grand total</td><td class="text-align-char" data-align-char="(">29535 (100.0)</td></tr></tbody></table><p>Hospital LOS decreased 9.8% from baseline among participating doctors, while LOS decreased 9.0% among non‐participating physicians; this difference was not statistically significant (<em>P</em> = 0.6). Participating physicians reduced costs by an average of $7,871 per quarter, compared to a reduction in costs by $3,018 for admissions by non‐participating physicians (<em>P</em> &lt; 0.0001). The average savings per admission for the participating physicians were $1,835, and for non‐participating physicians were $1,107, a difference of $728 per admission. Overall, cost savings during the three year period averaged $105,000 per physician who participated in the program and $67,000 per physician who did not (<em>P</em> &lt; 0.05). There was not a statistical difference in savings between medical and surgical admissions (<em>P</em> = 0.24).</p><p>Deviations from quality thresholds were identified during this time period. Some or all of the gainsharing income was withheld from 8% of participating physicians due to quality issues, incomplete medical records, or administrative reasons. Payouts to participating physicians averaged $1,866 quarterly (range $0‐$27,631). Overall, 9.4% of the hospital savings was directly paid to the participating physicians. Compliance with core measures improved in the following domains from year 2006 to 2009; acute myocardial infarction 94% to 98%, congestive heart failure 76% to 93%, pneumonia 88% to 97%, and surgical care improvement project 90% to 97%, (<em>P</em> = 0.17). There was no measurable increase in 30‐day mortality or readmission by APR‐DRG. The number of incomplete medical records decreased from an average of 43% of the total number of records in the second quarter of 2006 to 30% in the second quarter of 2009 (<em>P</em> &lt; 0.0001). Other quality indicators remained statistically unchanged.</p></section><section id="sec1-4"><h3 class="main">Discussion</h3><p>The promise of gainsharing may motivate physicians to decrease hospital costs while maintaining quality medical care, since it aligns physician and hospital incentives. Providing a reward to physicians creates positive reinforcement, which is more effective than warnings against poor performing physicians (carrot vs. stick).<a href="#bib5" rel="references:#bib5">5</a>, <a href="#bib6" rel="references:#bib6">6</a> This study is the first and largest of its kind to show the results of a gainsharing program for inpatient medical and surgical admissions and demonstrates that significant cost savings may be achieved. This is similar to previous studies that have shown positive outcomes for pay‐for‐performance programs.<a href="#bib7" rel="references:#bib7">7</a></p><p>Participating physicians in the present study accumulated almost $7 million more in savings than non‐participating physicians. Over time this difference has increased, possibly due to a learning curve in educating participating physicians and the way in which information about their performance is given back to them. A significant portion of the hospital's cost savings was through improvements in documentation and completion of medical records. While there was an actual reduction in average length of stay (ALOS), better documentation may also have contributed to adjusting the severity level within each DRG.</p><p>Using financial incentives to positively impact on physician behavior is not new. One program in a community‐based hospitalist group reported similar improvements in medical record documentation, as well as improvements in physician meeting attendance and quality goals.<a href="#bib8" rel="references:#bib8">8</a> Another study found that such hospital programs noted improved physician engagement and commitment to best practices and to improving the quality of care.<a href="#bib9" rel="references:#bib9">9</a></p><p>There is significant experience in the outpatient setting using pay‐for‐performance programs to enhance quality. Millett et al.<a href="#bib10" rel="references:#bib10">10</a> demonstrated a reduction in smoking among patients with diabetes in a program in the United Kingdom. Another study in Rochester, New York that used pay‐for‐performance incentives demonstrated better diabetes management.<a href="#bib11" rel="references:#bib11">11</a> Mandel and Kotagal<a href="#bib12" rel="references:#bib12">12</a> demonstrated improved asthma care utilizing a quality incentive program.</p><p>The use of financial motivation for physicians, as part of a hospital pay‐for‐performance program, has been shown to lead to improvements in quality performance scores when compared to non pay‐for‐performance hospitals.<a href="#bib13" rel="references:#bib13">13</a> Berthiaume demonstrated decreased costs and improvements in risk‐adjusted complications and risk‐adjusted LOS in patents admitted for acute coronary intervention in a pay‐for‐performance program.<a href="#bib14" rel="references:#bib14">14</a> Quality initiatives were integral for the gainsharing program, since measures such as surgical site infections may increase LOS and hospital costs. Core measures related to the care of patients with acute myocardial infarction, heart failure, pneumonia, and surgical prophylaxis steadily improved since the initiation of the gainsharing program. Gainsharing programs also enhance physician compliance with administrative responsibilities such as the completion of medical records.</p><p>One unexpected finding of our study was that there was a cost savings per admission even in the patients of physicians who did not participate in the gainsharing program. While the participating physicians showed statistically significant improvements in cost savings, savings were found in both groups. This raises the question as to whether these cost reductions could have been impacted by other factors such as new labor or vendor contracts, better documentation, improved operating room utilization and improved and timely documentation in the medical record. Another possibility is the Hawthorne effect on physicians, who altered their behavior with knowledge that process and outcome measurement were being measured. Physicians who voluntarily sign up for a gainsharing program would be expected to be more committed to the success of this program than physicians who decide to opt out. While this might appear to be a selection bias it does illustrate the point that motivated physicians are more likely to positively change their practice behaviors. However, one might suggest that financial savings directly attributed to the gainsharing program was not the $25.1 million saved during the 3 years overall, but the difference between participating and non‐participating physicians, or $6.9 million.</p><p>While the motivation to complete medical records was significant (gainsharing dollars were withheld from doctors with more than 5 incomplete charts for more than 30 days) it was not the only reason why the number of delinquent chart percentage decreased during the study period. While the improvement was significant, there are still more opportunities to reduce the number of incomplete charts. Hospital regulatory inspections and periodic physician education were also likely to have reduced the number of incomplete inpatient charts during this time period and may do so in the future.<a href="#bib15" rel="references:#bib15">15</a></p><p>The program focused on the physician activities that have the greatest impact on hospital costs. While optimizing laboratory, blood bank, and pharmacy management decreased hospital costs; we found that improvements in patient LOS, days in an intensive care unit, and management of surgical implants had the greatest impact on costs. Orthopedic surgeons began to use different implants, and all surgeons refrained from opening disposable surgical supplies until needed. Patients in intensive care unit beds stable for transfer were moved to regular medical/surgical rooms earlier. Since the program helped physicians understand the importance of LOS, many physicians increased their rounding on weekends and considered LOS implications before ordering diagnostic procedures that could be performed as an outpatient. Nurses, physician extenders such as physician assistants, and social workers have played an important role in streamlining patient care and hospital discharge; however, they were not directly rewarded under this program.</p><p>There are challenges to aligning the incentives of internists compared to procedure‐based specialists. This may be that the result of surgeons receiving payment for bundled care and thus the incentives are already aligned. The incentive of the program for internists, who get paid for each per daily visit, was intended to overcome the lost income resulting from an earlier discharge. Moreover, in the present study, only the discharging physician received incentive payments for each case. Patient care is undoubtedly a team effort and many physicians (radiologists, anesthesiologists, pathologists, emergency medicine physicians, consultant specialty physicians, etc.) are clearly left out in the present gainsharing program. Aligning the incentives of these physicians might be necessary. Furthermore, the actions of other members of the medical team and consultants, by their behaviors, could limit the incentive payments for the discharging physician. The discharging physician is often unable to control the transfer of a patient from a high‐cost or severity unit, or improve the timeliness of consulting physicians. Previous authors have raised the issue as to whether a physician should be prevented from payment because of the actions of another member of the medical team.<a href="#bib16" rel="references:#bib16">16</a></p><p>Ensuring a fair and transparent system is important in any pay‐for‐performance program. The present gainsharing program required sophisticated data analysis, which added to the costs of the program. To implement such a program, data must be clear and understandable, segregated by DRG and severity adjusted. But should the highest reward payments go to those who perform the best or improve the most? In the present study, some physicians were consistently unable to meet quality benchmarks. This may be related to several factors, 1 of which might be a particular physician's case mix. Some authors have raised concerns that pay‐for‐performance programs may unfairly impact physicians who care for more challenging or patients from disadvantaged socioeconomic circumstances.<a href="#bib17" rel="references:#bib17">17</a> Other authors have questioned whether widespread implementation of such a program could potentially increase healthcare disparities in the community.<a href="#bib18" rel="references:#bib18">18</a> It has been suggested by Greene and Nash that for a program to be successful, physicians who feel they provide good care yet but are not rewarded should be given an independent review.<a href="#bib16" rel="references:#bib16">16</a> Such a process is important to prevent resentment among physicians who are unable to meet benchmarks for payment, despite hard work.<a href="#bib19" rel="references:#bib19">19</a> Conversely, other studies have found that many physicians who receive payments in a pay‐for‐performance system do not necessarily consciously make improvement to enhance financial performance.<a href="#bib20" rel="references:#bib20">20</a> Only 54% of eligible physicians participated in the present gainsharing program. This is likely due to lack of understanding about the program, misperceptions about the ethics of such programs, perceived possible negative patient outcome, conflict of interest and mistrust.<a href="#bib21" rel="references:#bib21">21</a>, <a href="#bib22" rel="references:#bib22">22</a> This underscores the importance of providing understandable performance results, education, and a physician champion to help facilitate communication and enhanced outcomes. What is clear is that the perception by participating physicians is that this program is worthwhile as the number of participating physicians has steadily increased and it has become an incentive for new providers to choose this medical center over others.</p><p>In conclusion, the results of the present study show that physicians can help hospitals reduce inpatients costs while maintaining or improving hospital quality. Improvements in patient LOS, implant costs, overall costs per admission, and medical record completion were noted. Further work is needed to improve physician education and better understand the impact of uneven physician case mix. Further efforts are necessary to allow other members of the health care team to participate and benefit from gainsharing.</p></section></div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="bib1"><cite class="journal" id="ref-cit1"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib2"><cite class="journal" id="ref-cit2"><span class="author">Ketcham JD</span>,<span class="author">Furukawa MF</span>.<span class="articleTitle">Hospital‐physician gainsharing in cardiology</span>.<span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2008</span>;<span class="vol">27</span>(<span class="issue">3</span>):<span class="pageFirst">803</span>–<span class="pageLast">812</span>. </cite></li><li id="bib3"><cite class="journal" id="ref-cit3"><span class="author">Dirschl DR</span>,<span class="author">Goodroe J</span>,<span class="author">Thornton DM</span>,<span class="author">Eiland GW</span>.<span class="articleTitle">AOA Symposium. Gainsharing in orthopaedics: passing fancy or wave of the future?</span><span class="journalTitle">J Bone Joint Surg Am.</span><span class="pubYear">2007</span>;<span class="vol">89</span>(<span class="issue">9</span>):<span class="pageFirst">2075</span>–<span class="pageLast">2083</span>. </cite></li><li id="bib4"><cite class="book" id="ref-cit4"><span class="otherTitle">All Patient Defined Diagnosis Related Groups™ ‐ 3M Health Information Systems</span>,<span class="publisherLoc">St Paul, MN</span>. </cite></li><li id="bib5"><cite class="journal" id="ref-cit5"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib6"><cite class="journal" id="ref-cit6"><span class="author">Doyon C</span>.<span class="articleTitle">Best practices in record completion</span>.<span class="journalTitle">J Med Pract Manage.</span><span class="pubYear">2004</span>;<span class="vol">20</span>(<span class="issue">1</span>):<span class="pageFirst">18</span>–<span class="pageLast">22</span>. </cite></li><li id="bib7"><cite class="journal" id="ref-cit7"><span class="author">Curtin K</span>,<span class="author">Beckman H</span>,<span class="author">Pankow G</span>, et al.<span class="articleTitle">Return on investment in pay for performance: a diabetes case study</span>.<span class="journalTitle">J Healthc Manag.</span><span class="pubYear">2006</span>;<span class="vol">51</span>(<span class="issue">6</span>):<span class="pageFirst">365</span>–<span class="pageLast">374</span>; discussion 375‐376. </cite></li><li id="bib8"><cite class="journal" id="ref-cit8"><span class="author">Collier VU</span>.<span class="articleTitle">Use of pay for performance in a community hospital private hospitalists group: a preliminary report</span>.<span class="journalTitle">Trans Am Clin Climatol Assoc.</span><span class="pubYear">2007</span>;<span class="vol">188</span>:<span class="pageFirst">263</span>–<span class="pageLast">272</span>. </cite></li><li id="bib9"><cite class="journal" id="ref-cit9"><span class="author">Williams J</span>.<span class="articleTitle">Making the grade with pay for performance: 7 lessons from best‐performing hospitals</span>.<span class="journalTitle">Healthc Financ Manage.</span><span class="pubYear">2006</span>;<span class="vol">60</span>(<span class="issue">12</span>):<span class="pageFirst">79</span>–<span class="pageLast">85</span>. </cite></li><li id="bib10"><cite class="journal" id="ref-cit10"><span class="author">Millett C</span>,<span class="author">Gray J</span>,<span class="author">Saxena S</span>,<span class="author">Netuveli G</span>,<span class="author">Majeed A</span>.<span class="articleTitle">Impact of a pay‐for‐performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes</span>.<span class="journalTitle">CMAJ.</span><span class="pubYear">2007</span>;<span class="vol">176</span>(<span class="issue">12</span>):<span class="pageFirst">1705</span>–<span class="pageLast">1710</span>. </cite></li><li id="bib11"><cite class="journal" id="ref-cit11"><span class="author">Young GJ</span>,<span class="author">Meterko M</span>,<span class="author">Beckman H</span>, et al,<span class="articleTitle">Effects of paying physicians based on their relative performance for quality</span>.<span class="journalTitle">J Gen Intern Med.</span><span class="pubYear">2007</span>;<span class="vol">22</span>(<span class="issue">6</span>):<span class="pageFirst">872</span>–<span class="pageLast">876</span>. </cite></li><li id="bib12"><cite class="journal" id="ref-cit12"><span class="author">Mandel KE</span>,<span class="author">Kotagal UR</span>.<span class="articleTitle">Pay for performance alone cannot drive quality</span>.<span class="journalTitle">Arch Pediatr Adolesc Med.</span><span class="pubYear">2007</span>;<span class="vol">161</span>(<span class="issue">7</span>):<span class="pageFirst">650</span>–<span class="pageLast">655</span>. </cite></li><li id="bib13"><cite class="journal" id="ref-cit13"><span class="author">Grossbart SR</span>.<span class="articleTitle">What's the return? Assessing the effect of “pay‐for‐performance” initiatives on the quality of care delivery</span>.<span class="journalTitle">Med Care Res Rev.</span><span class="pubYear">2006</span>;<span class="vol">63</span>(<span class="issue">1 suppl</span>)( ):<span class="pageFirst">29S</span>–<span class="pageLast">48S</span>. </cite></li><li id="bib14"><cite class="journal" id="ref-cit14"><span class="author">Berthiaume JT</span>,<span class="author">Chung RS</span>,<span class="author">Ryskina KL</span>,<span class="author">Walsh J</span>,<span class="author">Legorrets AP</span>.<span class="articleTitle">Aligning financial incentives with “Get With the Guidelines” to improve cardiovascular care</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2004</span>;<span class="vol">10</span>(<span class="issue">7 pt 2</span>):<span class="pageFirst">501</span>–<span class="pageLast">504</span>. </cite></li><li id="bib15"><cite class="journal" id="ref-cit15"><span class="author">Rogliano J</span>.<span class="articleTitle">Sampling best practices. Managing delinquent records</span>.<span class="journalTitle">J AHIMA.</span><span class="pubYear">1997</span>;<span class="vol">68</span>(<span class="issue">8</span>):<span class="pageFirst">28</span>,30. </cite></li><li id="bib16"><cite class="journal" id="ref-cit16"><span class="author">Greene SE</span>,<span class="author">Nash DB</span>.<span class="articleTitle">Pay for performance: an overview of the literature</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2009</span>;<span class="vol">24</span>;<span class="pageFirst">140</span>–<span class="pageLast">163</span>. </cite></li><li id="bib17"><cite class="journal" id="ref-cit17"><span class="author">McMahon LF</span>,<span class="author">Hofer TP</span>,<span class="author">Hayward RA</span>.<span class="articleTitle">Physician‐level P4P:DOA? Can quality‐based payments be resuscitated?</span><span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2007</span>;<span class="vol">13</span>(<span class="issue">5</span>):<span class="pageFirst">233</span>–<span class="pageLast">236</span>. </cite></li><li id="bib18"><cite class="journal" id="ref-cit18"><span class="author">Casalino LP</span>,<span class="author">Elster A</span>,<span class="author">Eisenberg A</span>, et al.<span class="articleTitle">Will pay for performance and quality reporting affect health care disparities?</span><span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2007</span>;<span class="vol">26</span>(<span class="issue">3</span>):<span class="pageFirst">w405</span>–<span class="pageLast">w414</span>. </cite></li><li id="bib19"><cite class="journal" id="ref-cit19"><span class="author">Campbell SM</span>,<span class="author">McDonald R</span>,<span class="author">Lester H</span>.<span class="articleTitle">The experience of pay for performance in English family practice: a qualitative study</span>.<span class="journalTitle">Ann Fam Med.</span><span class="pubYear">2008</span>;<span class="vol">8</span>(<span class="issue">3</span>):<span class="pageFirst">228</span>–<span class="pageLast">234</span>. </cite></li><li id="bib20"><cite class="journal" id="ref-cit20"><span class="author">Teleki SS</span>,<span class="author">Damberg CL</span>,<span class="author">Pham C.</span>, et al.<span class="articleTitle">Will financial incentives stimulate quality improvement? Reactions from frontline physicians</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2006</span>;<span class="vol">21</span>(<span class="issue">6</span>):<span class="pageFirst">367</span>–<span class="pageLast">374</span>. </cite></li><li id="bib21"><cite class="journal" id="ref-cit21"><span class="author">Pierce RG</span>,<span class="author">Bozic KJ</span>,<span class="author">Bradford DS</span>.<span class="articleTitle">Pay for performance in orthopedic surgery</span>.<span class="journalTitle">Clin Orthop Relat Res.</span><span class="pubYear">2007</span>;<span class="vol">457</span>:<span class="pageFirst">87</span>–<span class="pageLast">95</span>. </cite></li><li id="bib22"><cite class="journal" id="ref-cit22"><span class="author">Seidel RL</span>,<span class="author">Baumgarten DA</span>.<span class="articleTitle">Pay for performance survey of diagnostic radiology faculty and trainees</span>.<span class="journalTitle">J Am Coll Radiol.</span><span class="pubYear">2007</span>;<span class="vol">4</span>(<span class="issue">6</span>):<span class="pageFirst">411</span>–<span class="pageLast">415</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-references"> <div class="clearfix text-formatted field field--name-field-references field--type-text-long field--label-above"> <div class="field__label">References</div> <div class="field__item"><ol class="reference-list"><li id="bib1"><cite class="journal" id="ref-cit1"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib2"><cite class="journal" id="ref-cit2"><span class="author">Ketcham JD</span>,<span class="author">Furukawa MF</span>.<span class="articleTitle">Hospital‐physician gainsharing in cardiology</span>.<span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2008</span>;<span class="vol">27</span>(<span class="issue">3</span>):<span class="pageFirst">803</span>–<span class="pageLast">812</span>. </cite></li><li id="bib3"><cite class="journal" id="ref-cit3"><span class="author">Dirschl DR</span>,<span class="author">Goodroe J</span>,<span class="author">Thornton DM</span>,<span class="author">Eiland GW</span>.<span class="articleTitle">AOA Symposium. Gainsharing in orthopaedics: passing fancy or wave of the future?</span><span class="journalTitle">J Bone Joint Surg Am.</span><span class="pubYear">2007</span>;<span class="vol">89</span>(<span class="issue">9</span>):<span class="pageFirst">2075</span>–<span class="pageLast">2083</span>. </cite></li><li id="bib4"><cite class="book" id="ref-cit4"><span class="otherTitle">All Patient Defined Diagnosis Related Groups™ ‐ 3M Health Information Systems</span>,<span class="publisherLoc">St Paul, MN</span>. </cite></li><li id="bib5"><cite class="journal" id="ref-cit5"><span class="author">Leff B</span>,<span class="author">Reider L</span>,<span class="author">Frick KD</span>, et al.<span class="articleTitle">Guided care and the cost of complex healthcare: a preliminary report</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2009</span>;<span class="vol">15</span>(<span class="issue">8</span>):<span class="pageFirst">555</span>–<span class="pageLast">559</span>. </cite></li><li id="bib6"><cite class="journal" id="ref-cit6"><span class="author">Doyon C</span>.<span class="articleTitle">Best practices in record completion</span>.<span class="journalTitle">J Med Pract Manage.</span><span class="pubYear">2004</span>;<span class="vol">20</span>(<span class="issue">1</span>):<span class="pageFirst">18</span>–<span class="pageLast">22</span>. </cite></li><li id="bib7"><cite class="journal" id="ref-cit7"><span class="author">Curtin K</span>,<span class="author">Beckman H</span>,<span class="author">Pankow G</span>, et al.<span class="articleTitle">Return on investment in pay for performance: a diabetes case study</span>.<span class="journalTitle">J Healthc Manag.</span><span class="pubYear">2006</span>;<span class="vol">51</span>(<span class="issue">6</span>):<span class="pageFirst">365</span>–<span class="pageLast">374</span>; discussion 375‐376. </cite></li><li id="bib8"><cite class="journal" id="ref-cit8"><span class="author">Collier VU</span>.<span class="articleTitle">Use of pay for performance in a community hospital private hospitalists group: a preliminary report</span>.<span class="journalTitle">Trans Am Clin Climatol Assoc.</span><span class="pubYear">2007</span>;<span class="vol">188</span>:<span class="pageFirst">263</span>–<span class="pageLast">272</span>. </cite></li><li id="bib9"><cite class="journal" id="ref-cit9"><span class="author">Williams J</span>.<span class="articleTitle">Making the grade with pay for performance: 7 lessons from best‐performing hospitals</span>.<span class="journalTitle">Healthc Financ Manage.</span><span class="pubYear">2006</span>;<span class="vol">60</span>(<span class="issue">12</span>):<span class="pageFirst">79</span>–<span class="pageLast">85</span>. </cite></li><li id="bib10"><cite class="journal" id="ref-cit10"><span class="author">Millett C</span>,<span class="author">Gray J</span>,<span class="author">Saxena S</span>,<span class="author">Netuveli G</span>,<span class="author">Majeed A</span>.<span class="articleTitle">Impact of a pay‐for‐performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes</span>.<span class="journalTitle">CMAJ.</span><span class="pubYear">2007</span>;<span class="vol">176</span>(<span class="issue">12</span>):<span class="pageFirst">1705</span>–<span class="pageLast">1710</span>. </cite></li><li id="bib11"><cite class="journal" id="ref-cit11"><span class="author">Young GJ</span>,<span class="author">Meterko M</span>,<span class="author">Beckman H</span>, et al,<span class="articleTitle">Effects of paying physicians based on their relative performance for quality</span>.<span class="journalTitle">J Gen Intern Med.</span><span class="pubYear">2007</span>;<span class="vol">22</span>(<span class="issue">6</span>):<span class="pageFirst">872</span>–<span class="pageLast">876</span>. </cite></li><li id="bib12"><cite class="journal" id="ref-cit12"><span class="author">Mandel KE</span>,<span class="author">Kotagal UR</span>.<span class="articleTitle">Pay for performance alone cannot drive quality</span>.<span class="journalTitle">Arch Pediatr Adolesc Med.</span><span class="pubYear">2007</span>;<span class="vol">161</span>(<span class="issue">7</span>):<span class="pageFirst">650</span>–<span class="pageLast">655</span>. </cite></li><li id="bib13"><cite class="journal" id="ref-cit13"><span class="author">Grossbart SR</span>.<span class="articleTitle">What's the return? Assessing the effect of “pay‐for‐performance” initiatives on the quality of care delivery</span>.<span class="journalTitle">Med Care Res Rev.</span><span class="pubYear">2006</span>;<span class="vol">63</span>(<span class="issue">1 suppl</span>)( ):<span class="pageFirst">29S</span>–<span class="pageLast">48S</span>. </cite></li><li id="bib14"><cite class="journal" id="ref-cit14"><span class="author">Berthiaume JT</span>,<span class="author">Chung RS</span>,<span class="author">Ryskina KL</span>,<span class="author">Walsh J</span>,<span class="author">Legorrets AP</span>.<span class="articleTitle">Aligning financial incentives with “Get With the Guidelines” to improve cardiovascular care</span>.<span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2004</span>;<span class="vol">10</span>(<span class="issue">7 pt 2</span>):<span class="pageFirst">501</span>–<span class="pageLast">504</span>. </cite></li><li id="bib15"><cite class="journal" id="ref-cit15"><span class="author">Rogliano J</span>.<span class="articleTitle">Sampling best practices. Managing delinquent records</span>.<span class="journalTitle">J AHIMA.</span><span class="pubYear">1997</span>;<span class="vol">68</span>(<span class="issue">8</span>):<span class="pageFirst">28</span>,30. </cite></li><li id="bib16"><cite class="journal" id="ref-cit16"><span class="author">Greene SE</span>,<span class="author">Nash DB</span>.<span class="articleTitle">Pay for performance: an overview of the literature</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2009</span>;<span class="vol">24</span>;<span class="pageFirst">140</span>–<span class="pageLast">163</span>. </cite></li><li id="bib17"><cite class="journal" id="ref-cit17"><span class="author">McMahon LF</span>,<span class="author">Hofer TP</span>,<span class="author">Hayward RA</span>.<span class="articleTitle">Physician‐level P4P:DOA? Can quality‐based payments be resuscitated?</span><span class="journalTitle">Am J Manag Care.</span><span class="pubYear">2007</span>;<span class="vol">13</span>(<span class="issue">5</span>):<span class="pageFirst">233</span>–<span class="pageLast">236</span>. </cite></li><li id="bib18"><cite class="journal" id="ref-cit18"><span class="author">Casalino LP</span>,<span class="author">Elster A</span>,<span class="author">Eisenberg A</span>, et al.<span class="articleTitle">Will pay for performance and quality reporting affect health care disparities?</span><span class="journalTitle">Health Aff (Millwood).</span><span class="pubYear">2007</span>;<span class="vol">26</span>(<span class="issue">3</span>):<span class="pageFirst">w405</span>–<span class="pageLast">w414</span>. </cite></li><li id="bib19"><cite class="journal" id="ref-cit19"><span class="author">Campbell SM</span>,<span class="author">McDonald R</span>,<span class="author">Lester H</span>.<span class="articleTitle">The experience of pay for performance in English family practice: a qualitative study</span>.<span class="journalTitle">Ann Fam Med.</span><span class="pubYear">2008</span>;<span class="vol">8</span>(<span class="issue">3</span>):<span class="pageFirst">228</span>–<span class="pageLast">234</span>. </cite></li><li id="bib20"><cite class="journal" id="ref-cit20"><span class="author">Teleki SS</span>,<span class="author">Damberg CL</span>,<span class="author">Pham C.</span>, et al.<span class="articleTitle">Will financial incentives stimulate quality improvement? Reactions from frontline physicians</span>.<span class="journalTitle">Am J Med Qual.</span><span class="pubYear">2006</span>;<span class="vol">21</span>(<span class="issue">6</span>):<span class="pageFirst">367</span>–<span class="pageLast">374</span>. </cite></li><li id="bib21"><cite class="journal" id="ref-cit21"><span class="author">Pierce RG</span>,<span class="author">Bozic KJ</span>,<span class="author">Bradford DS</span>.<span class="articleTitle">Pay for performance in orthopedic surgery</span>.<span class="journalTitle">Clin Orthop Relat Res.</span><span class="pubYear">2007</span>;<span class="vol">457</span>:<span class="pageFirst">87</span>–<span class="pageLast">95</span>. </cite></li><li id="bib22"><cite class="journal" id="ref-cit22"><span class="author">Seidel RL</span>,<span class="author">Baumgarten DA</span>.<span class="articleTitle">Pay for performance survey of diagnostic radiology faculty and trainees</span>.<span class="journalTitle">J Am Coll Radiol.</span><span class="pubYear">2007</span>;<span class="vol">4</span>(<span class="issue">6</span>):<span class="pageFirst">411</span>–<span class="pageLast">415</span>. </cite></li></ol></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 5(9)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-issue"> <div class="field field--name-field-article-issue field--type-entity-reference field--label-above"> <div class="field__label">Issue</div> <div class="field__item">Journal of Hospital Medicine - 5(9)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">501-507</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-page-number"> <div class="field field--name-field-article-page-number field--type-string field--label-above"> <div class="field__label">Page Number</div> <div class="field__item">501-507</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-type"> <div class="field field--name-field-article-type field--type-entity-reference field--label-above"> <div class="field__label">Article Type</div> <div class="field__item"><a href="/article-type/article" hreflang="en">Article</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">Quality and financial outcomes from gainsharing for inpatient admissions: A three‐year experience<link href="#fn1" /></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-display-head"> <div class="clearfix text-formatted field field--name-field-article-display-head field--type-text-long field--label-above"> <div class="field__label">Display Headline</div> <div class="field__item">Quality and financial outcomes from gainsharing for inpatient admissions: A three‐year experience<link href="#fn1" /></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-legacy-keywords"> <div class="field field--name-field-article-legacy-keywords field--type-string-long field--label-above"> <div class="field__label">Legacy Keywords</div> <div class="field__item">core measures, financial outcome, gainsharing, healthcare delivery systems, hospital costs, pay‐for‐performance, physician incentives, quality</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-legacy-keywords"> <div class="field field--name-field-article-legacy-keywords field--type-string-long field--label-above"> <div class="field__label">Legacy Keywords</div> <div class="field__item">core measures, financial outcome, gainsharing, healthcare delivery systems, hospital costs, pay‐for‐performance, physician incentives, quality</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-sections"> <div class="field field--name-field-article-sections field--type-entity-reference field--label-above"> <div class="field__label">Sections</div> <div class="field__items"> <div class="field__item"><a href="/sections/original-research" hreflang="en">Original Research</a></div> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-source"> <div class="clearfix text-formatted field field--name-field-article-source field--type-text-long field--label-above"> <div class="field__label">Article Source</div> <div class="field__item"><p>Copyright © 2010 Society of Hospital Medicine</p></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-disallow-ads"> <div class="field field--name-field-article-disallow-ads field--type-boolean field--label-above"> <div class="field__label">Disallow All Ads</div> <div class="field__item"></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-author-contact"> <div class="field field--name-field-article-author-contact field--type-entity-reference field--label-above"> <div class="field__label">Corresponding Author</div> <div class="field__item"><a href="/authors/i-michael-leitman-md" hreflang="en">I. Michael Leitman, MD</a></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-contact"> <div class="field field--name-field-article-contact field--type-string-long field--label-above"> <div class="field__label">Correspondence Location</div> <div class="field__item">Beth Israel Medical Center, 10 Union Square East, Suite 2M, New York, NY 10003</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-gating"> <div class="field field--name-field-article-gating field--type-list-string field--label-above"> <div class="field__label">Content Gating</div> <div class="field__item">No Gating (article Unlocked/Free)</div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-cme-enabled"> <div class="field field--name-field-article-cme-enabled field--type-boolean field--label-above"> <div class="field__label">Alternative CME</div> <div class="field__item"></div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-teaser-media"> <div class="field field--name-field-article-teaser-media field--type-entity-reference field--label-above"> <div class="field__label">Teaser Media</div> <div class="field__item"><article> <div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="https://cdn.mdedge.com/files/s3fs-public/images/article_teasers/mfig001_195.jpg" width="650" height="492" typeof="foaf:Image" /> </div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> </div> </div> </article> </div> </div> </div> <div class="block block-layout-builder block-field-blocknodearticlefield-article-pdf-media"> <div class="field field--name-field-article-pdf-media field--type-entity-reference field--label-above"> <div class="field__label">Article PDF Media</div> <div class="field__item"><article> <div> <div class="field field--name-field-media-document field--type-file field--label-visually_hidden"> <div class="field__label visually-hidden">Document</div> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="https://cdn.mdedge.com/files/s3fs-public/pdfs/journals/788_ftp.pdf" type="application/pdf">788_ftp.pdf</a></span> </div> </div> </div> <div> <div class="field field--name-field-media-credit field--type-string field--label-above"> </div> </div> </article> </div> </div> </div> </div> </div> Tue, 17 Aug 2010 04:00:00 +0000 Content Migration 127441 at https://ma1.mdedge.com https://ma1.mdedge.com/content/outcomes-inpatient-gainsharing#comments