User login
A few months ago, I posted a column on continuous positive airway pressure (CPAP) with the title, “CPAP Oversells and Underperforms.” To date, it has 299 likes and 90 comments, which are almost all negative. I’m glad to see that it’s generated interest, and I’d like to address some of the themes expressed in the posts.
Most comments were personal testimonies to the miracles of CPAP. These are important, and the point deserves emphasis. CPAP can provide significant improvements in daytime sleepiness and quality of life. I closed the original piece by acknowledging this important fact. Readers can be forgiven for missing it given that the title and text were otherwise disparaging of CPAP.
But several comments warrant a more in-depth discussion. The original piece focuses on CPAP and cardiovascular (CV) outcomes but made no mention of atrial fibrillation (AF) or ejection fraction (EF). The effects of CPAP on each are touted by cardiologists and PAP-pushers alike and are drivers of frequent referrals. It›s my fault for omitting them from the discussion.
AF is easy. The data is identical to all other things CPAP and CV. Based on biologic plausibility alone, the likelihood of a relationship between AF and obstructive sleep apnea (OSA) is similar to the odds that the Celtics raise an 18th banner come June. There’s hypoxia, intrathoracic pressure swings, sympathetic surges, and sleep state disruptions. It’s easy to get from there to arrhythmogenesis. There’s lots of observational noise, too, but no randomized proof that CPAP alters this relationship.
I found four randomized controlled trials (RCTs) that tested CPAP’s effect on AF. I’ll save you the suspense; they were all negative. One even found a signal for more adverse events in the CPAP group. These studies have several positive qualities: They enrolled patients with moderate to severe sleep apnea and high oxygen desaturation indices, adherence averaged more than 4 hours across all groups in all trials, and the methods for assessing the AF outcomes differed slightly. There’s also a lot not to like: The sample sizes were small, only one trial enrolled “sleepy” patients (as assessed by the Epworth Sleepiness Score), and follow-up was short.
To paraphrase Carl Sagan, “absence of evidence does not equal evidence of absence.” As a statistician would say, type II error cannot be excluded by these RCTs. In medicine, however, the burden of proof falls on demonstrating efficacy. If we treat before concluding that a therapy works, we risk wasting time, money, medical resources, and the most precious of patient commodities: the energy required for behavior change. In their response to letters to the editor, the authors of the third RCT summarize the CPAP, AF, and CV disease data far better than I ever could. They sound the same words of caution and come out against screening patients with AF for OSA.
The story for CPAP’s effects on EF is similar though muddier. The American College of Cardiology (ACC)/American Heart Association (AHA) guidelines for heart failure cite a meta-analysis showing that CPAP improves left ventricular EF. In 2019, the American Academy of Sleep Medicine (AASM) CPAP guidelines included a systematic review and meta-analysis that found that CPAP has no effect on left ventricular EF in patients with or without heart failure.
There are a million reasons why two systematic reviews on the same topic might come to different conclusions. In this case, the included studies only partially overlap, and broadly speaking, it appears the authors made trade-offs. The review cited by the ACC/AHA had broader inclusion and significantly more patients and paid for it in heterogeneity (I2 in the 80%-90% range). The AASM analysis achieved 0% heterogeneity but limited inclusion to fewer than 100 patients. Across both, the improvement in EF was 2%- 5% at a minimally clinically important difference of 4%. Hardly convincing.
In summary, the road to negative trials and patient harm has always been paved with observational signal and biologic plausibility. Throw in some intellectual and academic bias, and you’ve created the perfect storm of therapeutic overconfidence.
Dr. Holley is a professor in the department of medicine, Uniformed Services University, Bethesda, Maryland, and a physician at Pulmonary/Sleep and Critical Care Medicine, MedStar Washington Hospital Center, Washington. He disclosed ties to Metapharm Inc., CHEST College, and WebMD.
A version of this article appeared on Medscape.com .
A few months ago, I posted a column on continuous positive airway pressure (CPAP) with the title, “CPAP Oversells and Underperforms.” To date, it has 299 likes and 90 comments, which are almost all negative. I’m glad to see that it’s generated interest, and I’d like to address some of the themes expressed in the posts.
Most comments were personal testimonies to the miracles of CPAP. These are important, and the point deserves emphasis. CPAP can provide significant improvements in daytime sleepiness and quality of life. I closed the original piece by acknowledging this important fact. Readers can be forgiven for missing it given that the title and text were otherwise disparaging of CPAP.
But several comments warrant a more in-depth discussion. The original piece focuses on CPAP and cardiovascular (CV) outcomes but made no mention of atrial fibrillation (AF) or ejection fraction (EF). The effects of CPAP on each are touted by cardiologists and PAP-pushers alike and are drivers of frequent referrals. It›s my fault for omitting them from the discussion.
AF is easy. The data is identical to all other things CPAP and CV. Based on biologic plausibility alone, the likelihood of a relationship between AF and obstructive sleep apnea (OSA) is similar to the odds that the Celtics raise an 18th banner come June. There’s hypoxia, intrathoracic pressure swings, sympathetic surges, and sleep state disruptions. It’s easy to get from there to arrhythmogenesis. There’s lots of observational noise, too, but no randomized proof that CPAP alters this relationship.
I found four randomized controlled trials (RCTs) that tested CPAP’s effect on AF. I’ll save you the suspense; they were all negative. One even found a signal for more adverse events in the CPAP group. These studies have several positive qualities: They enrolled patients with moderate to severe sleep apnea and high oxygen desaturation indices, adherence averaged more than 4 hours across all groups in all trials, and the methods for assessing the AF outcomes differed slightly. There’s also a lot not to like: The sample sizes were small, only one trial enrolled “sleepy” patients (as assessed by the Epworth Sleepiness Score), and follow-up was short.
To paraphrase Carl Sagan, “absence of evidence does not equal evidence of absence.” As a statistician would say, type II error cannot be excluded by these RCTs. In medicine, however, the burden of proof falls on demonstrating efficacy. If we treat before concluding that a therapy works, we risk wasting time, money, medical resources, and the most precious of patient commodities: the energy required for behavior change. In their response to letters to the editor, the authors of the third RCT summarize the CPAP, AF, and CV disease data far better than I ever could. They sound the same words of caution and come out against screening patients with AF for OSA.
The story for CPAP’s effects on EF is similar though muddier. The American College of Cardiology (ACC)/American Heart Association (AHA) guidelines for heart failure cite a meta-analysis showing that CPAP improves left ventricular EF. In 2019, the American Academy of Sleep Medicine (AASM) CPAP guidelines included a systematic review and meta-analysis that found that CPAP has no effect on left ventricular EF in patients with or without heart failure.
There are a million reasons why two systematic reviews on the same topic might come to different conclusions. In this case, the included studies only partially overlap, and broadly speaking, it appears the authors made trade-offs. The review cited by the ACC/AHA had broader inclusion and significantly more patients and paid for it in heterogeneity (I2 in the 80%-90% range). The AASM analysis achieved 0% heterogeneity but limited inclusion to fewer than 100 patients. Across both, the improvement in EF was 2%- 5% at a minimally clinically important difference of 4%. Hardly convincing.
In summary, the road to negative trials and patient harm has always been paved with observational signal and biologic plausibility. Throw in some intellectual and academic bias, and you’ve created the perfect storm of therapeutic overconfidence.
Dr. Holley is a professor in the department of medicine, Uniformed Services University, Bethesda, Maryland, and a physician at Pulmonary/Sleep and Critical Care Medicine, MedStar Washington Hospital Center, Washington. He disclosed ties to Metapharm Inc., CHEST College, and WebMD.
A version of this article appeared on Medscape.com .
A few months ago, I posted a column on continuous positive airway pressure (CPAP) with the title, “CPAP Oversells and Underperforms.” To date, it has 299 likes and 90 comments, which are almost all negative. I’m glad to see that it’s generated interest, and I’d like to address some of the themes expressed in the posts.
Most comments were personal testimonies to the miracles of CPAP. These are important, and the point deserves emphasis. CPAP can provide significant improvements in daytime sleepiness and quality of life. I closed the original piece by acknowledging this important fact. Readers can be forgiven for missing it given that the title and text were otherwise disparaging of CPAP.
But several comments warrant a more in-depth discussion. The original piece focuses on CPAP and cardiovascular (CV) outcomes but made no mention of atrial fibrillation (AF) or ejection fraction (EF). The effects of CPAP on each are touted by cardiologists and PAP-pushers alike and are drivers of frequent referrals. It›s my fault for omitting them from the discussion.
AF is easy. The data is identical to all other things CPAP and CV. Based on biologic plausibility alone, the likelihood of a relationship between AF and obstructive sleep apnea (OSA) is similar to the odds that the Celtics raise an 18th banner come June. There’s hypoxia, intrathoracic pressure swings, sympathetic surges, and sleep state disruptions. It’s easy to get from there to arrhythmogenesis. There’s lots of observational noise, too, but no randomized proof that CPAP alters this relationship.
I found four randomized controlled trials (RCTs) that tested CPAP’s effect on AF. I’ll save you the suspense; they were all negative. One even found a signal for more adverse events in the CPAP group. These studies have several positive qualities: They enrolled patients with moderate to severe sleep apnea and high oxygen desaturation indices, adherence averaged more than 4 hours across all groups in all trials, and the methods for assessing the AF outcomes differed slightly. There’s also a lot not to like: The sample sizes were small, only one trial enrolled “sleepy” patients (as assessed by the Epworth Sleepiness Score), and follow-up was short.
To paraphrase Carl Sagan, “absence of evidence does not equal evidence of absence.” As a statistician would say, type II error cannot be excluded by these RCTs. In medicine, however, the burden of proof falls on demonstrating efficacy. If we treat before concluding that a therapy works, we risk wasting time, money, medical resources, and the most precious of patient commodities: the energy required for behavior change. In their response to letters to the editor, the authors of the third RCT summarize the CPAP, AF, and CV disease data far better than I ever could. They sound the same words of caution and come out against screening patients with AF for OSA.
The story for CPAP’s effects on EF is similar though muddier. The American College of Cardiology (ACC)/American Heart Association (AHA) guidelines for heart failure cite a meta-analysis showing that CPAP improves left ventricular EF. In 2019, the American Academy of Sleep Medicine (AASM) CPAP guidelines included a systematic review and meta-analysis that found that CPAP has no effect on left ventricular EF in patients with or without heart failure.
There are a million reasons why two systematic reviews on the same topic might come to different conclusions. In this case, the included studies only partially overlap, and broadly speaking, it appears the authors made trade-offs. The review cited by the ACC/AHA had broader inclusion and significantly more patients and paid for it in heterogeneity (I2 in the 80%-90% range). The AASM analysis achieved 0% heterogeneity but limited inclusion to fewer than 100 patients. Across both, the improvement in EF was 2%- 5% at a minimally clinically important difference of 4%. Hardly convincing.
In summary, the road to negative trials and patient harm has always been paved with observational signal and biologic plausibility. Throw in some intellectual and academic bias, and you’ve created the perfect storm of therapeutic overconfidence.
Dr. Holley is a professor in the department of medicine, Uniformed Services University, Bethesda, Maryland, and a physician at Pulmonary/Sleep and Critical Care Medicine, MedStar Washington Hospital Center, Washington. He disclosed ties to Metapharm Inc., CHEST College, and WebMD.
A version of this article appeared on Medscape.com .