Improving Veteran Care With the Mission Act

Article Type
Changed

NATIONAL HARBOR, MD–The US Department of Veterans Affairs (VA) is in the midst of a significant change in the way it will deliver care to veterans. Agency officials remain optimistic that the change will be for the better, and early indications are positive.

The change is being driven by the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (Mission) Act of 2018, a bill that opens health services options for veterans and integrates VA-administered care and care from community-based providers.

“This is change that is enhancing their experience in the system, and this is enhancing their options and the quality of the options in the system,” Jennifer MacDonald, MD, chief consultant to the principal deputy undersecretary for health at the VA, said during a December 3 session at the AMSUS 2019 annual meeting. “We need also for our workforce to understand how important they are to us across this degree of change.”

Dr. MacDonald highlighted integration with community-based care, including a community urgent care provision that allows veterans to access urgent care facilities and receive care without the need for prior authorization.

“The important piece about that is that we are also looking at the way this care has been accessed,” she said. “By and large, what we have seen from the data is that veterans are indeed seeking community urgent care at a site close to home. This may be CVS or Walgreens. It may be a stand-alone urgent care with a bit more functionality than those Minute Clinics tend to have. We are seeing veterans typically access care through those sites for those minor concerns and illnesses.”

However, she noted that this type of access does not alter the role the VA plays in administration of health care services.

“We are seeing them come back to VA for the majority of their care and for their core care–when there are serious issues, when insulin needs to be adjusted for diabetes, when there are heart disease medications that need to be refilled–we are seeing veterans not seek out urgent care, but come to us, and that is exactly what we want,” she said. “We want the continuity of care to continue and we want to help guide people to the right care, right place, right time.”

Dr. MacDonald also highlighted the expansion of a program that provides a stipend to caregivers that allows veterans to avoid institutionalization and remain within the community under that caregiver’s (a family or friend) supervision. This will expand by year’s end to Vietnam War-era veterans and within 2 years, to veterans that fall between the Vietnam War-era and the September 11, 2001, terrorist attacks.

“We wanted to do this equitably across all eras of veterans,” she said. “This now gives us that opportunity.”

Telehealth also plays a key role.

“For the first time ever, VA now has what we term ‘anywhere-to-anywhere’ telehealth under the Mission Act, an enormous opportunity for us,” she said. “Since we stretch … from New York City to Guam, we need the opportunity to provide care where it may be difficult to recruit and retain providers wherever veterans choose to live,” she said. “We believe that we should be able to meet people where they are regardless of where they choose to live. That’s an aspirational vision, but it is one we believe is exceptionally important and indeed we are moving toward that.”

These are just the beginning; the full implementation of the act goes out to 2034.

According to Dr. MacDonald, the agency is working hard to engage both veterans and the workforce to keep tabs on how the implementation is going.

“It’s a fundamental change in the day-to-day business that they’ve been doing, sometimes for years, and so extremely important across this change is that we have set up processes and now a joint operations center and a number of forums to hear directly from our front line and make sure that their issues are our issues in central office, in DC here, and that they feel heard and that they know that when they have needs, those needs are actioned,” she said.

The VA, under the Mission Act, is also working hard to engage health care providers in the community, including making VA training to community partners, including training on opioid use, suicide prevent and military culture.

However, all these change are for naught if the veterans are not on board. But so far, Dr. MacDonald said the early feedback is very positive.

She cited a VFW survey that asked a question about the Mission Act changes so far and whether they would recommend the VA to other veterans. Ninety percent of the respondents answered they would.

“That’s our marker that we are getting somewhere with these changes and the way we do business,” she said. “That is what we want to see continue to increase.”

Publications
Topics
Sections

NATIONAL HARBOR, MD–The US Department of Veterans Affairs (VA) is in the midst of a significant change in the way it will deliver care to veterans. Agency officials remain optimistic that the change will be for the better, and early indications are positive.

The change is being driven by the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (Mission) Act of 2018, a bill that opens health services options for veterans and integrates VA-administered care and care from community-based providers.

“This is change that is enhancing their experience in the system, and this is enhancing their options and the quality of the options in the system,” Jennifer MacDonald, MD, chief consultant to the principal deputy undersecretary for health at the VA, said during a December 3 session at the AMSUS 2019 annual meeting. “We need also for our workforce to understand how important they are to us across this degree of change.”

Dr. MacDonald highlighted integration with community-based care, including a community urgent care provision that allows veterans to access urgent care facilities and receive care without the need for prior authorization.

“The important piece about that is that we are also looking at the way this care has been accessed,” she said. “By and large, what we have seen from the data is that veterans are indeed seeking community urgent care at a site close to home. This may be CVS or Walgreens. It may be a stand-alone urgent care with a bit more functionality than those Minute Clinics tend to have. We are seeing veterans typically access care through those sites for those minor concerns and illnesses.”

However, she noted that this type of access does not alter the role the VA plays in administration of health care services.

“We are seeing them come back to VA for the majority of their care and for their core care–when there are serious issues, when insulin needs to be adjusted for diabetes, when there are heart disease medications that need to be refilled–we are seeing veterans not seek out urgent care, but come to us, and that is exactly what we want,” she said. “We want the continuity of care to continue and we want to help guide people to the right care, right place, right time.”

Dr. MacDonald also highlighted the expansion of a program that provides a stipend to caregivers that allows veterans to avoid institutionalization and remain within the community under that caregiver’s (a family or friend) supervision. This will expand by year’s end to Vietnam War-era veterans and within 2 years, to veterans that fall between the Vietnam War-era and the September 11, 2001, terrorist attacks.

“We wanted to do this equitably across all eras of veterans,” she said. “This now gives us that opportunity.”

Telehealth also plays a key role.

“For the first time ever, VA now has what we term ‘anywhere-to-anywhere’ telehealth under the Mission Act, an enormous opportunity for us,” she said. “Since we stretch … from New York City to Guam, we need the opportunity to provide care where it may be difficult to recruit and retain providers wherever veterans choose to live,” she said. “We believe that we should be able to meet people where they are regardless of where they choose to live. That’s an aspirational vision, but it is one we believe is exceptionally important and indeed we are moving toward that.”

These are just the beginning; the full implementation of the act goes out to 2034.

According to Dr. MacDonald, the agency is working hard to engage both veterans and the workforce to keep tabs on how the implementation is going.

“It’s a fundamental change in the day-to-day business that they’ve been doing, sometimes for years, and so extremely important across this change is that we have set up processes and now a joint operations center and a number of forums to hear directly from our front line and make sure that their issues are our issues in central office, in DC here, and that they feel heard and that they know that when they have needs, those needs are actioned,” she said.

The VA, under the Mission Act, is also working hard to engage health care providers in the community, including making VA training to community partners, including training on opioid use, suicide prevent and military culture.

However, all these change are for naught if the veterans are not on board. But so far, Dr. MacDonald said the early feedback is very positive.

She cited a VFW survey that asked a question about the Mission Act changes so far and whether they would recommend the VA to other veterans. Ninety percent of the respondents answered they would.

“That’s our marker that we are getting somewhere with these changes and the way we do business,” she said. “That is what we want to see continue to increase.”

NATIONAL HARBOR, MD–The US Department of Veterans Affairs (VA) is in the midst of a significant change in the way it will deliver care to veterans. Agency officials remain optimistic that the change will be for the better, and early indications are positive.

The change is being driven by the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (Mission) Act of 2018, a bill that opens health services options for veterans and integrates VA-administered care and care from community-based providers.

“This is change that is enhancing their experience in the system, and this is enhancing their options and the quality of the options in the system,” Jennifer MacDonald, MD, chief consultant to the principal deputy undersecretary for health at the VA, said during a December 3 session at the AMSUS 2019 annual meeting. “We need also for our workforce to understand how important they are to us across this degree of change.”

Dr. MacDonald highlighted integration with community-based care, including a community urgent care provision that allows veterans to access urgent care facilities and receive care without the need for prior authorization.

“The important piece about that is that we are also looking at the way this care has been accessed,” she said. “By and large, what we have seen from the data is that veterans are indeed seeking community urgent care at a site close to home. This may be CVS or Walgreens. It may be a stand-alone urgent care with a bit more functionality than those Minute Clinics tend to have. We are seeing veterans typically access care through those sites for those minor concerns and illnesses.”

However, she noted that this type of access does not alter the role the VA plays in administration of health care services.

“We are seeing them come back to VA for the majority of their care and for their core care–when there are serious issues, when insulin needs to be adjusted for diabetes, when there are heart disease medications that need to be refilled–we are seeing veterans not seek out urgent care, but come to us, and that is exactly what we want,” she said. “We want the continuity of care to continue and we want to help guide people to the right care, right place, right time.”

Dr. MacDonald also highlighted the expansion of a program that provides a stipend to caregivers that allows veterans to avoid institutionalization and remain within the community under that caregiver’s (a family or friend) supervision. This will expand by year’s end to Vietnam War-era veterans and within 2 years, to veterans that fall between the Vietnam War-era and the September 11, 2001, terrorist attacks.

“We wanted to do this equitably across all eras of veterans,” she said. “This now gives us that opportunity.”

Telehealth also plays a key role.

“For the first time ever, VA now has what we term ‘anywhere-to-anywhere’ telehealth under the Mission Act, an enormous opportunity for us,” she said. “Since we stretch … from New York City to Guam, we need the opportunity to provide care where it may be difficult to recruit and retain providers wherever veterans choose to live,” she said. “We believe that we should be able to meet people where they are regardless of where they choose to live. That’s an aspirational vision, but it is one we believe is exceptionally important and indeed we are moving toward that.”

These are just the beginning; the full implementation of the act goes out to 2034.

According to Dr. MacDonald, the agency is working hard to engage both veterans and the workforce to keep tabs on how the implementation is going.

“It’s a fundamental change in the day-to-day business that they’ve been doing, sometimes for years, and so extremely important across this change is that we have set up processes and now a joint operations center and a number of forums to hear directly from our front line and make sure that their issues are our issues in central office, in DC here, and that they feel heard and that they know that when they have needs, those needs are actioned,” she said.

The VA, under the Mission Act, is also working hard to engage health care providers in the community, including making VA training to community partners, including training on opioid use, suicide prevent and military culture.

However, all these change are for naught if the veterans are not on board. But so far, Dr. MacDonald said the early feedback is very positive.

She cited a VFW survey that asked a question about the Mission Act changes so far and whether they would recommend the VA to other veterans. Ninety percent of the respondents answered they would.

“That’s our marker that we are getting somewhere with these changes and the way we do business,” she said. “That is what we want to see continue to increase.”

Publications
Publications
Topics
Article Type
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Gate On Date
Un-Gate On Date
Use ProPublica
CFC Schedule Remove Status
Hide sidebar & use full width
render the right sidebar.

Survival gains in HR+/HER2– MBC trials yet to be seen in real world

Article Type
Changed

 

The introduction over the last decade of new systemic therapies for the treatment of hormone receptor positive, HER2-negative metastatic breast cancer has not translated into improved survival in a real-world setting, results of a retrospective study suggest.

Among 2,197 patients who received at least one line of systemic therapy for hormone receptor positive, HER2-negative metastatic breast cancer (HR+/HER2– MBC) from 2003 to 2013, there were no significant differences in median duration of hormonal therapy or median overall survival (OS) for patients treated in any of three time spans during that 10-year period, reported Dan Le, MD, MHA, of BC Cancer, Surrey, B.C., and colleagues.

“Despite the introduction of 9 new adjuvant therapies and 2 new metastatic treatments, survival in the metastatic setting for HR-positive, HER2-negative breast cancer did not improve between 2003 and 2013,” they wrote in a report published in Cancer.

Improvements in adjuvant therapy such as the introduction of cyclin-dependent kinase inhibitors (CDKI) may result in fewer relapses but may also affect the response of relapsed cancers to additional lines of therapy, the authors contended.

“Improved adjuvant therapy means that the cancers that do relapse may have more adverse biology, either intrinsically or because of selective pressure and clonal evolution from exposure to more and better drugs in the adjuvant setting. These factors could, in part, explain the lack of improved survival over time observed in this study,” they wrote.

To see whether significant increases in progression-free survival (PFS) in a clinical trial translated into improved outcomes – including OS – in population-based settings, the investigators identified 2,432 patients with HR+/HER2– MBC from data in the prospective Breast Cancer Outcomes Unit Database of BC Cancer. Of this group, 2,197 received at least one line of systemic therapy after an MBC diagnosis, and 1,752 received first and/or second-line hormonal therapy as well.

The patients were treated in one of three time cohorts: from 2003 through 2005, 2007 through 2009, or 2011 through 2013.

Nine new adjuvant systemic therapies with or without neoadjuvant therapy were approved by BC Cancer during the study period. For the entire decade of the study, the mean survival time was 3.1 years, and the median OS was 2.0 years.

The longest survival for patients diagnosed from 2003 through 2005 was 14.6 years, with 18.1% of these patients living at least 5 years after diagnosis. For patients diagnosed from 2007 through 2009, the longest survival was 10.6 years, with 17.7% of these patients living 5 years or longer post diagnosis. For patients in the most recent cohort (with patients diagnosed after August 2012 excluded), the longest survival was 6.6 years, with 17.3% living at least 5 years after diagnosis.

Overall, patients had a median of 9 months of first-line hormonal treatment, and 6.1 months of second-line hormonal therapy, with nearly identical duration across all three time cohorts.

“Ultimately, it seems likely that the greater the proportion of patients we cure with modern adjuvant therapy, the more challenging it will be to improve outcomes for patients with relapsed disease. This underscores the importance of 1) making continued progress in the adjuvant management of potentially curable breast cancer by first studying new therapeutic agents in the metastatic setting and 2) developing a better understanding of how selective pressure and clonal evolution may lead to more resistant biologic phenotypes in MBC,” the investigators wrote.

No specific study funding was disclosed. No authors disclosed potential conflicts of interest.

SOURCE: Le D et al. Cancer 2019 Nov 21. doi: 10.1002/cncr.32631.

Publications
Topics
Sections

 

The introduction over the last decade of new systemic therapies for the treatment of hormone receptor positive, HER2-negative metastatic breast cancer has not translated into improved survival in a real-world setting, results of a retrospective study suggest.

Among 2,197 patients who received at least one line of systemic therapy for hormone receptor positive, HER2-negative metastatic breast cancer (HR+/HER2– MBC) from 2003 to 2013, there were no significant differences in median duration of hormonal therapy or median overall survival (OS) for patients treated in any of three time spans during that 10-year period, reported Dan Le, MD, MHA, of BC Cancer, Surrey, B.C., and colleagues.

“Despite the introduction of 9 new adjuvant therapies and 2 new metastatic treatments, survival in the metastatic setting for HR-positive, HER2-negative breast cancer did not improve between 2003 and 2013,” they wrote in a report published in Cancer.

Improvements in adjuvant therapy such as the introduction of cyclin-dependent kinase inhibitors (CDKI) may result in fewer relapses but may also affect the response of relapsed cancers to additional lines of therapy, the authors contended.

“Improved adjuvant therapy means that the cancers that do relapse may have more adverse biology, either intrinsically or because of selective pressure and clonal evolution from exposure to more and better drugs in the adjuvant setting. These factors could, in part, explain the lack of improved survival over time observed in this study,” they wrote.

To see whether significant increases in progression-free survival (PFS) in a clinical trial translated into improved outcomes – including OS – in population-based settings, the investigators identified 2,432 patients with HR+/HER2– MBC from data in the prospective Breast Cancer Outcomes Unit Database of BC Cancer. Of this group, 2,197 received at least one line of systemic therapy after an MBC diagnosis, and 1,752 received first and/or second-line hormonal therapy as well.

The patients were treated in one of three time cohorts: from 2003 through 2005, 2007 through 2009, or 2011 through 2013.

Nine new adjuvant systemic therapies with or without neoadjuvant therapy were approved by BC Cancer during the study period. For the entire decade of the study, the mean survival time was 3.1 years, and the median OS was 2.0 years.

The longest survival for patients diagnosed from 2003 through 2005 was 14.6 years, with 18.1% of these patients living at least 5 years after diagnosis. For patients diagnosed from 2007 through 2009, the longest survival was 10.6 years, with 17.7% of these patients living 5 years or longer post diagnosis. For patients in the most recent cohort (with patients diagnosed after August 2012 excluded), the longest survival was 6.6 years, with 17.3% living at least 5 years after diagnosis.

Overall, patients had a median of 9 months of first-line hormonal treatment, and 6.1 months of second-line hormonal therapy, with nearly identical duration across all three time cohorts.

“Ultimately, it seems likely that the greater the proportion of patients we cure with modern adjuvant therapy, the more challenging it will be to improve outcomes for patients with relapsed disease. This underscores the importance of 1) making continued progress in the adjuvant management of potentially curable breast cancer by first studying new therapeutic agents in the metastatic setting and 2) developing a better understanding of how selective pressure and clonal evolution may lead to more resistant biologic phenotypes in MBC,” the investigators wrote.

No specific study funding was disclosed. No authors disclosed potential conflicts of interest.

SOURCE: Le D et al. Cancer 2019 Nov 21. doi: 10.1002/cncr.32631.

 

The introduction over the last decade of new systemic therapies for the treatment of hormone receptor positive, HER2-negative metastatic breast cancer has not translated into improved survival in a real-world setting, results of a retrospective study suggest.

Among 2,197 patients who received at least one line of systemic therapy for hormone receptor positive, HER2-negative metastatic breast cancer (HR+/HER2– MBC) from 2003 to 2013, there were no significant differences in median duration of hormonal therapy or median overall survival (OS) for patients treated in any of three time spans during that 10-year period, reported Dan Le, MD, MHA, of BC Cancer, Surrey, B.C., and colleagues.

“Despite the introduction of 9 new adjuvant therapies and 2 new metastatic treatments, survival in the metastatic setting for HR-positive, HER2-negative breast cancer did not improve between 2003 and 2013,” they wrote in a report published in Cancer.

Improvements in adjuvant therapy such as the introduction of cyclin-dependent kinase inhibitors (CDKI) may result in fewer relapses but may also affect the response of relapsed cancers to additional lines of therapy, the authors contended.

“Improved adjuvant therapy means that the cancers that do relapse may have more adverse biology, either intrinsically or because of selective pressure and clonal evolution from exposure to more and better drugs in the adjuvant setting. These factors could, in part, explain the lack of improved survival over time observed in this study,” they wrote.

To see whether significant increases in progression-free survival (PFS) in a clinical trial translated into improved outcomes – including OS – in population-based settings, the investigators identified 2,432 patients with HR+/HER2– MBC from data in the prospective Breast Cancer Outcomes Unit Database of BC Cancer. Of this group, 2,197 received at least one line of systemic therapy after an MBC diagnosis, and 1,752 received first and/or second-line hormonal therapy as well.

The patients were treated in one of three time cohorts: from 2003 through 2005, 2007 through 2009, or 2011 through 2013.

Nine new adjuvant systemic therapies with or without neoadjuvant therapy were approved by BC Cancer during the study period. For the entire decade of the study, the mean survival time was 3.1 years, and the median OS was 2.0 years.

The longest survival for patients diagnosed from 2003 through 2005 was 14.6 years, with 18.1% of these patients living at least 5 years after diagnosis. For patients diagnosed from 2007 through 2009, the longest survival was 10.6 years, with 17.7% of these patients living 5 years or longer post diagnosis. For patients in the most recent cohort (with patients diagnosed after August 2012 excluded), the longest survival was 6.6 years, with 17.3% living at least 5 years after diagnosis.

Overall, patients had a median of 9 months of first-line hormonal treatment, and 6.1 months of second-line hormonal therapy, with nearly identical duration across all three time cohorts.

“Ultimately, it seems likely that the greater the proportion of patients we cure with modern adjuvant therapy, the more challenging it will be to improve outcomes for patients with relapsed disease. This underscores the importance of 1) making continued progress in the adjuvant management of potentially curable breast cancer by first studying new therapeutic agents in the metastatic setting and 2) developing a better understanding of how selective pressure and clonal evolution may lead to more resistant biologic phenotypes in MBC,” the investigators wrote.

No specific study funding was disclosed. No authors disclosed potential conflicts of interest.

SOURCE: Le D et al. Cancer 2019 Nov 21. doi: 10.1002/cncr.32631.

Publications
Publications
Topics
Article Type
Sections
Article Source

FROM CANCER

Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.

Getting a Leg up on the Diagnosis

Article Type
Changed
Display Headline
Getting a Leg up on the Diagnosis

Three years ago, lesions began appearing on this now 68-year-old woman’s legs. They have grown in size and number, and their roughness disturbs the patient. She has been told the lesions are related to aging, but she has never seen anything like them on her friends or family—and she is worried about what they might mean for her health.

Her primary care provider diagnosed warts and performed cryotherapy on several of the lesions. However, the pain was intolerable and the treatment ineffective. To add insult to injury, each treated spot blistered and took more than a month to heal, leaving behind a pinkish brown blemish.

In all other respects, the patient’s health is excellent.

EXAMINATION
Both legs, from the upper thighs to the tops of the feet, are covered with thousands of uniformly distributed, tiny, keratotic, rough, dry papules. All the lesions are essentially identical: white, with no associated signs of inflammation. The patient’s skin is quite dry in general. Neither her palms nor soles are affected.

Rough lesions on leg

What’s the diagnosis?

 

 

DISCUSSION
The most common problem seen in dermatology offices worldwide is seborrheic keratosis (SK), a totally benign epidermal excrescence that appears to be related to aging and heredity. Most patients are in their 50s when they first notice an SK, and with a bit of luck, they will only see a few in their lifetime. But some patients develop hundreds of SKs, many of which become quite large (3-5 cm) and unsightly. In certain circumstances, SKs can herald the arrival of an occult carcinoma (the Leser-Trelat sign).

This patient has what some consider a variant of SK, called stucco keratosis. These lesions manifest almost exclusively on the lower legs and feet—perhaps due to the relative lack of sebaceous glands in those areas—and most often on men older than 60. Distressing as they are, stucco keratoses have no pathologic implications.

Grossly and histologically, stucco keratoses are different from ordinary SKs. Each stucco keratosis lesion is essentially identical to the others, with a spiculated surface, white color, and average diameter of 2 to 3 mm. Histologically, they demonstrate a thickened epidermis with focal exophytic upward projections that resemble church spires. The lesions do not extend into the dermis.

Treatment of stucco keratoses is, at best, tedious, painful, and futile. The modalities used are cryotherapy or electrodessication with curettage. For a degree of comfort, use of a loofah after bathing will remove or smooth down a few lesions, but this process must be followed by application of a heavy emollient. Alas, regrowth is a certainty.

TAKE-HOME LEARNING POINTS

  • Stucco keratosis is considered a variant of seborrheic keratosis, although they differ in several significant ways.
  • The lesions of stucco keratosis are fairly uniform in appearance: white, rough, spiculated, epidermal papules measuring 2 to 3 mm.
  • Stucco keratoses affect about 10% of the population (men more often than women) and have no racial predilection or pathologic implications.
  • The lesions are found almost exclusively on the legs, from the knees down to and including the dorsa of the feet.
  • Treatment is far from satisfactory, for multiple reasons, including resultant pain and scarring.
Publications
Topics
Sections

Three years ago, lesions began appearing on this now 68-year-old woman’s legs. They have grown in size and number, and their roughness disturbs the patient. She has been told the lesions are related to aging, but she has never seen anything like them on her friends or family—and she is worried about what they might mean for her health.

Her primary care provider diagnosed warts and performed cryotherapy on several of the lesions. However, the pain was intolerable and the treatment ineffective. To add insult to injury, each treated spot blistered and took more than a month to heal, leaving behind a pinkish brown blemish.

In all other respects, the patient’s health is excellent.

EXAMINATION
Both legs, from the upper thighs to the tops of the feet, are covered with thousands of uniformly distributed, tiny, keratotic, rough, dry papules. All the lesions are essentially identical: white, with no associated signs of inflammation. The patient’s skin is quite dry in general. Neither her palms nor soles are affected.

Rough lesions on leg

What’s the diagnosis?

 

 

DISCUSSION
The most common problem seen in dermatology offices worldwide is seborrheic keratosis (SK), a totally benign epidermal excrescence that appears to be related to aging and heredity. Most patients are in their 50s when they first notice an SK, and with a bit of luck, they will only see a few in their lifetime. But some patients develop hundreds of SKs, many of which become quite large (3-5 cm) and unsightly. In certain circumstances, SKs can herald the arrival of an occult carcinoma (the Leser-Trelat sign).

This patient has what some consider a variant of SK, called stucco keratosis. These lesions manifest almost exclusively on the lower legs and feet—perhaps due to the relative lack of sebaceous glands in those areas—and most often on men older than 60. Distressing as they are, stucco keratoses have no pathologic implications.

Grossly and histologically, stucco keratoses are different from ordinary SKs. Each stucco keratosis lesion is essentially identical to the others, with a spiculated surface, white color, and average diameter of 2 to 3 mm. Histologically, they demonstrate a thickened epidermis with focal exophytic upward projections that resemble church spires. The lesions do not extend into the dermis.

Treatment of stucco keratoses is, at best, tedious, painful, and futile. The modalities used are cryotherapy or electrodessication with curettage. For a degree of comfort, use of a loofah after bathing will remove or smooth down a few lesions, but this process must be followed by application of a heavy emollient. Alas, regrowth is a certainty.

TAKE-HOME LEARNING POINTS

  • Stucco keratosis is considered a variant of seborrheic keratosis, although they differ in several significant ways.
  • The lesions of stucco keratosis are fairly uniform in appearance: white, rough, spiculated, epidermal papules measuring 2 to 3 mm.
  • Stucco keratoses affect about 10% of the population (men more often than women) and have no racial predilection or pathologic implications.
  • The lesions are found almost exclusively on the legs, from the knees down to and including the dorsa of the feet.
  • Treatment is far from satisfactory, for multiple reasons, including resultant pain and scarring.

Three years ago, lesions began appearing on this now 68-year-old woman’s legs. They have grown in size and number, and their roughness disturbs the patient. She has been told the lesions are related to aging, but she has never seen anything like them on her friends or family—and she is worried about what they might mean for her health.

Her primary care provider diagnosed warts and performed cryotherapy on several of the lesions. However, the pain was intolerable and the treatment ineffective. To add insult to injury, each treated spot blistered and took more than a month to heal, leaving behind a pinkish brown blemish.

In all other respects, the patient’s health is excellent.

EXAMINATION
Both legs, from the upper thighs to the tops of the feet, are covered with thousands of uniformly distributed, tiny, keratotic, rough, dry papules. All the lesions are essentially identical: white, with no associated signs of inflammation. The patient’s skin is quite dry in general. Neither her palms nor soles are affected.

Rough lesions on leg

What’s the diagnosis?

 

 

DISCUSSION
The most common problem seen in dermatology offices worldwide is seborrheic keratosis (SK), a totally benign epidermal excrescence that appears to be related to aging and heredity. Most patients are in their 50s when they first notice an SK, and with a bit of luck, they will only see a few in their lifetime. But some patients develop hundreds of SKs, many of which become quite large (3-5 cm) and unsightly. In certain circumstances, SKs can herald the arrival of an occult carcinoma (the Leser-Trelat sign).

This patient has what some consider a variant of SK, called stucco keratosis. These lesions manifest almost exclusively on the lower legs and feet—perhaps due to the relative lack of sebaceous glands in those areas—and most often on men older than 60. Distressing as they are, stucco keratoses have no pathologic implications.

Grossly and histologically, stucco keratoses are different from ordinary SKs. Each stucco keratosis lesion is essentially identical to the others, with a spiculated surface, white color, and average diameter of 2 to 3 mm. Histologically, they demonstrate a thickened epidermis with focal exophytic upward projections that resemble church spires. The lesions do not extend into the dermis.

Treatment of stucco keratoses is, at best, tedious, painful, and futile. The modalities used are cryotherapy or electrodessication with curettage. For a degree of comfort, use of a loofah after bathing will remove or smooth down a few lesions, but this process must be followed by application of a heavy emollient. Alas, regrowth is a certainty.

TAKE-HOME LEARNING POINTS

  • Stucco keratosis is considered a variant of seborrheic keratosis, although they differ in several significant ways.
  • The lesions of stucco keratosis are fairly uniform in appearance: white, rough, spiculated, epidermal papules measuring 2 to 3 mm.
  • Stucco keratoses affect about 10% of the population (men more often than women) and have no racial predilection or pathologic implications.
  • The lesions are found almost exclusively on the legs, from the knees down to and including the dorsa of the feet.
  • Treatment is far from satisfactory, for multiple reasons, including resultant pain and scarring.
Publications
Publications
Topics
Article Type
Display Headline
Getting a Leg up on the Diagnosis
Display Headline
Getting a Leg up on the Diagnosis
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Gate On Date
Un-Gate On Date
Use ProPublica
CFC Schedule Remove Status
Hide sidebar & use full width
render the right sidebar.

Is it time for neurologists to manage high blood pressure?

Article Type
Changed

 

In the Nov. 1, 2019, issue of JAMA Neurology, an editorial argues that it’s time for neurologists to start managing high blood pressure.

GlobalStock/Getty Images

It makes some very valid points: that targeting a systolic blood pressure of less than 120 mm Hg results in lower rates of cardiovascular events and all causes of mortality, that poorly controlled hypertension leads to debilitating neurologic conditions, and that high blood pressure is the most common modifiable risk factor for stroke.

All are strong points. I agree with them and definitely believe that more can and should be done to control hypertension.

The editorial then goes on to say that “first and foremost we are charging neurologists with actively diagnosing hypertension and prescribing medications when appropriate.”

Uh, no. I’m not going to be the one managing hypertension, nor should any outpatient neurologist.

Outpatient hypertension treatment has historically been, and should remain, the province of general practitioners, cardiologists, and nephrologists. Too many cooks, as they say, spoils the broth. I don’t want to be in a situation where two (or more) doctors are simultaneously trying to treat the same condition. On that path lies danger.

This doesn’t mean I ignore blood pressure. On the contrary, I take it (myself) at every patient visit, and put it in my note. In most cases I do nothing further, as nothing further needs to be done. On occasion, though, if it’s concerningly high, I’ll write it down for the patient and direct them to call the physician handling it. I also fax a note about it to that office, and if it’s dangerously high will call the doctor myself.

But try to manage it? No. Elevated readings definitely overlap with my world, but treating them shouldn’t.

The article says that, for some chronic patients, neurologists are their de facto internist. Perhaps for a few, but when a patient calls with concerns about a respiratory ailment, gastrointestinal problem, or other nonneurologic issue, I tell them to call their general practitioner. If they don’t have one I’m happy to give them the names and phone numbers of colleagues who practice that field, or even urgent care and emergency department information if needed. Just because I see them for their neurologic problems doesn’t qualify me to practice another branch of medicine.

Dr. Allan M. Block

Beyond the dangers of having more than one doctor involved, as a specialist it’s not practical for me to know the antihypertensive medications – possibly the largest group of agents on the market, – in detail, with their mechanisms of action, side effects, and contraindications. Yes, I do keep a handful in mind, since they’re needed off label for migraines and tremors, but not in the kind of detail a cardiologist would. I have to keep track of enough medications in my specialty as it is.

I wouldn’t try to handle blood pressure any more than I’d expect a nephrologist to treat epilepsy. It’s just looking for trouble.

Even when covering the hospital, I’ll stay out of that arena. This doesn’t mean I ignore blood pressure in such serious conditions as stroke or posterior reversible encephalopathy syndrome. I’m more than happy to provide guidelines and parameters. But as far as choosing the medications and doses? No.

Like driving, we all have to share the road. We may even be focused on the same journey (or patient). But part of practicing medicine and handling traffic is knowing when to stay in your lane.

Dr. Block has a solo neurology practice in Scottsdale, Ariz.

Publications
Topics
Sections

 

In the Nov. 1, 2019, issue of JAMA Neurology, an editorial argues that it’s time for neurologists to start managing high blood pressure.

GlobalStock/Getty Images

It makes some very valid points: that targeting a systolic blood pressure of less than 120 mm Hg results in lower rates of cardiovascular events and all causes of mortality, that poorly controlled hypertension leads to debilitating neurologic conditions, and that high blood pressure is the most common modifiable risk factor for stroke.

All are strong points. I agree with them and definitely believe that more can and should be done to control hypertension.

The editorial then goes on to say that “first and foremost we are charging neurologists with actively diagnosing hypertension and prescribing medications when appropriate.”

Uh, no. I’m not going to be the one managing hypertension, nor should any outpatient neurologist.

Outpatient hypertension treatment has historically been, and should remain, the province of general practitioners, cardiologists, and nephrologists. Too many cooks, as they say, spoils the broth. I don’t want to be in a situation where two (or more) doctors are simultaneously trying to treat the same condition. On that path lies danger.

This doesn’t mean I ignore blood pressure. On the contrary, I take it (myself) at every patient visit, and put it in my note. In most cases I do nothing further, as nothing further needs to be done. On occasion, though, if it’s concerningly high, I’ll write it down for the patient and direct them to call the physician handling it. I also fax a note about it to that office, and if it’s dangerously high will call the doctor myself.

But try to manage it? No. Elevated readings definitely overlap with my world, but treating them shouldn’t.

The article says that, for some chronic patients, neurologists are their de facto internist. Perhaps for a few, but when a patient calls with concerns about a respiratory ailment, gastrointestinal problem, or other nonneurologic issue, I tell them to call their general practitioner. If they don’t have one I’m happy to give them the names and phone numbers of colleagues who practice that field, or even urgent care and emergency department information if needed. Just because I see them for their neurologic problems doesn’t qualify me to practice another branch of medicine.

Dr. Allan M. Block

Beyond the dangers of having more than one doctor involved, as a specialist it’s not practical for me to know the antihypertensive medications – possibly the largest group of agents on the market, – in detail, with their mechanisms of action, side effects, and contraindications. Yes, I do keep a handful in mind, since they’re needed off label for migraines and tremors, but not in the kind of detail a cardiologist would. I have to keep track of enough medications in my specialty as it is.

I wouldn’t try to handle blood pressure any more than I’d expect a nephrologist to treat epilepsy. It’s just looking for trouble.

Even when covering the hospital, I’ll stay out of that arena. This doesn’t mean I ignore blood pressure in such serious conditions as stroke or posterior reversible encephalopathy syndrome. I’m more than happy to provide guidelines and parameters. But as far as choosing the medications and doses? No.

Like driving, we all have to share the road. We may even be focused on the same journey (or patient). But part of practicing medicine and handling traffic is knowing when to stay in your lane.

Dr. Block has a solo neurology practice in Scottsdale, Ariz.

 

In the Nov. 1, 2019, issue of JAMA Neurology, an editorial argues that it’s time for neurologists to start managing high blood pressure.

GlobalStock/Getty Images

It makes some very valid points: that targeting a systolic blood pressure of less than 120 mm Hg results in lower rates of cardiovascular events and all causes of mortality, that poorly controlled hypertension leads to debilitating neurologic conditions, and that high blood pressure is the most common modifiable risk factor for stroke.

All are strong points. I agree with them and definitely believe that more can and should be done to control hypertension.

The editorial then goes on to say that “first and foremost we are charging neurologists with actively diagnosing hypertension and prescribing medications when appropriate.”

Uh, no. I’m not going to be the one managing hypertension, nor should any outpatient neurologist.

Outpatient hypertension treatment has historically been, and should remain, the province of general practitioners, cardiologists, and nephrologists. Too many cooks, as they say, spoils the broth. I don’t want to be in a situation where two (or more) doctors are simultaneously trying to treat the same condition. On that path lies danger.

This doesn’t mean I ignore blood pressure. On the contrary, I take it (myself) at every patient visit, and put it in my note. In most cases I do nothing further, as nothing further needs to be done. On occasion, though, if it’s concerningly high, I’ll write it down for the patient and direct them to call the physician handling it. I also fax a note about it to that office, and if it’s dangerously high will call the doctor myself.

But try to manage it? No. Elevated readings definitely overlap with my world, but treating them shouldn’t.

The article says that, for some chronic patients, neurologists are their de facto internist. Perhaps for a few, but when a patient calls with concerns about a respiratory ailment, gastrointestinal problem, or other nonneurologic issue, I tell them to call their general practitioner. If they don’t have one I’m happy to give them the names and phone numbers of colleagues who practice that field, or even urgent care and emergency department information if needed. Just because I see them for their neurologic problems doesn’t qualify me to practice another branch of medicine.

Dr. Allan M. Block

Beyond the dangers of having more than one doctor involved, as a specialist it’s not practical for me to know the antihypertensive medications – possibly the largest group of agents on the market, – in detail, with their mechanisms of action, side effects, and contraindications. Yes, I do keep a handful in mind, since they’re needed off label for migraines and tremors, but not in the kind of detail a cardiologist would. I have to keep track of enough medications in my specialty as it is.

I wouldn’t try to handle blood pressure any more than I’d expect a nephrologist to treat epilepsy. It’s just looking for trouble.

Even when covering the hospital, I’ll stay out of that arena. This doesn’t mean I ignore blood pressure in such serious conditions as stroke or posterior reversible encephalopathy syndrome. I’m more than happy to provide guidelines and parameters. But as far as choosing the medications and doses? No.

Like driving, we all have to share the road. We may even be focused on the same journey (or patient). But part of practicing medicine and handling traffic is knowing when to stay in your lane.

Dr. Block has a solo neurology practice in Scottsdale, Ariz.

Publications
Publications
Topics
Article Type
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.

Single-fraction radiation just misses mark for spinal compression relief

Article Type
Changed

 

Single-fraction radiation could not be shown to be noninferior to multi-fraction radiation at improving walking function in patients with spinal compression from metastatic cancer, but the small differences seen in a noninferiority trial may not matter to patients, investigators suggest.

Among 686 patients with spinal compression from metastatic cancer randomly assigned in a clinical trial to receive either 8 Gy of radiation in a single fraction or 20 Gy delivered in 5 fractions over 5 consecutive days, 69.3% of patients in the single-fraction arm had good ambulatory status at 8 weeks, compared with 72.7% of patients in the multi-fraction arm (P for noninferiority = .06), reported Peter J Hoskin, BSc, MBBS, MD, of Mount Vernon Cancer Centre in Northwood, England, and colleagues.

The trial did not meet the endpoint of noninferiority of single-fraction radiation for improving ambulation at 8 weeks because the lower limit of the 95% confidence interval (CI) was –11.5%, overlapping the noninferiority margin of –11%.

“However, for all other time points, the CI limits were within the noninferiority margin, and the observed risk differences between single-fraction and multi-fraction radiotherapy groups in ambulatory status were small and unlikely to be of clinical importance,” the investigators wrote in JAMA.

The authors note that although radiotherapy is widely used as a palliative measure for patients with spinal canal compression caused my metastatic disease, there is no agreement on the optimum schedule, with some guidelines recommending higher doses in multiple fractions, and others recommending a single 8 Gy does for patients with painful spinal sites.

To see whether single-fraction radiation could be noninferior to multi-fraction, the investigators enrolled patients in 42 sites in the United Kingdom and 5 in Australia into the SCORAD trial, and randomly assigned them to either single-fraction (345 patients) or multi-fraction (341 patients) radiation. The median age of those enrolled was 70 years, and 44% had prostate cancer, 19% had lung cancer, and 12% had breast cancer.

As noted, the primary endpoint of noninferiority of single-fraction radiation at improving ambulatory status at week 8 was not met. Ambulatory status was based on a 4-point scale and was classified as either grade 1: ambulatory without the use of aids and grade 5 of 5 of muscle power, or grade 2: ambulatory with aids or grade 4 of 5 of muscle power.

An analysis of secondary endpoints showed that the difference in ambulatory status grade 1 or 2 in the single- vs. multi-fraction group at week 1 was −0.4% (P value for noninferiority = .004), at week 4 it was −0.7% (P value for noninferiority = .01), and at week 12 it was 4.1% (P value for noninferiority = .002).

Overall survival rates at 12 weeks were 50% in the single-fraction group vs. 55% in the multi-fraction group; this difference was not statistically significant.

Of 11 other secondary endpoints analyzed, including ambulatory and safety endpoints, the between-group differences were not statistically significant or did not meet noninferiority criteria, the authors noted.

They concluded that although the trial did not meet the primary endpoint, ”the extent to which the lower bound of the CI overlapped with the noninferiority margin should be taken into account when interpreting the clinical importance of these findings.”

Cancer Research UK and Cancer Council Queensland funded the trial. Dr. Hoskin reported being supported by the National Institute for Health Research Manchester Biomedical Research Centre.

SOURCE: Hoskin PJ et al. JAMA 2019 Dec 3. doi: 10.1001/jama.2019.17913.

Publications
Topics
Sections

 

Single-fraction radiation could not be shown to be noninferior to multi-fraction radiation at improving walking function in patients with spinal compression from metastatic cancer, but the small differences seen in a noninferiority trial may not matter to patients, investigators suggest.

Among 686 patients with spinal compression from metastatic cancer randomly assigned in a clinical trial to receive either 8 Gy of radiation in a single fraction or 20 Gy delivered in 5 fractions over 5 consecutive days, 69.3% of patients in the single-fraction arm had good ambulatory status at 8 weeks, compared with 72.7% of patients in the multi-fraction arm (P for noninferiority = .06), reported Peter J Hoskin, BSc, MBBS, MD, of Mount Vernon Cancer Centre in Northwood, England, and colleagues.

The trial did not meet the endpoint of noninferiority of single-fraction radiation for improving ambulation at 8 weeks because the lower limit of the 95% confidence interval (CI) was –11.5%, overlapping the noninferiority margin of –11%.

“However, for all other time points, the CI limits were within the noninferiority margin, and the observed risk differences between single-fraction and multi-fraction radiotherapy groups in ambulatory status were small and unlikely to be of clinical importance,” the investigators wrote in JAMA.

The authors note that although radiotherapy is widely used as a palliative measure for patients with spinal canal compression caused my metastatic disease, there is no agreement on the optimum schedule, with some guidelines recommending higher doses in multiple fractions, and others recommending a single 8 Gy does for patients with painful spinal sites.

To see whether single-fraction radiation could be noninferior to multi-fraction, the investigators enrolled patients in 42 sites in the United Kingdom and 5 in Australia into the SCORAD trial, and randomly assigned them to either single-fraction (345 patients) or multi-fraction (341 patients) radiation. The median age of those enrolled was 70 years, and 44% had prostate cancer, 19% had lung cancer, and 12% had breast cancer.

As noted, the primary endpoint of noninferiority of single-fraction radiation at improving ambulatory status at week 8 was not met. Ambulatory status was based on a 4-point scale and was classified as either grade 1: ambulatory without the use of aids and grade 5 of 5 of muscle power, or grade 2: ambulatory with aids or grade 4 of 5 of muscle power.

An analysis of secondary endpoints showed that the difference in ambulatory status grade 1 or 2 in the single- vs. multi-fraction group at week 1 was −0.4% (P value for noninferiority = .004), at week 4 it was −0.7% (P value for noninferiority = .01), and at week 12 it was 4.1% (P value for noninferiority = .002).

Overall survival rates at 12 weeks were 50% in the single-fraction group vs. 55% in the multi-fraction group; this difference was not statistically significant.

Of 11 other secondary endpoints analyzed, including ambulatory and safety endpoints, the between-group differences were not statistically significant or did not meet noninferiority criteria, the authors noted.

They concluded that although the trial did not meet the primary endpoint, ”the extent to which the lower bound of the CI overlapped with the noninferiority margin should be taken into account when interpreting the clinical importance of these findings.”

Cancer Research UK and Cancer Council Queensland funded the trial. Dr. Hoskin reported being supported by the National Institute for Health Research Manchester Biomedical Research Centre.

SOURCE: Hoskin PJ et al. JAMA 2019 Dec 3. doi: 10.1001/jama.2019.17913.

 

Single-fraction radiation could not be shown to be noninferior to multi-fraction radiation at improving walking function in patients with spinal compression from metastatic cancer, but the small differences seen in a noninferiority trial may not matter to patients, investigators suggest.

Among 686 patients with spinal compression from metastatic cancer randomly assigned in a clinical trial to receive either 8 Gy of radiation in a single fraction or 20 Gy delivered in 5 fractions over 5 consecutive days, 69.3% of patients in the single-fraction arm had good ambulatory status at 8 weeks, compared with 72.7% of patients in the multi-fraction arm (P for noninferiority = .06), reported Peter J Hoskin, BSc, MBBS, MD, of Mount Vernon Cancer Centre in Northwood, England, and colleagues.

The trial did not meet the endpoint of noninferiority of single-fraction radiation for improving ambulation at 8 weeks because the lower limit of the 95% confidence interval (CI) was –11.5%, overlapping the noninferiority margin of –11%.

“However, for all other time points, the CI limits were within the noninferiority margin, and the observed risk differences between single-fraction and multi-fraction radiotherapy groups in ambulatory status were small and unlikely to be of clinical importance,” the investigators wrote in JAMA.

The authors note that although radiotherapy is widely used as a palliative measure for patients with spinal canal compression caused my metastatic disease, there is no agreement on the optimum schedule, with some guidelines recommending higher doses in multiple fractions, and others recommending a single 8 Gy does for patients with painful spinal sites.

To see whether single-fraction radiation could be noninferior to multi-fraction, the investigators enrolled patients in 42 sites in the United Kingdom and 5 in Australia into the SCORAD trial, and randomly assigned them to either single-fraction (345 patients) or multi-fraction (341 patients) radiation. The median age of those enrolled was 70 years, and 44% had prostate cancer, 19% had lung cancer, and 12% had breast cancer.

As noted, the primary endpoint of noninferiority of single-fraction radiation at improving ambulatory status at week 8 was not met. Ambulatory status was based on a 4-point scale and was classified as either grade 1: ambulatory without the use of aids and grade 5 of 5 of muscle power, or grade 2: ambulatory with aids or grade 4 of 5 of muscle power.

An analysis of secondary endpoints showed that the difference in ambulatory status grade 1 or 2 in the single- vs. multi-fraction group at week 1 was −0.4% (P value for noninferiority = .004), at week 4 it was −0.7% (P value for noninferiority = .01), and at week 12 it was 4.1% (P value for noninferiority = .002).

Overall survival rates at 12 weeks were 50% in the single-fraction group vs. 55% in the multi-fraction group; this difference was not statistically significant.

Of 11 other secondary endpoints analyzed, including ambulatory and safety endpoints, the between-group differences were not statistically significant or did not meet noninferiority criteria, the authors noted.

They concluded that although the trial did not meet the primary endpoint, ”the extent to which the lower bound of the CI overlapped with the noninferiority margin should be taken into account when interpreting the clinical importance of these findings.”

Cancer Research UK and Cancer Council Queensland funded the trial. Dr. Hoskin reported being supported by the National Institute for Health Research Manchester Biomedical Research Centre.

SOURCE: Hoskin PJ et al. JAMA 2019 Dec 3. doi: 10.1001/jama.2019.17913.

Publications
Publications
Topics
Article Type
Sections
Article Source

FROM JAMA

Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.

Better Planning Needed to Help Veterans During, After Service

Article Type
Changed

NATIONAL HARBOR, MD – More work and planning is needed for veterans after they serve in the Armed Forces, Rep. Brad Wenstrup, MD (R-Ohio), told attendees of the 2019 AMSUS annual meeting.

Rep. Wenstrup, in his December 3 keynote address, suggested that in addition to recruiters asking about what enlistees want to do in the military, they also should be asking what they want to do after military service.

“Let’s plan for that right now because it’s so much better, it’s so much healthier when you have a plan,” he said, noting that many military members struggle when integrating back into civilian life: They don’t have a plan, and they don’t feel “essential” and part of a team the way they did while serving. He pointed to graduating college students who have made plans for their next steps.

“We need to do the same thing for our troops who serve us [and] prepare them for what is next,” he said.

In addition to ensuring the health and well-being of service members when they come home, Rep. Wenstrup also discussed the need to ensure that medical staff are prepared for emergencies, identifying it as one of the challenges of military medicine right now.

“It’s a challenge for a lot in the active component when we are not at war … to sustain those skills, and it is very frustrating to the providers all the way around,” Rep. Wenstrup said. He noted that a lot of military medical staff help keep and refine those skills by working in the trauma department of major city hospitals.

“We are working together to try and bring our military assets, our civilian assets, DEA, whatever we can, together so that we make sure that we can provide and be ready,” he said. “And the importance of building these bridges is key to the future of medicine,” especially in a time of domestic crisis, so that all medical personnel, civilian and military, can work together for the common good of providing that service. “These are bridges we have to build.”

Rep. Wenstrup also talked about the need to do more to ensure a healthier population.

“The key is how do we live healthier, longer, because that is the real savings. A healthy nation is a stronger nation,” he said.

When comparing the amounts paid to providers for surgery with those paid for health and wellness, he contended that high payments for surgeons are due to the high skill set required for difficult procedures. However, health and wellness providers are paid poorly, as is payment for the management of chronic illness. “We don’t pay very well to the doctor who works with the patient and prevents the need to do open heart surgery,” he said. “Let’s start looking at that. Let’s start keeping people healthier longer.”

gtwachtman@mdedge.com

Publications
Sections

NATIONAL HARBOR, MD – More work and planning is needed for veterans after they serve in the Armed Forces, Rep. Brad Wenstrup, MD (R-Ohio), told attendees of the 2019 AMSUS annual meeting.

Rep. Wenstrup, in his December 3 keynote address, suggested that in addition to recruiters asking about what enlistees want to do in the military, they also should be asking what they want to do after military service.

“Let’s plan for that right now because it’s so much better, it’s so much healthier when you have a plan,” he said, noting that many military members struggle when integrating back into civilian life: They don’t have a plan, and they don’t feel “essential” and part of a team the way they did while serving. He pointed to graduating college students who have made plans for their next steps.

“We need to do the same thing for our troops who serve us [and] prepare them for what is next,” he said.

In addition to ensuring the health and well-being of service members when they come home, Rep. Wenstrup also discussed the need to ensure that medical staff are prepared for emergencies, identifying it as one of the challenges of military medicine right now.

“It’s a challenge for a lot in the active component when we are not at war … to sustain those skills, and it is very frustrating to the providers all the way around,” Rep. Wenstrup said. He noted that a lot of military medical staff help keep and refine those skills by working in the trauma department of major city hospitals.

“We are working together to try and bring our military assets, our civilian assets, DEA, whatever we can, together so that we make sure that we can provide and be ready,” he said. “And the importance of building these bridges is key to the future of medicine,” especially in a time of domestic crisis, so that all medical personnel, civilian and military, can work together for the common good of providing that service. “These are bridges we have to build.”

Rep. Wenstrup also talked about the need to do more to ensure a healthier population.

“The key is how do we live healthier, longer, because that is the real savings. A healthy nation is a stronger nation,” he said.

When comparing the amounts paid to providers for surgery with those paid for health and wellness, he contended that high payments for surgeons are due to the high skill set required for difficult procedures. However, health and wellness providers are paid poorly, as is payment for the management of chronic illness. “We don’t pay very well to the doctor who works with the patient and prevents the need to do open heart surgery,” he said. “Let’s start looking at that. Let’s start keeping people healthier longer.”

gtwachtman@mdedge.com

NATIONAL HARBOR, MD – More work and planning is needed for veterans after they serve in the Armed Forces, Rep. Brad Wenstrup, MD (R-Ohio), told attendees of the 2019 AMSUS annual meeting.

Rep. Wenstrup, in his December 3 keynote address, suggested that in addition to recruiters asking about what enlistees want to do in the military, they also should be asking what they want to do after military service.

“Let’s plan for that right now because it’s so much better, it’s so much healthier when you have a plan,” he said, noting that many military members struggle when integrating back into civilian life: They don’t have a plan, and they don’t feel “essential” and part of a team the way they did while serving. He pointed to graduating college students who have made plans for their next steps.

“We need to do the same thing for our troops who serve us [and] prepare them for what is next,” he said.

In addition to ensuring the health and well-being of service members when they come home, Rep. Wenstrup also discussed the need to ensure that medical staff are prepared for emergencies, identifying it as one of the challenges of military medicine right now.

“It’s a challenge for a lot in the active component when we are not at war … to sustain those skills, and it is very frustrating to the providers all the way around,” Rep. Wenstrup said. He noted that a lot of military medical staff help keep and refine those skills by working in the trauma department of major city hospitals.

“We are working together to try and bring our military assets, our civilian assets, DEA, whatever we can, together so that we make sure that we can provide and be ready,” he said. “And the importance of building these bridges is key to the future of medicine,” especially in a time of domestic crisis, so that all medical personnel, civilian and military, can work together for the common good of providing that service. “These are bridges we have to build.”

Rep. Wenstrup also talked about the need to do more to ensure a healthier population.

“The key is how do we live healthier, longer, because that is the real savings. A healthy nation is a stronger nation,” he said.

When comparing the amounts paid to providers for surgery with those paid for health and wellness, he contended that high payments for surgeons are due to the high skill set required for difficult procedures. However, health and wellness providers are paid poorly, as is payment for the management of chronic illness. “We don’t pay very well to the doctor who works with the patient and prevents the need to do open heart surgery,” he said. “Let’s start looking at that. Let’s start keeping people healthier longer.”

gtwachtman@mdedge.com

Publications
Publications
Article Type
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Gate On Date
Un-Gate On Date
Use ProPublica
CFC Schedule Remove Status
Hide sidebar & use full width
render the right sidebar.

Dual vs Triple Therapy Following ACS or PCI in Patients with Atrial Fibrillation

Article Type
Changed
Display Headline
Dual vs Triple Therapy Following ACS or PCI in Patients with Atrial Fibrillation

Study Overview

Objective. To compare the benefit of apixaban with a vitamin K antagonist and compare aspirin with placebo in patients with atrial fibrillation who had acute coronary syndrome or underwent percutaneous coronary intervention (PCI) and were planning to take a P2Y12 inhibitor.

Design. Multicenter, international, open-label, prospective randomized controlled trial with a 2-by-2 factorial design.

Setting and participants. 4614 patients who had an acute coronary syndrome or had undergone PCI and were planning to take a P2Y12 inhibitor.

Intervention. Patients were assigned by means of an interactive voice-response system to receive apixaban or a vitamin K antagonist and to receive aspirin or matching placebo for 6 months.

Main outcome measures. The primary outcome was major or clinically relevant nonmajor bleeding. Secondary outcomes included death or hospitalization and a composite of ischemic events.

Main results. At 6 months, major or clinically relevant nonmajor bleeding had occurred in 10.5% of the patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (hazard ratio [HR], 0.69; 95% confidence interval [CI], 0.58-0.81, P < 0.001 for both noninferiority and superiority), and in 16.1% of the patients receiving aspirin, as compared with 9.0% of those receiving placebo (HR 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR 0.83; 95% CI, 0.74-0.93; P = 0.002) and similar incidence of ischemic events.

Conclusion. Among patients with atrial fibrillation and recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, an antithrombotic regimen that included apixaban without aspirin resulted in less bleeding and fewer hospitalizations without significant differences in the incidence of ischemic events than the regimens that included a vitamin K antagonist, aspirin, or both.

 

 

Commentary

PCI is performed in about 20% of patients with atrial fibrillation. These patients require dual antiplatelet therapy to prevent ischemic events, combined with long-term anticoagulation to prevent stroke due to atrial fibrillation. Because the combination of anticoagulation and antiplatelet therapy is associated with a higher risk of bleeding, balancing the risk and benefit of dual antiplatelet therapy and anticoagulation in this population is crucial.

Previous studies have assessed the risk and benefit associated with anticoagulation and antiplatelet therapy. When warfarin plus clopidogrel (double therapy) was compared with warfarin, aspirin, and clopidogrel (triple therapy) in patients with acute coronary syndromes and stable ischemic coronary disease undergoing PCI, use of clopidogrel without aspirin (double therapy) was associated with a significant reduction in bleeding complications (19.4% versus 44.4%, HR, 0.36; 95% CI, 0.26-0.20; P < 0.0001) without increasing thrombotic events.1 Recent studies have compared triple therapy with warfarin to double therapy using direct oral anticoagulants (DOAC). The PIONEER AF-PCI study, which compared low-dose rivaroxaban (15 mg once daily) plus a P2Y12 inhibitor to vitamin K antagonist plus dual antiplatelet therapy, found that the rates of clinically significant bleeding were lower in the low-dose rivaroxaban group compared to the triple-therapy group with a vitamin K antagonist (16.8% versus 26.7%; HR, 0.59; 95% CI, 0.47-0.76; P < 0.001).2 Similarly, the RE-DUAL PCI studied dabigatran and showed that the dual therapy group with dabigatran had a lower incidence of major or clinically relevant nonmajor bleeding events during follow-up compared to triple therapy including a vitamin K antagonist (15.4% versus 26.9%; HR, 0.52; 95% CI, 0.42-0.63; P < 0.001).3

In this context, Lopes at al investigated the clinical question of dual therapy versus triple therapy by performing a well-designed randomized clinical trial. In this trial with a 2-by-2 factorial design, the authors studied the effect of apixaban compared to vitamin K antagonist and the effect of aspirin compared to placebo. Major or clinically relevant nonmajor bleeding occurred in 10.5% of patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (HR 0.69; 95% CI, 0.58-0.81; P < 0.001). The incidence of major or clinically relevant nonmajor bleeding was higher in patients receiving aspirin than in those receiving placebo (16.1% versus 9.0%; HR, 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR, 0.83; 95% CI, 0.74-0.93; P = 0.002). The incidence of ischemic events was similar between the apixaban group and vitamin K antagonist group and between the aspirin group and placebo group.

The strengths of this current study include the large number of patients it enrolled. Taking the results from the PIONEER-AF, RE-DUAL PCI, and AUGUSTUS trials, it is clear that DOAC reduces the risk of bleeding compared to vitamin K antagonist. In addition, the AUGUSTUS trial was the first that evaluated the effect of aspirin in patients treated with DOAC and antiplatelet therapy. Aspirin was associated with increased risk of bleeding, with a similar rate of ischemic events compared to placebo.

The AUGUSTUS trial has several limitations. Although the incidence of ischemic events was similar between the apixaban group and the vitamin K antagonist group, the study was not powered to evaluate for individual ischemic outcomes. However, there was no clear evidence of an increase in harm. Since more than 90% of P2Y12 inhibitors used were clopidogrel, the safety and efficacy of combining apixaban with ticagrelor or prasugrel will require further study.

 

 

Applications for Clinical Practice

In patients with atrial fibrillation and a recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, dual therapy with a P2Y12 inhibitor and DOAC should be favored over a regimen that includes a vitamin K antagonist and/or aspirin.

—Taishi Hirai, MD, University of Missouri Medical Center, and John Blair, MD, University of Chicago Medical Center

References

1. Dewilde WJM, Oirbans T, Verheugt FWA, et al. Use of clopidogrel with or without aspirin in patients taking oral anticoagulant therapy and undergoing percutaneous coronary intervention: an open-label, randomised, controlled trial. Lancet. 2013;381(9872):1107-1115.

2. Gibson CM, Mehran R, Bode C, et al. Prevention of bleeding in patients with atrial fibrillation undergoing PCI. N Engl J Med. 2016;375:2423-2434.

3. Cannon CP, Bhatt DL, Oldgren J, et al. Dual antithrombotic therapy with dabigatran after PCI in atrial fibrillation. N Engl J Med. 2017;377:1513-1524.

Issue
Journal of Clinical Outcomes Management - 26(6)
Publications
Topics
Page Number
1-2
Sections

Study Overview

Objective. To compare the benefit of apixaban with a vitamin K antagonist and compare aspirin with placebo in patients with atrial fibrillation who had acute coronary syndrome or underwent percutaneous coronary intervention (PCI) and were planning to take a P2Y12 inhibitor.

Design. Multicenter, international, open-label, prospective randomized controlled trial with a 2-by-2 factorial design.

Setting and participants. 4614 patients who had an acute coronary syndrome or had undergone PCI and were planning to take a P2Y12 inhibitor.

Intervention. Patients were assigned by means of an interactive voice-response system to receive apixaban or a vitamin K antagonist and to receive aspirin or matching placebo for 6 months.

Main outcome measures. The primary outcome was major or clinically relevant nonmajor bleeding. Secondary outcomes included death or hospitalization and a composite of ischemic events.

Main results. At 6 months, major or clinically relevant nonmajor bleeding had occurred in 10.5% of the patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (hazard ratio [HR], 0.69; 95% confidence interval [CI], 0.58-0.81, P < 0.001 for both noninferiority and superiority), and in 16.1% of the patients receiving aspirin, as compared with 9.0% of those receiving placebo (HR 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR 0.83; 95% CI, 0.74-0.93; P = 0.002) and similar incidence of ischemic events.

Conclusion. Among patients with atrial fibrillation and recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, an antithrombotic regimen that included apixaban without aspirin resulted in less bleeding and fewer hospitalizations without significant differences in the incidence of ischemic events than the regimens that included a vitamin K antagonist, aspirin, or both.

 

 

Commentary

PCI is performed in about 20% of patients with atrial fibrillation. These patients require dual antiplatelet therapy to prevent ischemic events, combined with long-term anticoagulation to prevent stroke due to atrial fibrillation. Because the combination of anticoagulation and antiplatelet therapy is associated with a higher risk of bleeding, balancing the risk and benefit of dual antiplatelet therapy and anticoagulation in this population is crucial.

Previous studies have assessed the risk and benefit associated with anticoagulation and antiplatelet therapy. When warfarin plus clopidogrel (double therapy) was compared with warfarin, aspirin, and clopidogrel (triple therapy) in patients with acute coronary syndromes and stable ischemic coronary disease undergoing PCI, use of clopidogrel without aspirin (double therapy) was associated with a significant reduction in bleeding complications (19.4% versus 44.4%, HR, 0.36; 95% CI, 0.26-0.20; P < 0.0001) without increasing thrombotic events.1 Recent studies have compared triple therapy with warfarin to double therapy using direct oral anticoagulants (DOAC). The PIONEER AF-PCI study, which compared low-dose rivaroxaban (15 mg once daily) plus a P2Y12 inhibitor to vitamin K antagonist plus dual antiplatelet therapy, found that the rates of clinically significant bleeding were lower in the low-dose rivaroxaban group compared to the triple-therapy group with a vitamin K antagonist (16.8% versus 26.7%; HR, 0.59; 95% CI, 0.47-0.76; P < 0.001).2 Similarly, the RE-DUAL PCI studied dabigatran and showed that the dual therapy group with dabigatran had a lower incidence of major or clinically relevant nonmajor bleeding events during follow-up compared to triple therapy including a vitamin K antagonist (15.4% versus 26.9%; HR, 0.52; 95% CI, 0.42-0.63; P < 0.001).3

In this context, Lopes at al investigated the clinical question of dual therapy versus triple therapy by performing a well-designed randomized clinical trial. In this trial with a 2-by-2 factorial design, the authors studied the effect of apixaban compared to vitamin K antagonist and the effect of aspirin compared to placebo. Major or clinically relevant nonmajor bleeding occurred in 10.5% of patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (HR 0.69; 95% CI, 0.58-0.81; P < 0.001). The incidence of major or clinically relevant nonmajor bleeding was higher in patients receiving aspirin than in those receiving placebo (16.1% versus 9.0%; HR, 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR, 0.83; 95% CI, 0.74-0.93; P = 0.002). The incidence of ischemic events was similar between the apixaban group and vitamin K antagonist group and between the aspirin group and placebo group.

The strengths of this current study include the large number of patients it enrolled. Taking the results from the PIONEER-AF, RE-DUAL PCI, and AUGUSTUS trials, it is clear that DOAC reduces the risk of bleeding compared to vitamin K antagonist. In addition, the AUGUSTUS trial was the first that evaluated the effect of aspirin in patients treated with DOAC and antiplatelet therapy. Aspirin was associated with increased risk of bleeding, with a similar rate of ischemic events compared to placebo.

The AUGUSTUS trial has several limitations. Although the incidence of ischemic events was similar between the apixaban group and the vitamin K antagonist group, the study was not powered to evaluate for individual ischemic outcomes. However, there was no clear evidence of an increase in harm. Since more than 90% of P2Y12 inhibitors used were clopidogrel, the safety and efficacy of combining apixaban with ticagrelor or prasugrel will require further study.

 

 

Applications for Clinical Practice

In patients with atrial fibrillation and a recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, dual therapy with a P2Y12 inhibitor and DOAC should be favored over a regimen that includes a vitamin K antagonist and/or aspirin.

—Taishi Hirai, MD, University of Missouri Medical Center, and John Blair, MD, University of Chicago Medical Center

Study Overview

Objective. To compare the benefit of apixaban with a vitamin K antagonist and compare aspirin with placebo in patients with atrial fibrillation who had acute coronary syndrome or underwent percutaneous coronary intervention (PCI) and were planning to take a P2Y12 inhibitor.

Design. Multicenter, international, open-label, prospective randomized controlled trial with a 2-by-2 factorial design.

Setting and participants. 4614 patients who had an acute coronary syndrome or had undergone PCI and were planning to take a P2Y12 inhibitor.

Intervention. Patients were assigned by means of an interactive voice-response system to receive apixaban or a vitamin K antagonist and to receive aspirin or matching placebo for 6 months.

Main outcome measures. The primary outcome was major or clinically relevant nonmajor bleeding. Secondary outcomes included death or hospitalization and a composite of ischemic events.

Main results. At 6 months, major or clinically relevant nonmajor bleeding had occurred in 10.5% of the patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (hazard ratio [HR], 0.69; 95% confidence interval [CI], 0.58-0.81, P < 0.001 for both noninferiority and superiority), and in 16.1% of the patients receiving aspirin, as compared with 9.0% of those receiving placebo (HR 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR 0.83; 95% CI, 0.74-0.93; P = 0.002) and similar incidence of ischemic events.

Conclusion. Among patients with atrial fibrillation and recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, an antithrombotic regimen that included apixaban without aspirin resulted in less bleeding and fewer hospitalizations without significant differences in the incidence of ischemic events than the regimens that included a vitamin K antagonist, aspirin, or both.

 

 

Commentary

PCI is performed in about 20% of patients with atrial fibrillation. These patients require dual antiplatelet therapy to prevent ischemic events, combined with long-term anticoagulation to prevent stroke due to atrial fibrillation. Because the combination of anticoagulation and antiplatelet therapy is associated with a higher risk of bleeding, balancing the risk and benefit of dual antiplatelet therapy and anticoagulation in this population is crucial.

Previous studies have assessed the risk and benefit associated with anticoagulation and antiplatelet therapy. When warfarin plus clopidogrel (double therapy) was compared with warfarin, aspirin, and clopidogrel (triple therapy) in patients with acute coronary syndromes and stable ischemic coronary disease undergoing PCI, use of clopidogrel without aspirin (double therapy) was associated with a significant reduction in bleeding complications (19.4% versus 44.4%, HR, 0.36; 95% CI, 0.26-0.20; P < 0.0001) without increasing thrombotic events.1 Recent studies have compared triple therapy with warfarin to double therapy using direct oral anticoagulants (DOAC). The PIONEER AF-PCI study, which compared low-dose rivaroxaban (15 mg once daily) plus a P2Y12 inhibitor to vitamin K antagonist plus dual antiplatelet therapy, found that the rates of clinically significant bleeding were lower in the low-dose rivaroxaban group compared to the triple-therapy group with a vitamin K antagonist (16.8% versus 26.7%; HR, 0.59; 95% CI, 0.47-0.76; P < 0.001).2 Similarly, the RE-DUAL PCI studied dabigatran and showed that the dual therapy group with dabigatran had a lower incidence of major or clinically relevant nonmajor bleeding events during follow-up compared to triple therapy including a vitamin K antagonist (15.4% versus 26.9%; HR, 0.52; 95% CI, 0.42-0.63; P < 0.001).3

In this context, Lopes at al investigated the clinical question of dual therapy versus triple therapy by performing a well-designed randomized clinical trial. In this trial with a 2-by-2 factorial design, the authors studied the effect of apixaban compared to vitamin K antagonist and the effect of aspirin compared to placebo. Major or clinically relevant nonmajor bleeding occurred in 10.5% of patients receiving apixaban, as compared to 14.7% of those receiving a vitamin K antagonist (HR 0.69; 95% CI, 0.58-0.81; P < 0.001). The incidence of major or clinically relevant nonmajor bleeding was higher in patients receiving aspirin than in those receiving placebo (16.1% versus 9.0%; HR, 1.89; 95% CI, 1.59-2.24; P < 0.001). Patients in the apixaban group had a lower incidence of death or hospitalization than those in the vitamin K antagonist group (23.5% versus 27.4%; HR, 0.83; 95% CI, 0.74-0.93; P = 0.002). The incidence of ischemic events was similar between the apixaban group and vitamin K antagonist group and between the aspirin group and placebo group.

The strengths of this current study include the large number of patients it enrolled. Taking the results from the PIONEER-AF, RE-DUAL PCI, and AUGUSTUS trials, it is clear that DOAC reduces the risk of bleeding compared to vitamin K antagonist. In addition, the AUGUSTUS trial was the first that evaluated the effect of aspirin in patients treated with DOAC and antiplatelet therapy. Aspirin was associated with increased risk of bleeding, with a similar rate of ischemic events compared to placebo.

The AUGUSTUS trial has several limitations. Although the incidence of ischemic events was similar between the apixaban group and the vitamin K antagonist group, the study was not powered to evaluate for individual ischemic outcomes. However, there was no clear evidence of an increase in harm. Since more than 90% of P2Y12 inhibitors used were clopidogrel, the safety and efficacy of combining apixaban with ticagrelor or prasugrel will require further study.

 

 

Applications for Clinical Practice

In patients with atrial fibrillation and a recent acute coronary syndrome or PCI treated with a P2Y12 inhibitor, dual therapy with a P2Y12 inhibitor and DOAC should be favored over a regimen that includes a vitamin K antagonist and/or aspirin.

—Taishi Hirai, MD, University of Missouri Medical Center, and John Blair, MD, University of Chicago Medical Center

References

1. Dewilde WJM, Oirbans T, Verheugt FWA, et al. Use of clopidogrel with or without aspirin in patients taking oral anticoagulant therapy and undergoing percutaneous coronary intervention: an open-label, randomised, controlled trial. Lancet. 2013;381(9872):1107-1115.

2. Gibson CM, Mehran R, Bode C, et al. Prevention of bleeding in patients with atrial fibrillation undergoing PCI. N Engl J Med. 2016;375:2423-2434.

3. Cannon CP, Bhatt DL, Oldgren J, et al. Dual antithrombotic therapy with dabigatran after PCI in atrial fibrillation. N Engl J Med. 2017;377:1513-1524.

References

1. Dewilde WJM, Oirbans T, Verheugt FWA, et al. Use of clopidogrel with or without aspirin in patients taking oral anticoagulant therapy and undergoing percutaneous coronary intervention: an open-label, randomised, controlled trial. Lancet. 2013;381(9872):1107-1115.

2. Gibson CM, Mehran R, Bode C, et al. Prevention of bleeding in patients with atrial fibrillation undergoing PCI. N Engl J Med. 2016;375:2423-2434.

3. Cannon CP, Bhatt DL, Oldgren J, et al. Dual antithrombotic therapy with dabigatran after PCI in atrial fibrillation. N Engl J Med. 2017;377:1513-1524.

Issue
Journal of Clinical Outcomes Management - 26(6)
Issue
Journal of Clinical Outcomes Management - 26(6)
Page Number
1-2
Page Number
1-2
Publications
Publications
Topics
Article Type
Display Headline
Dual vs Triple Therapy Following ACS or PCI in Patients with Atrial Fibrillation
Display Headline
Dual vs Triple Therapy Following ACS or PCI in Patients with Atrial Fibrillation
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.

Patient-Reported Outcomes in Multiple Sclerosis: An Overview

Article Type
Changed
Display Headline
Patient-Reported Outcomes in Multiple Sclerosis: An Overview

From the Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Hanover, NH (Ms. Manohar and Dr. Oliver), the Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH (Ms. Perkins, Ms. Laurion, and Dr. Oliver), and the Multiple Sclerosis Specialty Care Program, Concord Hospital, Concord, NH (Dr. Oliver).

Abstract

  • Background: Patient-reported outcomes (PROs), including patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs), can be used to assess perceived health status, functioning, quality of life, and experience of care. Complex chronic illnesses such as multiple sclerosis (MS) affect multiple aspects of health, and PROs can be applied in assessment and decision-making in MS care as well as in research pertaining to MS.
  • Objective: To provide a general review of PROs, with a specific focus on implications for MS care.
  • Methods: Evidence synthesis of available literature on PROs in MS care.
  • Results: PROs (including PROMs and PREMs) have historically been utilized in research and are now being applied in clinical, improvement, and population health settings using learning health system approaches in many disease populations, including MS. Many challenges complicate the use of PROs in MS care, including reliability, validity, and interpretability of PROMs, as well as feasibility barriers due to time and financial constraints in clinical settings.
  • Conclusion: PROs have the potential to better inform clinical care, empower patient-centered care, inform health care improvement efforts, and create the conditions for coproduction of health care services.

Keywords: PRO; PROM; patient-reported outcome measure; patient-reported experience measure; quality of life; patient-centered care.

Multiple sclerosis (MS) is a disabling, complex, chronic, immune-mediated disorder of the central nervous system (CNS). MS causes inflammatory and degenerative damage in the CNS, which disrupts signaling pathways.1 It is most commonly diagnosed in young adults and affects 2.3 million people worldwide.2 People with MS experience very different disease courses and a wide range of neurological symptoms, including visual, somatic, mental health, sensory, motor, and cognitive problems.1-3 Relapsing-remitting MS, the most common form, affects 85% of those with MS and is characterized by periods of relapse (exacerbation) and remission.1 Other forms of MS (primary progressive and secondary progressive MS) are characterized by progressive deterioration and worsening symptom severity without exacerbations. Disease-modifying therapies (DMTs) can reduce the frequency of exacerbations and disability progression, but unfortunately there is no cure for MS. Treatment is focused on increasing quality of life, minimizing disability, and maximizing wellness.

Patient-reported outcomes (PROs) describe the perceived health status, function, and/or experience of a person as obtained by direct self-report. Patient-reported outcome measures (PROMs) are validated PROs that can be used to inform clinical care,4 and have demonstrated effectiveness in improving patient-provider communication and decision-making.5-7 PROMs are currently used in some MS clinical trials to determine the impact of experimental interventions,8-10 and are also being used to inform and improve clinical care in some settings. Especially for persons with MS, they can provide individualized perspectives about health experience and outcomes.11 In more advanced applications, PROMs can be used to improve face-to-face collaborations between clinicians and patients and to inform patient-centered systems of care.12-14 PROMs can also be used to inform systems-level improvement for entire patient populations.15,16

In this article, we review current applications of PROs and PROMs in the care of persons with MS, as well as current limitations and barriers to their use.

CASE STUDY

Marion is a 26-year-old woman who first developed MS symptoms at age 16, including increased sensitivity to heat, blurry vision, and numbness in her legs (note: this case was developed based on interviews with persons with MS, obtained with appropriate consents, and does not represent a specific patient). At that time, her clinician attributed her symptoms to a car accident she had been in a few months before. Later, at age 20, she developed abdominal paresthesia, which her clinician attributed to an episode of shingles. At age 23, she developed double vision. She was evaluated by a neurologist and was diagnosed with MS. Marion started care with an MS specialists, who worked with her towards her goals of having a family, working, and exercising. In addition to appropriate medical care, she started martial arts training and biking for exercise and transitioned to a consulting position with flexible hours and the ability to work from home. Her daughter was born a year later.

 

 

At a recent visit to her neurologist, Marion reviews her health diary, in which she has been tracking her fatigue levels throughout the day and when she has to visit the bathroom. The PRO diary also helps her remember details that she might not otherwise be able to recall at the time of her clinic visit. They review the diary entrees together to develop a shared understanding of what Marion has been experiencing and identify trends in the PRO data. They discuss symptom management and use the PRO information from the diary to help guide adjustments to her physical therapy routine and medication regimen.

Part of Marion’s “PRO package” includes the Center for Epidemiologic Studies Depression Scale (CES-D), a validated depression screening and symptom severity questionnaire that she completes every 3 months. Although she denies being depressed, she has noticed that her CES-D scores in recent months have been consistently increasing. This prompts a discussion about mental health in MS and a referral to work on depression with the MS mental health specialist. Marion and the mental health specialist use CES-D measures at baseline and during treatment to set a remission target and to track progress during treatment. Marion finds this helpful because she says it is hard for her to “wrap my hands around depression… it’s not something that there is a blood test or a MRI for.” Marion is encouraged by being able to see her CES-D scores change as her depression severity decreases, and this helps motivate her to keep engaged in treatment.

PROs and PROMs: General Applications

PROs are measures obtained directly from an individual without a priori interpretation by a clinician.9,17 PROs capture individual perspectives on symptoms, capability, disability, and health-related quality of life.9 With increasing emphasis on patient-centered care,18 individual perspectives and preferences elicited using PROMs may be able to inform better quality of care and patient-centered disease treatment and management.19-21

PROMs are standardized, validated questionnaires used to assess PROs and can be generic or condition-specific. Generic PROMs can be used in any patient population. The SF-3622 is a set of quality of life measures that assess perceived ability to complete physical tasks and routine activities, general health status, fatigue, social functioning, pain, and emotional and mental health.23 Condition-specific PROMs can be used for particular patient populations and are helpful in identifying changes in health status for a specific disease, disability, or surgery. For example, the PDQ-39 assesses 8 dimensions of daily living, functioning, and well-being for people with Parkinson’s disease.24

PROMs have been used in some MS clinical trials and research studies to determine the effectiveness of experimental treatments from the viewpoint of study participants.9,25,26 PROs can also be utilized in clinical care to facilitate communication of needs and track health outcomes,27 and can inform improvement in outcomes for health systems and populations. They can also be used to assess experience of care,28 encouraging a focus on high-quality outcomes through PRO-connected reimbursement mechanisms,29 and provide aggregate data to evaluate clinical practice, population health outcomes, and the effectiveness of public policies.27

 

 

Patient-reported experience measures (PREMs) assess patient satisfaction and experience of health care.30,31 CollaboRATE32 is a PREM that assesses the degree of shared decision-making occurring between patients and clinicians during clinical care. PREMs are currently used for assessing self-efficacy and in shared decision-making and health care improvement applications. PREMs have yet to be developed specifically for persons with MS.

PROMs in MS Care

Generic PROMs have shown that persons with MS are disproportionately burdened by poor quality of life.33-35 Other generic PROMs, like the SF-36,36 the Sickness Impact Profile,37 and versions of the Health Utilities Index,38 can be used to gather information on dysfunction and to determine quality and duration of life modified by MS-related dysfunction and disability. MS-specific PROMs are used to assess MS impairments, including pain, fatigue, cognition, sexual dysfunction, and depression.12,39-42 PROMs have also been used in MS clinical trials, including the Multiple Sclerosis Impact Scale-29 (MSIS-29),43,44 the Leeds MS QoL (LMSQoL),45,46 the Functional Assessment of MS (FAMS),47 the Hamburg Quality of Life Questionnaire in MS (HAQUAMS),48 the MS Quality of Life-54 (MSQoL-54),49 the MS International QoL (MUSIQoL),50 and the Patient-Reported Indices for MS Activity Limitations Scale (PRIMUS).51

Condition-specific PROMs are more sensitive to changes in health status and functioning for persons with MS compared to generic PROMs. They are also more reliable during MS remission and relapse periods.44,52 For example, the SF-36 has floor and ceiling effects in MS populations—a high proportion of persons with MS are scored at the maximum or minimum levels of the scale, limiting discriminant capability.22 As a result, a “combined approach” using both generic and MS-specific measures is often recommended.53 Some MS PROMs (eg, MSQoL-54) include generic questions found in the SF-36 as well as additional MS-specific questions or scales.

The variety of PROMs available (see Table for a selected listing) introduces a significant challenge to using them—limited generalizability and difficulty comparing PROs across MS studies. Efforts to establish common PROMs have been undertaken to address this problem.54 The National Institute of Neurologicical Disorders and Stroke (NINDS) sponsored the development of a neurological quality of life battery, the Neuro-QOL.55 Neuro-QOL measures the physical, mental, and social effects of neurological conditions in adults and children with neurological disorders and has the capability to facilitate comparisons across different neurological conditions. Additionally, the Patient-Reported Outcomes Measure Information System (PROMIS) has been developed to assess physical, mental, and social effects of chronic disease. PROMIS has a hybrid design that includes generic and MS-specific measures (such as PROMIS FatigueMS).56 PROMIS can be used to assess persons with MS as well as to compare the MS population with other populations with chronic illness.

Selected PROMs and PREMs

PROMs have varying levels of reliability and validity. The Evaluating the Measure of Patient-Reported Outcomes57 study evaluated the development process of MS PROMs,43 and found that the MSIS-29 and LMSQoL had the highest overall reliability among the most common MS PROMs. However, both scored poorly on validity due to lack of patient involvement during development. This questions the overall capability of existing MS PROMs to accurately and consistently assess PROs in persons with MS.

 

 

“Feed-Forward” PROMs

Oliver and colleagues16 have described “feed-forward” PROM applications in MS care in a community hospital setting using a learning health system approach. This MS clinic uses feed-forward PROs to inform clinical care—PRO data are gathered before the clinic visit and analyzed ahead of or during the clinic visit by the clinician. Patients are asked to arrive early and complete a questionnaire comprised of PROMs measuring disability, functioning, quality of life, cognitive ability, pain, fatigue, sleep quality, anxiety, and depression. Clinicians score the PROMs and input scores into the electronic health record before the clinical encounter. During the clinic visit, PROM data is visually displayed so that the clinician and patient can discuss results and use the data to better inform decision-making. The visual data display contains longitudinal information, displaying trends in health status across multiple domains, and includes specified thresholds for clinically active symptom levels (Figure).16 Longitudinal monitoring of PROM data allows for real-time assessment of goal-related progress throughout treatment. As illustrated previously by Marion’s case study, the use of real-time feed-forward PROM data can strengthen the partnership between patient and clinician as well as improve empowerment, engagement, self-monitoring, and adherence.

Visual display of patient-reported outcome measures in ellectronic health record. Dotted lines represent threshold levels selected for clinically significant symptom severity for each measure.

PRO Dashboards

Performance dashboards are increasingly used in health care to visually display clinical and PRO data for individual patients, systems, and populations over time. Dashboards display a parsimonious group of critically important measures to give clinicians and patients a longitudinal view of PRO status. They can inform decision-making in clinical care, operations, health care improvement efforts, and population health initiatives.58 Effective dashboards allow for user customization with meaningful measures, knowledge discovery for analysis of health problems, accessibility of health information, clear visualization, alerts for unexpected data values, and system connectivity.59,60 Appropriate development of PRO dashboards requires meaningful patient and clinician involvement via focus groups and key informant interviews, Delphi process approaches to prioritize and finalize selection of priority measures, iterative building of the interface with design input from key informants and stakeholders (co-design), and pilot testing to assess feasibility and acceptability of use.61-63

Other Applications of PROs/PROMs in MS

Learning Health Systems

The National Quality Forum (NQF) and the Centers for Medicaid and Medicare Services have adopted PROs for use in quality measurement.64-66 This includes a movement towards the use of LHS, defined as a health system in which information from patients and clinicians is systematically collected and synthesized with external evidence to inform clinical care, improvement, and research.67-70 Often a LHS is undertaken as a collaborative effort between multiple health care centers to improve quality and outcomes of care.70 The MS Continuous Quality Improvement Collaborative (MS-CQI), the first multi-center systems-level health care improvement research collaborative for MS,71 as well as IBD Qorus and the Cystic Fibrosis Care Center Network utilize LHS approaches.72-77

IBD Qorus is a LHS developed by the Crohn’s and Colitis Foundation that uses performance dashboards to better inform clinical care for people with inflammatory bowel disease. It also employs system-level dashboards for performance benchmarking in quality improvement initiatives and aggregate-level dashboards to assess population health status.78,79 MS-CQI uses a LHS approach to inform the improvement of MS care across multiple centers using a comprehensive dashboard, including PROMs, for benchmarking and to monitor system and population health status. MS-CQI collects PROMs using a secure online platform that can be accessed by persons with MS and their clinicians and also includes a journaling feature for collecting qualitative information and for reference and self-monitoring.71

MS Research

PROMs are used in clinical and epidemiological research to evaluate many aspects of MS, including the FAMS, the PDSS, the Fatigue Impact Scale (FIS), and others.80-82 For example, the PROMIS FatigueMS and the Fatigue Performance Scale have been used to assess the impact of MS-related fatigue on social participation.83 Generic and MS-specific PROMs have been used to assess pain levels for people with MS,84-87 and multiple MS-specific PROMs, like PRIMUS and MSQoL-54,43 as well as the SF-3639 include pain assessment scales. PROMs have also been used to assess MS-related bladder, bowel, and sexual dysfunction. Urgency, frequency, and incontinence affect up to 75% of patients with MS,88 and many PROMs, such as the LMSQoL, MUSIQoL, and the MSQoL-54, are able to evaluate bladder control and sexual functioning.43,89

 

 

PROMs are employed in MS clinical trials to help assess the tolerability and effectiveness of DMTs.90,91 PROs have been used as secondary endpoints to understand the global experience of a DMT from the patient perspective.92-94 There are 15 FDA-approved DMTs for MS, and clinical trials for 6 of these have used PROMs as an effectiveness end point.54,91,95,96 However, most DMT clinical trials are powered for MRI, relapse rate, or disease progression primary outcomes rather than PROMs, often resulting in underpowered PROM analyses.97 In addition, many PROMs are not appropriate for use in DMT clinical trials.98,99

In order to bridge the gap between clinical research and practice, some industry entities are championing “patient-focused drug development” approaches. The Accelerated Cure Project for MS has launched iConquerMS, which collects PROMs from persons with MS to further PRO research in MS and follows 4700 individuals with MS worldwide.100 In 2018, the American College of Physicians announced a collaboration with an industry partner to share data to inform DMT clinical trials and develop and validate PROMs specifically designed for DMT clinical trials.101

Population Health

Registries following large cohorts of people with MS have the potential to develop knowledge about disease progression, treatment patterns, and outcomes.102 The Swedish EIMS study has identified associations between pre-disease body mass index and MS prognosis,102 alcohol and tobacco consumption affecting MS risk,103,104 and exposure to shift work at a young age and increased MS risk.105 The North American Research Committee on MS83,106,107 and iConquerMS registries are “PROM-driven” and have been useful in identifying reductions in disease progression in people using DMTs.107,108 The New York State MS Consortium has identified important demographic characteristics that influence MS progression.109,110 PROs can also be used to determine risk of MS-related mortality111 and decline in quality of life.112,113 Limitations of these approaches include use of different PROMs, inconsistencies in data collection processes, and different follow-up intervals used across registries.102

 

Patient-Centered Care

The Institute of Medicine defines patient-centeredness as “care that is respectful and responsive to individual patient preferences, needs, and values and ensures that patient values guide all clinical decisions.”114 PROs are useful for identifying a patient’s individual health concerns and preferences, something that is needed when treating a highly variable chronic health condition like MS. The use of PROs can help clinicicans visualize the lived experience of persons with MS and identify personal preferences,115 as well as improve self-monitoring, self-management, self-efficacy, adherence, wellness, and coping ability.116 At the system level, PROs can inform improvement initiatives and patient-centered care design efforts.117-120

Selecting PROMs

Initiatives from groups like the COnsensus-based Standards for the Selection of health Measurement INstruments (COSMIN)121 and the International Society for Quality of Life Research (ISOQOL)108 offer guidance on selecting PROs. The NINDS has promoted common data collection between clinical studies of the brain and nervous system.122 General guidance from these sources recommends first considering the outcome and target population, selecting PROMs to measure the outcome through a synthesis of the available evidence, assessing validity and reliability of selected PROMs, and using standard measures that can be compared across studies or populations.108,121 Other factors include feasibility, acceptability, and burden of use for patients, clinicians, and systems, as well as literacy, cultural, and linguistic factors.123

 

 

The NQF recommends that consideration be given to individual patient needs, insurance factors, clinical setting constraints, and available resources when selecting PROMs.124 To maximize response rate, PROMs that are sensitive, reliable, valid, and developed in a comparative demographic of patients are advised.125 ISOQOL has released a User’s Guide and several companion guides on implementing and utilizing PROMs.108,126,127 Finally, PRO-Performance Measures (PRO-PMs) are sometimes used to assess whether PROMs are appropriately contributing to performance improvement and accountability.124

The Cons of PROs

Time and Software Constraints

PROs can disrupt busy clinical care environments and overextend clinical staff.125 Online collection of PROs outside of clinical encounters can relieve PRO-related burden, but this requires finding and funding appropriate secure online networks to effectively collect PROs.128 In 2015, only 60% of people seen for primary care visits could access or view their records online, and of those, only 57% used messaging for medical questions or concerns.129 Ideally, online patient portal or mobile health apps could synchronize directly to electronic health records or virtual scribes to transfer patient communications into clinical documentation.130 There has been limited success with this approach in European countries131 and with some chronic illness conditions in the United States.74

Electronic health technologies, including mobile health (mHealth) solutions, have improved the self-monitoring and self-management capability of patients with MS via information sharing in patient networks, assistive technologies, smartphone applications, and wearable devices.132,133 A recent study found that communication modes included secure online patient portal use (29%) and email use (21%), and among those who owned tablets or smartphones, 46% used mHealth apps.134 Social media use has been associated with increased peer/social/emotional support and increased access to health information, as well as clinical monitoring and behavior change.134,135 Individuals using mHealth apps are younger, have comorbidities, and have higher socioeconomic and education levels,135,136 suggesting that inequities in mHealth access exist.

 

Burden on People with MS

Questionnaires can be time-consuming and cause mental distress if not appropriately facilitated.137 Decreasing questionnaire length and providing the option for PROMs to be delivered and completed online or outside of the clinic context can reduce burden.138 Additionally, while some people are consistent in sharing their PROs, others struggle with using computers, especially while experiencing severe symptoms, forget to complete PROMs, or simply do not have internet access due to financial or geographic constraints.139 A group of disabled and elderly persons with MS reported barriers to internet use due to visual deficits, small website font sizes, and distracting color schemes.140

Interpretability

Interpreting PROMs and displays of longitudinal PROM data can be a challenge for persons with MS and their clinicians. There is little standardization in how PROMs are scored and presented, and there is often confusion about thresholds for clinical significance and how PROM scores can be compared to other PROMs.141,142 While guidelines exist for implementing PRO scores in clinical settings,126,143 there are few that aid PROM interpretation. As a result, clinicians often seek research evidence for PROMs used in other similar patient populations as a benchmark,142-144 or compare them to other patients seen in their clinical practice.

 

 

Longitudinal PRO data are usually displayed in simple line graphs.145,146 Overall, line graphs have been found to have the highest ease of understanding by both patients and clinicians, but sometimes can be confusing.147 For example, upward trending lines are usually viewed as improvement and downward trending lines as decline; however, upward trending scores on a PROM can indicate decline, such as increasing fatigue severity. Annotation of visual displays can help. Patients and clinicians find that employing thresholds and color coding is useful, and better than “stoplight” red-yellow-green shading schemes or red-circle formats to indicate data that warrant attention.142

Error Risks

PROs are not free of risk for error, especially if they are used independently of other information sources, such as clinical interview, examination, and diagnostic testing, or if they are utilized too frequently, too infrequently, or are duplicated in practice. If a PRO instrument is employed too frequently, score changes may reflect learning effects rather than actual clinical status. Conversely, if used too infrequently, PRO information will not be timely enough to inform real-time clinical practice. Duplication of PRO assessments (eg, multiple measures of the same PRO for the same patient on the same day) or use of multiple PRO measures to assess the same aspect (eg, 2 measures used to assess fatigue) could introduce unnecessary complexity and confusion to interpretation of PRO results.

PRO measures also can be biased or modified by clinical status and/or perceptions of people with MS at the time of assessment. For example, cognitive impairment, whether at baseline state or due to a cognitive MS relapse event, could impact patients’ ability to understand and respond to PRO assessments, producing erroneous results. However, when used appropriately, PROs targeting cognitive dysfunction may be able to detect onset of cognitive events or help to measure recovery from them. Finally, PROs measure perceived (self-reported) status, which may not be an accurate depiction of actual status.

All of these potential pitfalls support the argument that PROs should be utilized to augment the clinical interview, examination, and diagnostic (objective) testing aspects of comprehensive MS care. In this way, PROs can be correlated with other information sources to deepen the shared understanding of health status between a person with MS and her clinician, increasing the potential to make better treatment decisions and care plans together in partnership.

Value and Cost

National groups such as the Patient-Centered Outcomes Research Institute (PCORI) are working with regulatory bodies, funding agencies, insurance providers, patient advocacy groups, researchers, providers, and specialty groups to investigate how PROMs can be implemented into value-based health care reforms, including value-based reimbursement.148 However, practical PRO implementation requires considerable time and resources, and many methodological and operational questions must be addressed before widespread adoption and reimbursement for PROMs will be feasible.148,149

 

 

Summary

PROs can generate valuable information about perceived health status, function, quality of life, and experience of care using self-reported sources. Validated PRO assessment tools include PROMs and PREMs. PROs are currently utilized in research settings (especially PROMs) but are also being used in clinical practice, quality improvement initiatives, and population health applications using LHS approaches. PROs have the advantages of empowering and informing persons with MS and clinicians to optimize patient-centered care, improve systems of care, and study population health outcomes. Barriers include PROM validity, reliability, comparability, specificity, interpretability, equity, time, and cost. Generic PROMs and PREMs, and some MS-specific PROMs, can be used for persons with MS. Unfortunately, no PREMs have been developed specifically for persons with MS, and this is an area for future research. With appropriate development and utilization in LHS applications, PROs can inform patient-centered clinical care, system-level improvement initiatives, and population health research, and have the potential to help facilitate coproduction of health care services.

Acknowledgments: The authors thank Ann Cabot, DO, of the MS Specialty Care Program at Concord Hospital and (especially) peer mentors from a peer outreach wellness program for people with MS (who have asked to remain anonymous) for interviews conducted with their permission to inform the case study described in this article. The case study used in this manuscript has been de-identified, with some aspects modified from actual, and the person in the case study is fictitiously named.

Corresponding author: Brant Oliver, PhD, MS, MPH, APRN-BC, Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756; brant.j.oliver@dartmouth.edu.

Financial disclosures: None.

References

1. Goldenberg MM. Multiple sclerosis review. PT. 2012;37:175-184.

2. Doshi A, Chataway J. Multiple sclerosis, a treatable disease. Clin Med. 2016;16(Suppl 6):s53-s9.

3. Perrin Ross A. Management of multiple sclerosis. Am J Managed Care. 2013;19(16 Suppl):s301-s306.

4. Batalden M, Batalden P, Margolis P, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25:509-517.

5. Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.

6. Knaup C, Koesters M, Schoefer D, et al. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatr. 2009;195:15-22.

7. Dudgeon D. The impact of measuring patient-reported outcome measures on quality of and access to palliative care. J Palliat Med. 2018;21(S1):S76-s80.

8. Snyder CF, Herman JM, White SM, et al. When using patient-reported outcomes in clinical practice, the measure matters: a randomized controlled trial. J Oncol Pract. 2014;10:e299-e306.

9. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.

10. de Jong MJ, Huibregtse R, Masclee AAM, et al. Patient-reported outcome measures for use in clinical trials and clinical practice in inflammatory bowel diseases: a systematic review. Clin Gastroenterol Hepatol. 2018;16:648-663.

11. Roman D, Osborne-Stafsnes J, Amy CH, et al. Early lessons from four ‘aligning forces for quality’ communities bolster the case for patient-centered care. Health Affairs. 2013;32:232-241.

12. Ehde DM, Alschuler KN, Sullivan MD, et al. Improving the quality of depression and pain care in multiple sclerosis using collaborative care: The MS-care trial protocol. Contemporary Clinical Trials. 2018;64:219-229.

13. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

14. Schick-Makaroff K, Thummapol O, Thompson S, et al. Strategies for incorporating patient-reported outcomes in the care of people with chronic kidney disease (PRO kidney): a protocol for a realist synthesis. Clin Gastroenterol Hepatol. 2018;16:648-663.

15. Nelson EC, Dixon-Woods M, Batalden PB, et al. Patient focused registries can improve health, care, and science. BMJ. 2016;354:i3319.

16. Oliver BJ, Nelson EC, Kerrigan CL. Turning feed-forward and feedback processes on patient-reported data into intelligent action and informed decision-making: case studies and principles. Med Care. 2019;57 Suppl 1:S31-s37.

17. Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: A new era in clinical research. Perspect Clin Res. 2011;2:137-144.

18. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9:100-103.

19. Payne SA. A study of quality of life in cancer patients receiving palliative chemotherapy. Soc Sci Med. 1992;35:1505-1509.

20. Borgaonkar MR, Irvine EJ. Quality of life measurement in gastrointestinal and liver disorders. Gut. 2000;47:444-454.

21. Macdonell R, Nagels G, Laplaud DA, et al. Improved patient-reported health impact of multiple sclerosis: The ENABLE study of PR-fampridine. Multiple Sclerosis. 2016;22:944-954.

22. Hobart J, Freeman J, Lamping D, et al. The SF-36 in multiple sclerosis: why basic assumptions must be tested. J Neurol Neurosurg Psychiatry. 2001;71:363-370.

23. Lins L, Carvalho FM. SF-36 total score as a single measure of health-related quality of life: Scoping review. SAGE Open Med. 2016;4:2050312116671725.

24. Parkinson’s Disease Society of the United Kingdom. The Parkinson’s Disease Questionnaire (PDQ-39). https://www.parkinsons.org.uk/professionals/resources/parkinsons-disease-questionnaire-pdq-39. Accessed October 20, 2019.

25. Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362:865-869.

26. Calvert M, Brundage M, Jacobsen PB, et al. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes. 2013;11:184.

27. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

28. Franks P, Fiscella K, Shields CG, et al. Are patients’ ratings of their physicians related to health outcomes? Ann Fam Med. 2005;3:229-234.

29. Hostetter M, Klein S. Using patient-reported outcomes to improve health care quality. The Commonwealth Fund 2019. www.commonwealthfund.org/publications/newsletter-article/using-patient-reported-outcomes-improve-health-care-quality. Accessed October 24, 2019.

30. Charlotte Kingsley SP. Patient-reported outcome measures and patient-reported experience measures. BJA Education. 2017;17:137-144.

31. Weldring T, Smith SM. Patient-Reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Services Insights. 2013;6:61-68.

32. Elwyn G, Barr PJ, Grande SW, et al. Developing CollaboRATE: A fast and frugal patient-reported measure of shared decision making in clinical encounters. Patient Educ Couns. 2013;93:102-107.

33. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33:1444-1452.

34. Rudick RA, Miller D, Clough JD, et al. Quality of life in multiple sclerosis. Comparison with inflammatory bowel disease and rheumatoid arthritis. Arch Neurol. 1992;49:1237-1242.

35. Benito-Leon J, Morales JM, Rivera-Navarro J, Mitchell A. A review about the impact of multiple sclerosis on health-related quality of life. Disabil Rehabil. 2003;25:1291-1303.

36. RAND Corporation. 36-Item Short Form Survey (SF-36). [https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html. Accessed October 20, 2019.

37. Bergner M, Bobbitt RA, Carter WB, Gilson BS. The sickness impact profile: development and final revision of a health status measure. Medical Care. 1981;19:787-805.

38. Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1:54.

39. Kinkel RP, Laforet G, You X. Disease-related determinants of quality of life 10 years after clinically isolated syndrome. Int J MS Care. 2015;17:26-34.

40. Baumstarck-Barrau K, Simeoni MC, Reuter F, et al. Cognitive function and quality of life in multiple sclerosis patients: a cross-sectional study. BMC Neurology. 2011;11:17.

41. Samartzis L, Gavala E, Zoukos Y, et al. Perceived cognitive decline in multiple sclerosis impacts quality of life independently of depression. Rehabil Res Pract. 2014;2014:128751.

42. Vitkova M, Rosenberger J, Krokavcova M, et al. Health-related quality of life in multiple sclerosis patients with bladder, bowel and sexual dysfunction. Disabil Rehabil. 2014;36:987-992.

43. Khurana V, Sharma H, Afroz N, et al. Patient-reported outcomes in multiple sclerosis: a systematic comparison of available measures. Eur J Neurol. 2017;24:1099-1107.

44. Hobart J, Lamping D, Fitzpatrick R, et al. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(Pt 5):962-973.

45. Lily O, McFadden E, Hensor E, et al. Disease-specific quality of life in multiple sclerosis: the effect of disease modifying treatment. Multiple Sclerosis. 2006;12:808-813.

46. Ford HL, Gerry E, Tennant A, et al. Developing a disease-specific quality of life measure for people with multiple sclerosis. Clin Rehabil. 2001;15:247-258.

47. Cella DF, Dineen K, Arnason B, et al. Validation of the functional assessment of multiple sclerosis quality of life instrument. Neurology. 1996;47:129-139.

48. Gold SM, Heesen C, Schulz H, et al. Disease specific quality of life instruments in multiple sclerosis: validation of the Hamburg Quality of Life Questionnaire in Multiple Sclerosis (HAQUAMS). Multiple Sclerosis. 2001;7:119-130.

49. Vickrey BG, Hays RD, Harooni R, et al. A health-related quality of life measure for multiple sclerosis. Qual Life Res. 1995;4:187-206.

50. Simeoni M, Auquier P, Fernandez O, et al. Validation of the Multiple Sclerosis International Quality of Life questionnaire. Multiple Sclerosis. 2008;14:219-230.

51. Doward LC, McKenna SP, Meads DM, et al. The development of patient-reported outcome indices for multiple sclerosis (PRIMUS). Multiple Sclerosis. 2009;15:1092-1102.

52. Ozakbas S, Akdede BB, Kosehasanogullari G, et al. Difference between generic and multiple sclerosis-specific quality of life instruments regarding the assessment of treatment efficacy. J Neurol Sci. 2007;256:30-34.

53. Cella DF, Wiklund I, Shumaker SA, Aaronson NK. Integrating health-related quality of life into cross-national clinical trials. Qual Life Res. 1993;2:433-440.

54. Nowinski CJ, Miller DM, Cella D. Evolution of patient-reported outcomes and their role in multiple sclerosis clinical trials. Neurotherapeutics. 2017;14:934-944.

55. Cella D, Nowinski C, Peterman A, et al. The neurology quality-of-life measurement initiative. Arch Phys Med Rehabil. 2011;92(10 Suppl):S28-S36.

56. HealthMeasures: PROMIS. http://www.healthmeasures.net/explore-measurement-systems/promis. Accessed October 20, 2019.

57. Valderas JM, Ferrer M, Mendivil J, et al. Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures. Value Health. 2008;11:700-708.

58. Bach K, Martling C, Mork PJ, et al. Design of a clinician dashboard to facilitate co-decision making in the management of non-specific low back pain. J Intelligent Helath Syst. 2019;52:269-284.

59. Karami M, Safdari R, Rahimi A. Effective radiology dashboards: key research findings. Radiology Management. 2013;35:42-45.

60. Dowding D, Randell R, Gardner P, et al. Dashboards for improving patient care: review of the literature. Int J Med Informatic. 2015;84:87-100.

61. Mlaver E, Schnipper JL, Boxer RB, et al. User-centered collaborative design and development of an inpatient safety dashboard. Jt Comm J Qual Patient Saf. 2017;43:676-685.

62. Dowding D, Merrill J, Russell D. Using feedback intervention theory to guide clinical dashboard design. AMIA Annu Symp Proc. 2018;2018:395-403.

63. Hartzler AL, Izard JP, Dalkin BL, et al. Design and feasibility of integrating personalized PRO dashboards into prostate cancer care. J Am Med Inform Assoc. 2016;23:38-47.

64. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

65. U.S. Centers for Medicare & Medicaid Services. Comprehensive Care for Joint Replacement Model. https://innovation.cms.gov/initiatives/CJR. Accessed August 3, 2019.

66. National Quality Forum. Patient-reported outcomes: Accessed August 3, 2019. http://www.qualityforum.org/Patient-Reported_Outcomes.aspx. Accessed October 20, 2019.

67. Institute of Medicine Roundtable on Evidence-Based Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Olsen LA, Aisner D, McGinnis JM, eds. The Learning Healthcare System: Workshop Summary. Washington (DC): National Academies Press (US).National Academy of Sciences; 2007.

68. About Learning Health Systems: Agency for Healthcare Research and Quality. https://www.ahrq.gov/learning-health-systems/about.html. Accessed August 3, 2019.

69. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington (DC): National Academies Press; 2013.

70. Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.

71. Oliver BJ, for the MS-CQI Investigators. The Multiple Sclerosis Continuous improvement collaborative: the first coproduction learning health system improvement science research collaborative for multiple sclerosis. The International Society for Quality in Health Care (ISQua) Annual International Conference; October 2019; Cape Town, South Africa.

72. Britto MT, Fuller SC, Kaplan HC, et al. Using a network organisational architecture to support the development of Learning Healthcare Systems. BMJ Qual Saf. 2018;27:937-946.

73. Care Centers: Cystic Fibrosis Foundation. https://www.cff.org/Care/Care-Centers/. Accessed August 3, 2019.

74. Schechter MS, Fink AK, Homa K, Goss CH. The Cystic Fibrosis Foundation patient registry as a tool for use in quality improvement. BMJ Qual Saf. 2014;23(Suppl 1):i9-i14.

75. Mogayzel PJ, Dunitz J, Marrow LC, Hazle LA. Improving chronic care delivery and outcomes: the impact of the cystic fibrosis Care Center Network. BMJ Qual Saf. 2014;23(Suppl 1):i3-i8.

76. Godfrey MM, Oliver BJ. Accelerating the rate of improvement in cystic fibrosis care: contributions and insights of the learning and leadership collaborative. BMJ Qual Saf. 2014;23(Suppl 1):i23-i32.

77. Nelson EC, Godfrey MM. Quality by Design: A Clinical Microsystems Approach. San Francisco, California: Jossey-Bass; 2007.

78. Crohn’s & Colitis Foundation.Quality of Care: IBD Qorus: https://www.crohnscolitisfoundation.org/research/ibd-qorus. Accessed October 23, 2019.

79. Johnson LC, Melmed GY, Nelson EC, et al. Fostering collaboration through creation of an ibd learning health system. Am J Gastroenterol. 2017;112:406-468.

80. Fernandez-Munoz JJ, Moron-Verdasco A, Cigaran-Mendez M, et al. Disability, quality of life, personality, cognitive and psychological variables associated with fatigue in patients with multiple sclerosis. Acta Neurologica Scandinavica. 2015;132:118-124.

81. Flachenecker P, Kumpfel T, Kallmann B, et al. Fatigue in multiple sclerosis: a comparison of different rating scales and correlation to clinical parameters. Multiple Sclerosis. 2002;8:523-526.

82. Tellez N, Rio J, Tintore M, et al. Does the Modified Fatigue Impact Scale offer a more comprehensive assessment of fatigue in MS? Multiple Sclerosis. 2005;11:198-202.

83. Salter A, Fox RJ, Tyry T, et al. The association of fatigue and social participation in multiple sclerosis as assessed using two different instruments. Mult Scler Relat Disord. 2019;31:165-72.

84. Solaro C, Trabucco E, Messmer Uccelli M. Pain and multiple sclerosis: pathophysiology and treatment. Curr Neurol Neurosci Rep. 2013;13:320.

85. Jawahar R, Oh U, Yang S, Lapane KL. A systematic review of pharmacological pain management in multiple sclerosis. Drugs. 2013;73:1711-1722.

86. Rintala A, Hakkinen A, Paltamaa J. Ten-year follow-up of health-related quality of life among ambulatory persons with multiple sclerosis at baseline. Qual Life Res. 2016;25:3119-3127.

87. Tepavcevic DK, Pekmezovic T, Stojsavljevic N, et al. Change in quality of life and predictors of change among patients with multiple sclerosis: a prospective cohort study. Qual Life Res. 2014;23:1027-1037.

88. DasGupta R, Fowler CJ. Bladder, bowel and sexual dysfunction in multiple sclerosis: management strategies. Drugs. 2003;63:153-166.

89. Marck CH, Jelinek PL, Weiland TJ, et al. Sexual function in multiple sclerosis and associations with demographic, disease and lifestyle characteristics: an international cross-sectional study. BMC Neurology. 2016;16:210.

90. Gajofatto A, Benedetti MD. Treatment strategies for multiple sclerosis: When to start, when to change, when to stop? World J Clinical Cases. 2015;3:545-555.

91. National Multiple Sclerosis Society. Disease-modifying therapies for MS. 2018.

92. Rudick RA, Panzara MA. Natalizumab for the treatment of relapsing multiple sclerosis. Biologics. 2008;2:189-199.

93. Cohen JA, Cutter GR, Fischer JS, et al. Benefit of interferon beta-1a on MSFC progression in secondary progressive MS. Neurology. 2002;59:679-687.

94. Patti F, Pappalardo A, Montanari E, et al. Interferon-beta-1a treatment has a positive effect on quality of life of relapsing-remitting multiple sclerosis: results from a longitudinal study. J Neurol Sci. 2014;337:180-185.

95. Novartis. Exploring the efficacy and safety of Siponimod in patients with secondary progressive multiple sclerosis (EXPAND). Available from clinicaltrials.gov/ct2/show/NCT01665144. NLM identifier: NCT01665144.

96. Singal AG, Higgins PD, Waljee AK. A primer on effectiveness and efficacy trials. Clin Transl Gastroenterol. 2014;5:e45.

97. Jongen PJ. Health-related quality of life in patients with multiple sclerosis: impact of disease-modifying drugs. CNS Drugs. 2017;31:585-602.

98. Coretti S, Ruggeri M, McNamee P. The minimum clinically important difference for EQ-5D index: a critical review. Expert Rev Pharmacoecon Outcomes Res. 2014;14:221-233.

99. Clinical Review Report: Ocrelizumab (Ocrevus). CADTH Common Drug Review. 2018:Appendix 4, Validity of Outcome Measures.

100. iCounquer MS; Empowering patients: how individuals with ms are contributing to the fight to find a cure: 2018. https://www.iconquerms.org/empowering-patients-how-individuals-ms-are-contributing-fight-find-cure. Accessed October 23, 2019.

101. K M. Accelerated Cure Project Announces Collaboration with EMD Serono to Advance Patient-Focused Drug Development in Multiple Sclerosis2018. https://www.iconquerms.org/accelerated-cure-project-announces-collaboration-emd-serono-advance-patient-focused-drug-development. Accessed October 24, 2019.

102. Bebo BF Jr, Fox RJ, Lee K, et al. Landscape of MS patient cohorts and registries: Recommendations for maximizing impact. Multiple Sclerosis. 2018;24:579-586.

103. Hedstrom AK, Hillert J, Olsson T, Alfredsson L. Alcohol as a modifiable lifestyle factor affecting multiple sclerosis risk. JAMA Neurology. 2014;71:300-305.

104. Hedstrom AK, Baarnhielm M, Olsson T, Alfredsson L. Tobacco smoking, but not Swedish snuff use, increases the risk of multiple sclerosis. Neurology. 2009;73:696-701.

105. Hedstrom AK, Akerstedt T, Hillert J, et al. Shift work at young age is associated with increased risk for multiple sclerosis. Ann Neurol. 2011;70:733-741.

106. Hadjimichael O, Vollmer T, Oleen-Burkey M. Fatigue characteristics in multiple sclerosis: the North American Research Committee on Multiple Sclerosis (NARCOMS) survey. Health Qual Life Outcomes. 2008;6:100.

107. Fox RJ, Salter AR, Tyry T, et al. Treatment discontinuation and disease progression with injectable disease-modifying therapies: findings from the North American research committee on multiple sclerosis database. Int J MS Care. 2013;15:194-201.

108. Reeve BB, Wyrwich KW, Wu AW, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22:1889-1905.

109. Jacobs LD, Wende KE, Brownscheidle CM, et al. A profile of multiple sclerosis: the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 1999;5:369-376.

110. Weinstock-Guttman B, Jacobs LD, Brownscheidle CM, et al. Multiple sclerosis characteristics in African American patients in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2003;9:293-298.

111. Raffel J, Wallace A, Gveric D, et al. Patient-reported outcomes and survival in multiple sclerosis: A 10-year retrospective cohort study using the Multiple Sclerosis Impact Scale-29. PLoS Med. 2017;14:e1002346.

112. Vaughn CB, Kavak KS, Dwyer MG, et al. Fatigue at enrollment predicts EDSS worsening in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2018:1352458518816619.

113. Alroughani RA, Akhtar S, Ahmed SF, Al-Hashel JY. Clinical predictors of disease progression in multiple sclerosis patients with relapsing onset in a nation-wide cohort. Int J Neuroscience. 2015;125:831-837.

114. Dolan JG, Veazie PJ, Russ AJ. Development and initial evaluation of a treatment decision dashboard. BMC Med Inform Decision Mak. 2013;13:51.

115. Stuifbergen AK, Becker H, Blozis S, et al. A randomized clinical trial of a wellness intervention for women with multiple sclerosis. Arch Phys Med Rehabil. 2003;84:467-476.

116. Finkelstein J, Martin C, Bhushan A, et al. Feasibility of computer-assisted education in patients with multiple sclerosis. In: Proceedings of the IEEE Symposium on Computer-Based Medical Systems. Bethesda, MD; 2004.

117. Batalden P. Getting more health from healthcare: quality improvement must acknowledge patient coproduction—an essay by Paul Batalden. BMJ. 2018;362:k3617.

118. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Health Care. 2007;16:2-3.

119. Ovretveit J, Zubkoff L, Nelson EC, et al. Using patient-reported outcome measurement to improve patient care. Int J Qual Health Care. 2017;29:874-879.

120. Prodinger B, Taylor P. Improving quality of care through patient-reported outcome measures (PROMs): expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples. BMC Health Services Res. 2018;18:87.

121. Prinsen CA, Vohra S, Rose MR, et al. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” – a practical guideline. Trials. 2016;17:449.

122. NINDS. NINDS Common Data Elements: Streamline Your Neuroscience Clinical Research National Institute of Health. https://www.commondataelements.ninds.nih.gov/#page=Default. Accessed October 23, 2019.

123. Francis DO, McPheeters ML, Noud M, et al. Checklist to operationalize measurement characteristics of patient-reported outcome measures. Systematic Rev. 2016;5:129.

124. National Quality Forum. Patient-reported outcomes (PROs) in performance measurement. 2013. https://www.qualityforum.org/Publications/2012/12/Patient-Reported_Outcomes_in_Performance_Measurement.aspx. Accessed October 15, 2019.

125. Dawson J, Doll H, Fitzpatrick R, et al. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186.

126. Aaronson N ET, Greenlhalgh J, Halyard M, et al. User’s guide to implementation of patient reported outcomes assessment in clinical practice. International Society for Quality of Life. 2015.

127. Chan EKH, Edwards TC, Haywood K, et al. Implementing patient-reported outcomes mesaures in clinical practice: a companion guide to the ISOQOL user’s guide. Qual Life Res. 2018;28:621-627.

128. Snyder CF, Wu AW, Miller RS, et al. The role of informatics in promoting patient-centered care. Cancer J. 2011;17:211-218

129. Osborn R, Moulds D, Schneider EC, et al. Primary care physicians in ten countries report challenges caring for patients with complex health needs. Health Affairs. 2015;34:2104-2112.

130. Wu AW, Kharrazi H, Boulware LE, Snyder CF. Measure once, cut 0wice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research. J Clin Epidemiol. 2013;66(8 Suppl):S12-S20.

131. Trojano M, Bergamaschi R, Amato MP, et al. The Italian multiple sclerosis register. Neurol Sci. 2019;40:155-165.

132. Moorhead SA, Hazlett DE, Harrison L, et al. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res. 2013;15:e85.

133. Luigi L, Francesco B, Marcello M, et al. e-Health and multiple sclerosis: An update. Multiple Sclerosis J. 2018;24:1657-1664.

134. Marrie RA, Leung S, Tyry T, et al. Use of eHealth and mHealth technology by persons with multiple sclerosis. Mult Scler Relat Dis. 2019;27:13-19.

135. Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E. Exploring the specific needs of persons with multiple sclerosis for mhealth solutions for physical activity: mixed-methods study. JMIR Mhealth Uhealth. 2018;6:e37.

136. Spooner KK, Salemi JL, Salihu HM, Zoorob RJ. eHealth patient-provider communication in the United States: interest, inequalities, and predictors. J Am Med Inform Assoc. 2017;24(e1):e18-e27.

137. Safdar N, Abbo LM, Knobloch MJ, Seo SK. Research methods in healthcare epidemiology: survey and qualitative research. Infect Control Hosp Epidemiol. 2016;37:1272-1277.

138. Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101-1108.

139. Chiu C, Bishop M, Pionke JJ, et al. Barriers to the accessibility and continuity of health-care services in people with multiple sclerosis: a literature review. Int J MS Care. 2017;19:313-321.

140. Atreja A, Mehta N, Miller D, et al. One size does not fit all: using qualitative methods to inform the development of an Internet portal for multiple sclerosis patients. AMIA Annu Symp Proc Symp. 2005:16-20.

141. Snyder CF, Blackford AL, Brahmer JR, et al. Needs assessments can identify scores on HRQOL questionnaires that represent problems for patients: an illustration with the Supportive Care Needs Survey and the QLQ-C30. Qual Life Res. 2010;19:837-845.

142. de Vet HC, Terwee CB. The minimal detectable change should not replace the minimal important difference. J Clin Epidemiol. 2010;63:804-805.

143. Snyder CF, Aaronson NK, Choucair AK, et al. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life. 2012;21:1305-1314.

144. Myla DG, Melanie DW, Robert WM, et al. Identification and validation of clinically meaningful benchmarks in the 12-item Multiple Sclerosis Walking Scale. Multiple Sclerosis J. 2017;23:1405-1414.

145. van Munster CEP, Uitdehaag BMJ. Outcome measures in clinical trials for multiple sclerosis. CNS Drugs. 2017;31:217-236.

146. Snyder CF, Jensen R, Courtin SO, Wu AW. PatientViewpoint: a website for patient-reported outcomes assessment. Quality Life Res. 2009;18:793-800.

147. Snyder CF, Smith KC, Bantug ET, et al. What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer. 2017;123:1848-1859.

148. Squitieri L, Bozic KJ, Pusic AL. The role of patient-reported outcome measures in value-based payment reform. Value Health. 2017;20:834-836.

149. Boyce MB, Browne JP. The effectiveness of providing peer benchmarked feedback to hip replacement surgeons based on patient-reported outcome measures—results from the PROFILE trial: a cluster randomised controlled study. BMJ Open. 2015;5:e008325.

Article PDF
Issue
Journal of Clinical Outcomes Management - 26(6)
Publications
Topics
Page Number
277-288
Sections
Article PDF
Article PDF

From the Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Hanover, NH (Ms. Manohar and Dr. Oliver), the Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH (Ms. Perkins, Ms. Laurion, and Dr. Oliver), and the Multiple Sclerosis Specialty Care Program, Concord Hospital, Concord, NH (Dr. Oliver).

Abstract

  • Background: Patient-reported outcomes (PROs), including patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs), can be used to assess perceived health status, functioning, quality of life, and experience of care. Complex chronic illnesses such as multiple sclerosis (MS) affect multiple aspects of health, and PROs can be applied in assessment and decision-making in MS care as well as in research pertaining to MS.
  • Objective: To provide a general review of PROs, with a specific focus on implications for MS care.
  • Methods: Evidence synthesis of available literature on PROs in MS care.
  • Results: PROs (including PROMs and PREMs) have historically been utilized in research and are now being applied in clinical, improvement, and population health settings using learning health system approaches in many disease populations, including MS. Many challenges complicate the use of PROs in MS care, including reliability, validity, and interpretability of PROMs, as well as feasibility barriers due to time and financial constraints in clinical settings.
  • Conclusion: PROs have the potential to better inform clinical care, empower patient-centered care, inform health care improvement efforts, and create the conditions for coproduction of health care services.

Keywords: PRO; PROM; patient-reported outcome measure; patient-reported experience measure; quality of life; patient-centered care.

Multiple sclerosis (MS) is a disabling, complex, chronic, immune-mediated disorder of the central nervous system (CNS). MS causes inflammatory and degenerative damage in the CNS, which disrupts signaling pathways.1 It is most commonly diagnosed in young adults and affects 2.3 million people worldwide.2 People with MS experience very different disease courses and a wide range of neurological symptoms, including visual, somatic, mental health, sensory, motor, and cognitive problems.1-3 Relapsing-remitting MS, the most common form, affects 85% of those with MS and is characterized by periods of relapse (exacerbation) and remission.1 Other forms of MS (primary progressive and secondary progressive MS) are characterized by progressive deterioration and worsening symptom severity without exacerbations. Disease-modifying therapies (DMTs) can reduce the frequency of exacerbations and disability progression, but unfortunately there is no cure for MS. Treatment is focused on increasing quality of life, minimizing disability, and maximizing wellness.

Patient-reported outcomes (PROs) describe the perceived health status, function, and/or experience of a person as obtained by direct self-report. Patient-reported outcome measures (PROMs) are validated PROs that can be used to inform clinical care,4 and have demonstrated effectiveness in improving patient-provider communication and decision-making.5-7 PROMs are currently used in some MS clinical trials to determine the impact of experimental interventions,8-10 and are also being used to inform and improve clinical care in some settings. Especially for persons with MS, they can provide individualized perspectives about health experience and outcomes.11 In more advanced applications, PROMs can be used to improve face-to-face collaborations between clinicians and patients and to inform patient-centered systems of care.12-14 PROMs can also be used to inform systems-level improvement for entire patient populations.15,16

In this article, we review current applications of PROs and PROMs in the care of persons with MS, as well as current limitations and barriers to their use.

CASE STUDY

Marion is a 26-year-old woman who first developed MS symptoms at age 16, including increased sensitivity to heat, blurry vision, and numbness in her legs (note: this case was developed based on interviews with persons with MS, obtained with appropriate consents, and does not represent a specific patient). At that time, her clinician attributed her symptoms to a car accident she had been in a few months before. Later, at age 20, she developed abdominal paresthesia, which her clinician attributed to an episode of shingles. At age 23, she developed double vision. She was evaluated by a neurologist and was diagnosed with MS. Marion started care with an MS specialists, who worked with her towards her goals of having a family, working, and exercising. In addition to appropriate medical care, she started martial arts training and biking for exercise and transitioned to a consulting position with flexible hours and the ability to work from home. Her daughter was born a year later.

 

 

At a recent visit to her neurologist, Marion reviews her health diary, in which she has been tracking her fatigue levels throughout the day and when she has to visit the bathroom. The PRO diary also helps her remember details that she might not otherwise be able to recall at the time of her clinic visit. They review the diary entrees together to develop a shared understanding of what Marion has been experiencing and identify trends in the PRO data. They discuss symptom management and use the PRO information from the diary to help guide adjustments to her physical therapy routine and medication regimen.

Part of Marion’s “PRO package” includes the Center for Epidemiologic Studies Depression Scale (CES-D), a validated depression screening and symptom severity questionnaire that she completes every 3 months. Although she denies being depressed, she has noticed that her CES-D scores in recent months have been consistently increasing. This prompts a discussion about mental health in MS and a referral to work on depression with the MS mental health specialist. Marion and the mental health specialist use CES-D measures at baseline and during treatment to set a remission target and to track progress during treatment. Marion finds this helpful because she says it is hard for her to “wrap my hands around depression… it’s not something that there is a blood test or a MRI for.” Marion is encouraged by being able to see her CES-D scores change as her depression severity decreases, and this helps motivate her to keep engaged in treatment.

PROs and PROMs: General Applications

PROs are measures obtained directly from an individual without a priori interpretation by a clinician.9,17 PROs capture individual perspectives on symptoms, capability, disability, and health-related quality of life.9 With increasing emphasis on patient-centered care,18 individual perspectives and preferences elicited using PROMs may be able to inform better quality of care and patient-centered disease treatment and management.19-21

PROMs are standardized, validated questionnaires used to assess PROs and can be generic or condition-specific. Generic PROMs can be used in any patient population. The SF-3622 is a set of quality of life measures that assess perceived ability to complete physical tasks and routine activities, general health status, fatigue, social functioning, pain, and emotional and mental health.23 Condition-specific PROMs can be used for particular patient populations and are helpful in identifying changes in health status for a specific disease, disability, or surgery. For example, the PDQ-39 assesses 8 dimensions of daily living, functioning, and well-being for people with Parkinson’s disease.24

PROMs have been used in some MS clinical trials and research studies to determine the effectiveness of experimental treatments from the viewpoint of study participants.9,25,26 PROs can also be utilized in clinical care to facilitate communication of needs and track health outcomes,27 and can inform improvement in outcomes for health systems and populations. They can also be used to assess experience of care,28 encouraging a focus on high-quality outcomes through PRO-connected reimbursement mechanisms,29 and provide aggregate data to evaluate clinical practice, population health outcomes, and the effectiveness of public policies.27

 

 

Patient-reported experience measures (PREMs) assess patient satisfaction and experience of health care.30,31 CollaboRATE32 is a PREM that assesses the degree of shared decision-making occurring between patients and clinicians during clinical care. PREMs are currently used for assessing self-efficacy and in shared decision-making and health care improvement applications. PREMs have yet to be developed specifically for persons with MS.

PROMs in MS Care

Generic PROMs have shown that persons with MS are disproportionately burdened by poor quality of life.33-35 Other generic PROMs, like the SF-36,36 the Sickness Impact Profile,37 and versions of the Health Utilities Index,38 can be used to gather information on dysfunction and to determine quality and duration of life modified by MS-related dysfunction and disability. MS-specific PROMs are used to assess MS impairments, including pain, fatigue, cognition, sexual dysfunction, and depression.12,39-42 PROMs have also been used in MS clinical trials, including the Multiple Sclerosis Impact Scale-29 (MSIS-29),43,44 the Leeds MS QoL (LMSQoL),45,46 the Functional Assessment of MS (FAMS),47 the Hamburg Quality of Life Questionnaire in MS (HAQUAMS),48 the MS Quality of Life-54 (MSQoL-54),49 the MS International QoL (MUSIQoL),50 and the Patient-Reported Indices for MS Activity Limitations Scale (PRIMUS).51

Condition-specific PROMs are more sensitive to changes in health status and functioning for persons with MS compared to generic PROMs. They are also more reliable during MS remission and relapse periods.44,52 For example, the SF-36 has floor and ceiling effects in MS populations—a high proportion of persons with MS are scored at the maximum or minimum levels of the scale, limiting discriminant capability.22 As a result, a “combined approach” using both generic and MS-specific measures is often recommended.53 Some MS PROMs (eg, MSQoL-54) include generic questions found in the SF-36 as well as additional MS-specific questions or scales.

The variety of PROMs available (see Table for a selected listing) introduces a significant challenge to using them—limited generalizability and difficulty comparing PROs across MS studies. Efforts to establish common PROMs have been undertaken to address this problem.54 The National Institute of Neurologicical Disorders and Stroke (NINDS) sponsored the development of a neurological quality of life battery, the Neuro-QOL.55 Neuro-QOL measures the physical, mental, and social effects of neurological conditions in adults and children with neurological disorders and has the capability to facilitate comparisons across different neurological conditions. Additionally, the Patient-Reported Outcomes Measure Information System (PROMIS) has been developed to assess physical, mental, and social effects of chronic disease. PROMIS has a hybrid design that includes generic and MS-specific measures (such as PROMIS FatigueMS).56 PROMIS can be used to assess persons with MS as well as to compare the MS population with other populations with chronic illness.

Selected PROMs and PREMs

PROMs have varying levels of reliability and validity. The Evaluating the Measure of Patient-Reported Outcomes57 study evaluated the development process of MS PROMs,43 and found that the MSIS-29 and LMSQoL had the highest overall reliability among the most common MS PROMs. However, both scored poorly on validity due to lack of patient involvement during development. This questions the overall capability of existing MS PROMs to accurately and consistently assess PROs in persons with MS.

 

 

“Feed-Forward” PROMs

Oliver and colleagues16 have described “feed-forward” PROM applications in MS care in a community hospital setting using a learning health system approach. This MS clinic uses feed-forward PROs to inform clinical care—PRO data are gathered before the clinic visit and analyzed ahead of or during the clinic visit by the clinician. Patients are asked to arrive early and complete a questionnaire comprised of PROMs measuring disability, functioning, quality of life, cognitive ability, pain, fatigue, sleep quality, anxiety, and depression. Clinicians score the PROMs and input scores into the electronic health record before the clinical encounter. During the clinic visit, PROM data is visually displayed so that the clinician and patient can discuss results and use the data to better inform decision-making. The visual data display contains longitudinal information, displaying trends in health status across multiple domains, and includes specified thresholds for clinically active symptom levels (Figure).16 Longitudinal monitoring of PROM data allows for real-time assessment of goal-related progress throughout treatment. As illustrated previously by Marion’s case study, the use of real-time feed-forward PROM data can strengthen the partnership between patient and clinician as well as improve empowerment, engagement, self-monitoring, and adherence.

Visual display of patient-reported outcome measures in ellectronic health record. Dotted lines represent threshold levels selected for clinically significant symptom severity for each measure.

PRO Dashboards

Performance dashboards are increasingly used in health care to visually display clinical and PRO data for individual patients, systems, and populations over time. Dashboards display a parsimonious group of critically important measures to give clinicians and patients a longitudinal view of PRO status. They can inform decision-making in clinical care, operations, health care improvement efforts, and population health initiatives.58 Effective dashboards allow for user customization with meaningful measures, knowledge discovery for analysis of health problems, accessibility of health information, clear visualization, alerts for unexpected data values, and system connectivity.59,60 Appropriate development of PRO dashboards requires meaningful patient and clinician involvement via focus groups and key informant interviews, Delphi process approaches to prioritize and finalize selection of priority measures, iterative building of the interface with design input from key informants and stakeholders (co-design), and pilot testing to assess feasibility and acceptability of use.61-63

Other Applications of PROs/PROMs in MS

Learning Health Systems

The National Quality Forum (NQF) and the Centers for Medicaid and Medicare Services have adopted PROs for use in quality measurement.64-66 This includes a movement towards the use of LHS, defined as a health system in which information from patients and clinicians is systematically collected and synthesized with external evidence to inform clinical care, improvement, and research.67-70 Often a LHS is undertaken as a collaborative effort between multiple health care centers to improve quality and outcomes of care.70 The MS Continuous Quality Improvement Collaborative (MS-CQI), the first multi-center systems-level health care improvement research collaborative for MS,71 as well as IBD Qorus and the Cystic Fibrosis Care Center Network utilize LHS approaches.72-77

IBD Qorus is a LHS developed by the Crohn’s and Colitis Foundation that uses performance dashboards to better inform clinical care for people with inflammatory bowel disease. It also employs system-level dashboards for performance benchmarking in quality improvement initiatives and aggregate-level dashboards to assess population health status.78,79 MS-CQI uses a LHS approach to inform the improvement of MS care across multiple centers using a comprehensive dashboard, including PROMs, for benchmarking and to monitor system and population health status. MS-CQI collects PROMs using a secure online platform that can be accessed by persons with MS and their clinicians and also includes a journaling feature for collecting qualitative information and for reference and self-monitoring.71

MS Research

PROMs are used in clinical and epidemiological research to evaluate many aspects of MS, including the FAMS, the PDSS, the Fatigue Impact Scale (FIS), and others.80-82 For example, the PROMIS FatigueMS and the Fatigue Performance Scale have been used to assess the impact of MS-related fatigue on social participation.83 Generic and MS-specific PROMs have been used to assess pain levels for people with MS,84-87 and multiple MS-specific PROMs, like PRIMUS and MSQoL-54,43 as well as the SF-3639 include pain assessment scales. PROMs have also been used to assess MS-related bladder, bowel, and sexual dysfunction. Urgency, frequency, and incontinence affect up to 75% of patients with MS,88 and many PROMs, such as the LMSQoL, MUSIQoL, and the MSQoL-54, are able to evaluate bladder control and sexual functioning.43,89

 

 

PROMs are employed in MS clinical trials to help assess the tolerability and effectiveness of DMTs.90,91 PROs have been used as secondary endpoints to understand the global experience of a DMT from the patient perspective.92-94 There are 15 FDA-approved DMTs for MS, and clinical trials for 6 of these have used PROMs as an effectiveness end point.54,91,95,96 However, most DMT clinical trials are powered for MRI, relapse rate, or disease progression primary outcomes rather than PROMs, often resulting in underpowered PROM analyses.97 In addition, many PROMs are not appropriate for use in DMT clinical trials.98,99

In order to bridge the gap between clinical research and practice, some industry entities are championing “patient-focused drug development” approaches. The Accelerated Cure Project for MS has launched iConquerMS, which collects PROMs from persons with MS to further PRO research in MS and follows 4700 individuals with MS worldwide.100 In 2018, the American College of Physicians announced a collaboration with an industry partner to share data to inform DMT clinical trials and develop and validate PROMs specifically designed for DMT clinical trials.101

Population Health

Registries following large cohorts of people with MS have the potential to develop knowledge about disease progression, treatment patterns, and outcomes.102 The Swedish EIMS study has identified associations between pre-disease body mass index and MS prognosis,102 alcohol and tobacco consumption affecting MS risk,103,104 and exposure to shift work at a young age and increased MS risk.105 The North American Research Committee on MS83,106,107 and iConquerMS registries are “PROM-driven” and have been useful in identifying reductions in disease progression in people using DMTs.107,108 The New York State MS Consortium has identified important demographic characteristics that influence MS progression.109,110 PROs can also be used to determine risk of MS-related mortality111 and decline in quality of life.112,113 Limitations of these approaches include use of different PROMs, inconsistencies in data collection processes, and different follow-up intervals used across registries.102

 

Patient-Centered Care

The Institute of Medicine defines patient-centeredness as “care that is respectful and responsive to individual patient preferences, needs, and values and ensures that patient values guide all clinical decisions.”114 PROs are useful for identifying a patient’s individual health concerns and preferences, something that is needed when treating a highly variable chronic health condition like MS. The use of PROs can help clinicicans visualize the lived experience of persons with MS and identify personal preferences,115 as well as improve self-monitoring, self-management, self-efficacy, adherence, wellness, and coping ability.116 At the system level, PROs can inform improvement initiatives and patient-centered care design efforts.117-120

Selecting PROMs

Initiatives from groups like the COnsensus-based Standards for the Selection of health Measurement INstruments (COSMIN)121 and the International Society for Quality of Life Research (ISOQOL)108 offer guidance on selecting PROs. The NINDS has promoted common data collection between clinical studies of the brain and nervous system.122 General guidance from these sources recommends first considering the outcome and target population, selecting PROMs to measure the outcome through a synthesis of the available evidence, assessing validity and reliability of selected PROMs, and using standard measures that can be compared across studies or populations.108,121 Other factors include feasibility, acceptability, and burden of use for patients, clinicians, and systems, as well as literacy, cultural, and linguistic factors.123

 

 

The NQF recommends that consideration be given to individual patient needs, insurance factors, clinical setting constraints, and available resources when selecting PROMs.124 To maximize response rate, PROMs that are sensitive, reliable, valid, and developed in a comparative demographic of patients are advised.125 ISOQOL has released a User’s Guide and several companion guides on implementing and utilizing PROMs.108,126,127 Finally, PRO-Performance Measures (PRO-PMs) are sometimes used to assess whether PROMs are appropriately contributing to performance improvement and accountability.124

The Cons of PROs

Time and Software Constraints

PROs can disrupt busy clinical care environments and overextend clinical staff.125 Online collection of PROs outside of clinical encounters can relieve PRO-related burden, but this requires finding and funding appropriate secure online networks to effectively collect PROs.128 In 2015, only 60% of people seen for primary care visits could access or view their records online, and of those, only 57% used messaging for medical questions or concerns.129 Ideally, online patient portal or mobile health apps could synchronize directly to electronic health records or virtual scribes to transfer patient communications into clinical documentation.130 There has been limited success with this approach in European countries131 and with some chronic illness conditions in the United States.74

Electronic health technologies, including mobile health (mHealth) solutions, have improved the self-monitoring and self-management capability of patients with MS via information sharing in patient networks, assistive technologies, smartphone applications, and wearable devices.132,133 A recent study found that communication modes included secure online patient portal use (29%) and email use (21%), and among those who owned tablets or smartphones, 46% used mHealth apps.134 Social media use has been associated with increased peer/social/emotional support and increased access to health information, as well as clinical monitoring and behavior change.134,135 Individuals using mHealth apps are younger, have comorbidities, and have higher socioeconomic and education levels,135,136 suggesting that inequities in mHealth access exist.

 

Burden on People with MS

Questionnaires can be time-consuming and cause mental distress if not appropriately facilitated.137 Decreasing questionnaire length and providing the option for PROMs to be delivered and completed online or outside of the clinic context can reduce burden.138 Additionally, while some people are consistent in sharing their PROs, others struggle with using computers, especially while experiencing severe symptoms, forget to complete PROMs, or simply do not have internet access due to financial or geographic constraints.139 A group of disabled and elderly persons with MS reported barriers to internet use due to visual deficits, small website font sizes, and distracting color schemes.140

Interpretability

Interpreting PROMs and displays of longitudinal PROM data can be a challenge for persons with MS and their clinicians. There is little standardization in how PROMs are scored and presented, and there is often confusion about thresholds for clinical significance and how PROM scores can be compared to other PROMs.141,142 While guidelines exist for implementing PRO scores in clinical settings,126,143 there are few that aid PROM interpretation. As a result, clinicians often seek research evidence for PROMs used in other similar patient populations as a benchmark,142-144 or compare them to other patients seen in their clinical practice.

 

 

Longitudinal PRO data are usually displayed in simple line graphs.145,146 Overall, line graphs have been found to have the highest ease of understanding by both patients and clinicians, but sometimes can be confusing.147 For example, upward trending lines are usually viewed as improvement and downward trending lines as decline; however, upward trending scores on a PROM can indicate decline, such as increasing fatigue severity. Annotation of visual displays can help. Patients and clinicians find that employing thresholds and color coding is useful, and better than “stoplight” red-yellow-green shading schemes or red-circle formats to indicate data that warrant attention.142

Error Risks

PROs are not free of risk for error, especially if they are used independently of other information sources, such as clinical interview, examination, and diagnostic testing, or if they are utilized too frequently, too infrequently, or are duplicated in practice. If a PRO instrument is employed too frequently, score changes may reflect learning effects rather than actual clinical status. Conversely, if used too infrequently, PRO information will not be timely enough to inform real-time clinical practice. Duplication of PRO assessments (eg, multiple measures of the same PRO for the same patient on the same day) or use of multiple PRO measures to assess the same aspect (eg, 2 measures used to assess fatigue) could introduce unnecessary complexity and confusion to interpretation of PRO results.

PRO measures also can be biased or modified by clinical status and/or perceptions of people with MS at the time of assessment. For example, cognitive impairment, whether at baseline state or due to a cognitive MS relapse event, could impact patients’ ability to understand and respond to PRO assessments, producing erroneous results. However, when used appropriately, PROs targeting cognitive dysfunction may be able to detect onset of cognitive events or help to measure recovery from them. Finally, PROs measure perceived (self-reported) status, which may not be an accurate depiction of actual status.

All of these potential pitfalls support the argument that PROs should be utilized to augment the clinical interview, examination, and diagnostic (objective) testing aspects of comprehensive MS care. In this way, PROs can be correlated with other information sources to deepen the shared understanding of health status between a person with MS and her clinician, increasing the potential to make better treatment decisions and care plans together in partnership.

Value and Cost

National groups such as the Patient-Centered Outcomes Research Institute (PCORI) are working with regulatory bodies, funding agencies, insurance providers, patient advocacy groups, researchers, providers, and specialty groups to investigate how PROMs can be implemented into value-based health care reforms, including value-based reimbursement.148 However, practical PRO implementation requires considerable time and resources, and many methodological and operational questions must be addressed before widespread adoption and reimbursement for PROMs will be feasible.148,149

 

 

Summary

PROs can generate valuable information about perceived health status, function, quality of life, and experience of care using self-reported sources. Validated PRO assessment tools include PROMs and PREMs. PROs are currently utilized in research settings (especially PROMs) but are also being used in clinical practice, quality improvement initiatives, and population health applications using LHS approaches. PROs have the advantages of empowering and informing persons with MS and clinicians to optimize patient-centered care, improve systems of care, and study population health outcomes. Barriers include PROM validity, reliability, comparability, specificity, interpretability, equity, time, and cost. Generic PROMs and PREMs, and some MS-specific PROMs, can be used for persons with MS. Unfortunately, no PREMs have been developed specifically for persons with MS, and this is an area for future research. With appropriate development and utilization in LHS applications, PROs can inform patient-centered clinical care, system-level improvement initiatives, and population health research, and have the potential to help facilitate coproduction of health care services.

Acknowledgments: The authors thank Ann Cabot, DO, of the MS Specialty Care Program at Concord Hospital and (especially) peer mentors from a peer outreach wellness program for people with MS (who have asked to remain anonymous) for interviews conducted with their permission to inform the case study described in this article. The case study used in this manuscript has been de-identified, with some aspects modified from actual, and the person in the case study is fictitiously named.

Corresponding author: Brant Oliver, PhD, MS, MPH, APRN-BC, Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756; brant.j.oliver@dartmouth.edu.

Financial disclosures: None.

From the Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Hanover, NH (Ms. Manohar and Dr. Oliver), the Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH (Ms. Perkins, Ms. Laurion, and Dr. Oliver), and the Multiple Sclerosis Specialty Care Program, Concord Hospital, Concord, NH (Dr. Oliver).

Abstract

  • Background: Patient-reported outcomes (PROs), including patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs), can be used to assess perceived health status, functioning, quality of life, and experience of care. Complex chronic illnesses such as multiple sclerosis (MS) affect multiple aspects of health, and PROs can be applied in assessment and decision-making in MS care as well as in research pertaining to MS.
  • Objective: To provide a general review of PROs, with a specific focus on implications for MS care.
  • Methods: Evidence synthesis of available literature on PROs in MS care.
  • Results: PROs (including PROMs and PREMs) have historically been utilized in research and are now being applied in clinical, improvement, and population health settings using learning health system approaches in many disease populations, including MS. Many challenges complicate the use of PROs in MS care, including reliability, validity, and interpretability of PROMs, as well as feasibility barriers due to time and financial constraints in clinical settings.
  • Conclusion: PROs have the potential to better inform clinical care, empower patient-centered care, inform health care improvement efforts, and create the conditions for coproduction of health care services.

Keywords: PRO; PROM; patient-reported outcome measure; patient-reported experience measure; quality of life; patient-centered care.

Multiple sclerosis (MS) is a disabling, complex, chronic, immune-mediated disorder of the central nervous system (CNS). MS causes inflammatory and degenerative damage in the CNS, which disrupts signaling pathways.1 It is most commonly diagnosed in young adults and affects 2.3 million people worldwide.2 People with MS experience very different disease courses and a wide range of neurological symptoms, including visual, somatic, mental health, sensory, motor, and cognitive problems.1-3 Relapsing-remitting MS, the most common form, affects 85% of those with MS and is characterized by periods of relapse (exacerbation) and remission.1 Other forms of MS (primary progressive and secondary progressive MS) are characterized by progressive deterioration and worsening symptom severity without exacerbations. Disease-modifying therapies (DMTs) can reduce the frequency of exacerbations and disability progression, but unfortunately there is no cure for MS. Treatment is focused on increasing quality of life, minimizing disability, and maximizing wellness.

Patient-reported outcomes (PROs) describe the perceived health status, function, and/or experience of a person as obtained by direct self-report. Patient-reported outcome measures (PROMs) are validated PROs that can be used to inform clinical care,4 and have demonstrated effectiveness in improving patient-provider communication and decision-making.5-7 PROMs are currently used in some MS clinical trials to determine the impact of experimental interventions,8-10 and are also being used to inform and improve clinical care in some settings. Especially for persons with MS, they can provide individualized perspectives about health experience and outcomes.11 In more advanced applications, PROMs can be used to improve face-to-face collaborations between clinicians and patients and to inform patient-centered systems of care.12-14 PROMs can also be used to inform systems-level improvement for entire patient populations.15,16

In this article, we review current applications of PROs and PROMs in the care of persons with MS, as well as current limitations and barriers to their use.

CASE STUDY

Marion is a 26-year-old woman who first developed MS symptoms at age 16, including increased sensitivity to heat, blurry vision, and numbness in her legs (note: this case was developed based on interviews with persons with MS, obtained with appropriate consents, and does not represent a specific patient). At that time, her clinician attributed her symptoms to a car accident she had been in a few months before. Later, at age 20, she developed abdominal paresthesia, which her clinician attributed to an episode of shingles. At age 23, she developed double vision. She was evaluated by a neurologist and was diagnosed with MS. Marion started care with an MS specialists, who worked with her towards her goals of having a family, working, and exercising. In addition to appropriate medical care, she started martial arts training and biking for exercise and transitioned to a consulting position with flexible hours and the ability to work from home. Her daughter was born a year later.

 

 

At a recent visit to her neurologist, Marion reviews her health diary, in which she has been tracking her fatigue levels throughout the day and when she has to visit the bathroom. The PRO diary also helps her remember details that she might not otherwise be able to recall at the time of her clinic visit. They review the diary entrees together to develop a shared understanding of what Marion has been experiencing and identify trends in the PRO data. They discuss symptom management and use the PRO information from the diary to help guide adjustments to her physical therapy routine and medication regimen.

Part of Marion’s “PRO package” includes the Center for Epidemiologic Studies Depression Scale (CES-D), a validated depression screening and symptom severity questionnaire that she completes every 3 months. Although she denies being depressed, she has noticed that her CES-D scores in recent months have been consistently increasing. This prompts a discussion about mental health in MS and a referral to work on depression with the MS mental health specialist. Marion and the mental health specialist use CES-D measures at baseline and during treatment to set a remission target and to track progress during treatment. Marion finds this helpful because she says it is hard for her to “wrap my hands around depression… it’s not something that there is a blood test or a MRI for.” Marion is encouraged by being able to see her CES-D scores change as her depression severity decreases, and this helps motivate her to keep engaged in treatment.

PROs and PROMs: General Applications

PROs are measures obtained directly from an individual without a priori interpretation by a clinician.9,17 PROs capture individual perspectives on symptoms, capability, disability, and health-related quality of life.9 With increasing emphasis on patient-centered care,18 individual perspectives and preferences elicited using PROMs may be able to inform better quality of care and patient-centered disease treatment and management.19-21

PROMs are standardized, validated questionnaires used to assess PROs and can be generic or condition-specific. Generic PROMs can be used in any patient population. The SF-3622 is a set of quality of life measures that assess perceived ability to complete physical tasks and routine activities, general health status, fatigue, social functioning, pain, and emotional and mental health.23 Condition-specific PROMs can be used for particular patient populations and are helpful in identifying changes in health status for a specific disease, disability, or surgery. For example, the PDQ-39 assesses 8 dimensions of daily living, functioning, and well-being for people with Parkinson’s disease.24

PROMs have been used in some MS clinical trials and research studies to determine the effectiveness of experimental treatments from the viewpoint of study participants.9,25,26 PROs can also be utilized in clinical care to facilitate communication of needs and track health outcomes,27 and can inform improvement in outcomes for health systems and populations. They can also be used to assess experience of care,28 encouraging a focus on high-quality outcomes through PRO-connected reimbursement mechanisms,29 and provide aggregate data to evaluate clinical practice, population health outcomes, and the effectiveness of public policies.27

 

 

Patient-reported experience measures (PREMs) assess patient satisfaction and experience of health care.30,31 CollaboRATE32 is a PREM that assesses the degree of shared decision-making occurring between patients and clinicians during clinical care. PREMs are currently used for assessing self-efficacy and in shared decision-making and health care improvement applications. PREMs have yet to be developed specifically for persons with MS.

PROMs in MS Care

Generic PROMs have shown that persons with MS are disproportionately burdened by poor quality of life.33-35 Other generic PROMs, like the SF-36,36 the Sickness Impact Profile,37 and versions of the Health Utilities Index,38 can be used to gather information on dysfunction and to determine quality and duration of life modified by MS-related dysfunction and disability. MS-specific PROMs are used to assess MS impairments, including pain, fatigue, cognition, sexual dysfunction, and depression.12,39-42 PROMs have also been used in MS clinical trials, including the Multiple Sclerosis Impact Scale-29 (MSIS-29),43,44 the Leeds MS QoL (LMSQoL),45,46 the Functional Assessment of MS (FAMS),47 the Hamburg Quality of Life Questionnaire in MS (HAQUAMS),48 the MS Quality of Life-54 (MSQoL-54),49 the MS International QoL (MUSIQoL),50 and the Patient-Reported Indices for MS Activity Limitations Scale (PRIMUS).51

Condition-specific PROMs are more sensitive to changes in health status and functioning for persons with MS compared to generic PROMs. They are also more reliable during MS remission and relapse periods.44,52 For example, the SF-36 has floor and ceiling effects in MS populations—a high proportion of persons with MS are scored at the maximum or minimum levels of the scale, limiting discriminant capability.22 As a result, a “combined approach” using both generic and MS-specific measures is often recommended.53 Some MS PROMs (eg, MSQoL-54) include generic questions found in the SF-36 as well as additional MS-specific questions or scales.

The variety of PROMs available (see Table for a selected listing) introduces a significant challenge to using them—limited generalizability and difficulty comparing PROs across MS studies. Efforts to establish common PROMs have been undertaken to address this problem.54 The National Institute of Neurologicical Disorders and Stroke (NINDS) sponsored the development of a neurological quality of life battery, the Neuro-QOL.55 Neuro-QOL measures the physical, mental, and social effects of neurological conditions in adults and children with neurological disorders and has the capability to facilitate comparisons across different neurological conditions. Additionally, the Patient-Reported Outcomes Measure Information System (PROMIS) has been developed to assess physical, mental, and social effects of chronic disease. PROMIS has a hybrid design that includes generic and MS-specific measures (such as PROMIS FatigueMS).56 PROMIS can be used to assess persons with MS as well as to compare the MS population with other populations with chronic illness.

Selected PROMs and PREMs

PROMs have varying levels of reliability and validity. The Evaluating the Measure of Patient-Reported Outcomes57 study evaluated the development process of MS PROMs,43 and found that the MSIS-29 and LMSQoL had the highest overall reliability among the most common MS PROMs. However, both scored poorly on validity due to lack of patient involvement during development. This questions the overall capability of existing MS PROMs to accurately and consistently assess PROs in persons with MS.

 

 

“Feed-Forward” PROMs

Oliver and colleagues16 have described “feed-forward” PROM applications in MS care in a community hospital setting using a learning health system approach. This MS clinic uses feed-forward PROs to inform clinical care—PRO data are gathered before the clinic visit and analyzed ahead of or during the clinic visit by the clinician. Patients are asked to arrive early and complete a questionnaire comprised of PROMs measuring disability, functioning, quality of life, cognitive ability, pain, fatigue, sleep quality, anxiety, and depression. Clinicians score the PROMs and input scores into the electronic health record before the clinical encounter. During the clinic visit, PROM data is visually displayed so that the clinician and patient can discuss results and use the data to better inform decision-making. The visual data display contains longitudinal information, displaying trends in health status across multiple domains, and includes specified thresholds for clinically active symptom levels (Figure).16 Longitudinal monitoring of PROM data allows for real-time assessment of goal-related progress throughout treatment. As illustrated previously by Marion’s case study, the use of real-time feed-forward PROM data can strengthen the partnership between patient and clinician as well as improve empowerment, engagement, self-monitoring, and adherence.

Visual display of patient-reported outcome measures in ellectronic health record. Dotted lines represent threshold levels selected for clinically significant symptom severity for each measure.

PRO Dashboards

Performance dashboards are increasingly used in health care to visually display clinical and PRO data for individual patients, systems, and populations over time. Dashboards display a parsimonious group of critically important measures to give clinicians and patients a longitudinal view of PRO status. They can inform decision-making in clinical care, operations, health care improvement efforts, and population health initiatives.58 Effective dashboards allow for user customization with meaningful measures, knowledge discovery for analysis of health problems, accessibility of health information, clear visualization, alerts for unexpected data values, and system connectivity.59,60 Appropriate development of PRO dashboards requires meaningful patient and clinician involvement via focus groups and key informant interviews, Delphi process approaches to prioritize and finalize selection of priority measures, iterative building of the interface with design input from key informants and stakeholders (co-design), and pilot testing to assess feasibility and acceptability of use.61-63

Other Applications of PROs/PROMs in MS

Learning Health Systems

The National Quality Forum (NQF) and the Centers for Medicaid and Medicare Services have adopted PROs for use in quality measurement.64-66 This includes a movement towards the use of LHS, defined as a health system in which information from patients and clinicians is systematically collected and synthesized with external evidence to inform clinical care, improvement, and research.67-70 Often a LHS is undertaken as a collaborative effort between multiple health care centers to improve quality and outcomes of care.70 The MS Continuous Quality Improvement Collaborative (MS-CQI), the first multi-center systems-level health care improvement research collaborative for MS,71 as well as IBD Qorus and the Cystic Fibrosis Care Center Network utilize LHS approaches.72-77

IBD Qorus is a LHS developed by the Crohn’s and Colitis Foundation that uses performance dashboards to better inform clinical care for people with inflammatory bowel disease. It also employs system-level dashboards for performance benchmarking in quality improvement initiatives and aggregate-level dashboards to assess population health status.78,79 MS-CQI uses a LHS approach to inform the improvement of MS care across multiple centers using a comprehensive dashboard, including PROMs, for benchmarking and to monitor system and population health status. MS-CQI collects PROMs using a secure online platform that can be accessed by persons with MS and their clinicians and also includes a journaling feature for collecting qualitative information and for reference and self-monitoring.71

MS Research

PROMs are used in clinical and epidemiological research to evaluate many aspects of MS, including the FAMS, the PDSS, the Fatigue Impact Scale (FIS), and others.80-82 For example, the PROMIS FatigueMS and the Fatigue Performance Scale have been used to assess the impact of MS-related fatigue on social participation.83 Generic and MS-specific PROMs have been used to assess pain levels for people with MS,84-87 and multiple MS-specific PROMs, like PRIMUS and MSQoL-54,43 as well as the SF-3639 include pain assessment scales. PROMs have also been used to assess MS-related bladder, bowel, and sexual dysfunction. Urgency, frequency, and incontinence affect up to 75% of patients with MS,88 and many PROMs, such as the LMSQoL, MUSIQoL, and the MSQoL-54, are able to evaluate bladder control and sexual functioning.43,89

 

 

PROMs are employed in MS clinical trials to help assess the tolerability and effectiveness of DMTs.90,91 PROs have been used as secondary endpoints to understand the global experience of a DMT from the patient perspective.92-94 There are 15 FDA-approved DMTs for MS, and clinical trials for 6 of these have used PROMs as an effectiveness end point.54,91,95,96 However, most DMT clinical trials are powered for MRI, relapse rate, or disease progression primary outcomes rather than PROMs, often resulting in underpowered PROM analyses.97 In addition, many PROMs are not appropriate for use in DMT clinical trials.98,99

In order to bridge the gap between clinical research and practice, some industry entities are championing “patient-focused drug development” approaches. The Accelerated Cure Project for MS has launched iConquerMS, which collects PROMs from persons with MS to further PRO research in MS and follows 4700 individuals with MS worldwide.100 In 2018, the American College of Physicians announced a collaboration with an industry partner to share data to inform DMT clinical trials and develop and validate PROMs specifically designed for DMT clinical trials.101

Population Health

Registries following large cohorts of people with MS have the potential to develop knowledge about disease progression, treatment patterns, and outcomes.102 The Swedish EIMS study has identified associations between pre-disease body mass index and MS prognosis,102 alcohol and tobacco consumption affecting MS risk,103,104 and exposure to shift work at a young age and increased MS risk.105 The North American Research Committee on MS83,106,107 and iConquerMS registries are “PROM-driven” and have been useful in identifying reductions in disease progression in people using DMTs.107,108 The New York State MS Consortium has identified important demographic characteristics that influence MS progression.109,110 PROs can also be used to determine risk of MS-related mortality111 and decline in quality of life.112,113 Limitations of these approaches include use of different PROMs, inconsistencies in data collection processes, and different follow-up intervals used across registries.102

 

Patient-Centered Care

The Institute of Medicine defines patient-centeredness as “care that is respectful and responsive to individual patient preferences, needs, and values and ensures that patient values guide all clinical decisions.”114 PROs are useful for identifying a patient’s individual health concerns and preferences, something that is needed when treating a highly variable chronic health condition like MS. The use of PROs can help clinicicans visualize the lived experience of persons with MS and identify personal preferences,115 as well as improve self-monitoring, self-management, self-efficacy, adherence, wellness, and coping ability.116 At the system level, PROs can inform improvement initiatives and patient-centered care design efforts.117-120

Selecting PROMs

Initiatives from groups like the COnsensus-based Standards for the Selection of health Measurement INstruments (COSMIN)121 and the International Society for Quality of Life Research (ISOQOL)108 offer guidance on selecting PROs. The NINDS has promoted common data collection between clinical studies of the brain and nervous system.122 General guidance from these sources recommends first considering the outcome and target population, selecting PROMs to measure the outcome through a synthesis of the available evidence, assessing validity and reliability of selected PROMs, and using standard measures that can be compared across studies or populations.108,121 Other factors include feasibility, acceptability, and burden of use for patients, clinicians, and systems, as well as literacy, cultural, and linguistic factors.123

 

 

The NQF recommends that consideration be given to individual patient needs, insurance factors, clinical setting constraints, and available resources when selecting PROMs.124 To maximize response rate, PROMs that are sensitive, reliable, valid, and developed in a comparative demographic of patients are advised.125 ISOQOL has released a User’s Guide and several companion guides on implementing and utilizing PROMs.108,126,127 Finally, PRO-Performance Measures (PRO-PMs) are sometimes used to assess whether PROMs are appropriately contributing to performance improvement and accountability.124

The Cons of PROs

Time and Software Constraints

PROs can disrupt busy clinical care environments and overextend clinical staff.125 Online collection of PROs outside of clinical encounters can relieve PRO-related burden, but this requires finding and funding appropriate secure online networks to effectively collect PROs.128 In 2015, only 60% of people seen for primary care visits could access or view their records online, and of those, only 57% used messaging for medical questions or concerns.129 Ideally, online patient portal or mobile health apps could synchronize directly to electronic health records or virtual scribes to transfer patient communications into clinical documentation.130 There has been limited success with this approach in European countries131 and with some chronic illness conditions in the United States.74

Electronic health technologies, including mobile health (mHealth) solutions, have improved the self-monitoring and self-management capability of patients with MS via information sharing in patient networks, assistive technologies, smartphone applications, and wearable devices.132,133 A recent study found that communication modes included secure online patient portal use (29%) and email use (21%), and among those who owned tablets or smartphones, 46% used mHealth apps.134 Social media use has been associated with increased peer/social/emotional support and increased access to health information, as well as clinical monitoring and behavior change.134,135 Individuals using mHealth apps are younger, have comorbidities, and have higher socioeconomic and education levels,135,136 suggesting that inequities in mHealth access exist.

 

Burden on People with MS

Questionnaires can be time-consuming and cause mental distress if not appropriately facilitated.137 Decreasing questionnaire length and providing the option for PROMs to be delivered and completed online or outside of the clinic context can reduce burden.138 Additionally, while some people are consistent in sharing their PROs, others struggle with using computers, especially while experiencing severe symptoms, forget to complete PROMs, or simply do not have internet access due to financial or geographic constraints.139 A group of disabled and elderly persons with MS reported barriers to internet use due to visual deficits, small website font sizes, and distracting color schemes.140

Interpretability

Interpreting PROMs and displays of longitudinal PROM data can be a challenge for persons with MS and their clinicians. There is little standardization in how PROMs are scored and presented, and there is often confusion about thresholds for clinical significance and how PROM scores can be compared to other PROMs.141,142 While guidelines exist for implementing PRO scores in clinical settings,126,143 there are few that aid PROM interpretation. As a result, clinicians often seek research evidence for PROMs used in other similar patient populations as a benchmark,142-144 or compare them to other patients seen in their clinical practice.

 

 

Longitudinal PRO data are usually displayed in simple line graphs.145,146 Overall, line graphs have been found to have the highest ease of understanding by both patients and clinicians, but sometimes can be confusing.147 For example, upward trending lines are usually viewed as improvement and downward trending lines as decline; however, upward trending scores on a PROM can indicate decline, such as increasing fatigue severity. Annotation of visual displays can help. Patients and clinicians find that employing thresholds and color coding is useful, and better than “stoplight” red-yellow-green shading schemes or red-circle formats to indicate data that warrant attention.142

Error Risks

PROs are not free of risk for error, especially if they are used independently of other information sources, such as clinical interview, examination, and diagnostic testing, or if they are utilized too frequently, too infrequently, or are duplicated in practice. If a PRO instrument is employed too frequently, score changes may reflect learning effects rather than actual clinical status. Conversely, if used too infrequently, PRO information will not be timely enough to inform real-time clinical practice. Duplication of PRO assessments (eg, multiple measures of the same PRO for the same patient on the same day) or use of multiple PRO measures to assess the same aspect (eg, 2 measures used to assess fatigue) could introduce unnecessary complexity and confusion to interpretation of PRO results.

PRO measures also can be biased or modified by clinical status and/or perceptions of people with MS at the time of assessment. For example, cognitive impairment, whether at baseline state or due to a cognitive MS relapse event, could impact patients’ ability to understand and respond to PRO assessments, producing erroneous results. However, when used appropriately, PROs targeting cognitive dysfunction may be able to detect onset of cognitive events or help to measure recovery from them. Finally, PROs measure perceived (self-reported) status, which may not be an accurate depiction of actual status.

All of these potential pitfalls support the argument that PROs should be utilized to augment the clinical interview, examination, and diagnostic (objective) testing aspects of comprehensive MS care. In this way, PROs can be correlated with other information sources to deepen the shared understanding of health status between a person with MS and her clinician, increasing the potential to make better treatment decisions and care plans together in partnership.

Value and Cost

National groups such as the Patient-Centered Outcomes Research Institute (PCORI) are working with regulatory bodies, funding agencies, insurance providers, patient advocacy groups, researchers, providers, and specialty groups to investigate how PROMs can be implemented into value-based health care reforms, including value-based reimbursement.148 However, practical PRO implementation requires considerable time and resources, and many methodological and operational questions must be addressed before widespread adoption and reimbursement for PROMs will be feasible.148,149

 

 

Summary

PROs can generate valuable information about perceived health status, function, quality of life, and experience of care using self-reported sources. Validated PRO assessment tools include PROMs and PREMs. PROs are currently utilized in research settings (especially PROMs) but are also being used in clinical practice, quality improvement initiatives, and population health applications using LHS approaches. PROs have the advantages of empowering and informing persons with MS and clinicians to optimize patient-centered care, improve systems of care, and study population health outcomes. Barriers include PROM validity, reliability, comparability, specificity, interpretability, equity, time, and cost. Generic PROMs and PREMs, and some MS-specific PROMs, can be used for persons with MS. Unfortunately, no PREMs have been developed specifically for persons with MS, and this is an area for future research. With appropriate development and utilization in LHS applications, PROs can inform patient-centered clinical care, system-level improvement initiatives, and population health research, and have the potential to help facilitate coproduction of health care services.

Acknowledgments: The authors thank Ann Cabot, DO, of the MS Specialty Care Program at Concord Hospital and (especially) peer mentors from a peer outreach wellness program for people with MS (who have asked to remain anonymous) for interviews conducted with their permission to inform the case study described in this article. The case study used in this manuscript has been de-identified, with some aspects modified from actual, and the person in the case study is fictitiously named.

Corresponding author: Brant Oliver, PhD, MS, MPH, APRN-BC, Department of Community & Family Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756; brant.j.oliver@dartmouth.edu.

Financial disclosures: None.

References

1. Goldenberg MM. Multiple sclerosis review. PT. 2012;37:175-184.

2. Doshi A, Chataway J. Multiple sclerosis, a treatable disease. Clin Med. 2016;16(Suppl 6):s53-s9.

3. Perrin Ross A. Management of multiple sclerosis. Am J Managed Care. 2013;19(16 Suppl):s301-s306.

4. Batalden M, Batalden P, Margolis P, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25:509-517.

5. Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.

6. Knaup C, Koesters M, Schoefer D, et al. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatr. 2009;195:15-22.

7. Dudgeon D. The impact of measuring patient-reported outcome measures on quality of and access to palliative care. J Palliat Med. 2018;21(S1):S76-s80.

8. Snyder CF, Herman JM, White SM, et al. When using patient-reported outcomes in clinical practice, the measure matters: a randomized controlled trial. J Oncol Pract. 2014;10:e299-e306.

9. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.

10. de Jong MJ, Huibregtse R, Masclee AAM, et al. Patient-reported outcome measures for use in clinical trials and clinical practice in inflammatory bowel diseases: a systematic review. Clin Gastroenterol Hepatol. 2018;16:648-663.

11. Roman D, Osborne-Stafsnes J, Amy CH, et al. Early lessons from four ‘aligning forces for quality’ communities bolster the case for patient-centered care. Health Affairs. 2013;32:232-241.

12. Ehde DM, Alschuler KN, Sullivan MD, et al. Improving the quality of depression and pain care in multiple sclerosis using collaborative care: The MS-care trial protocol. Contemporary Clinical Trials. 2018;64:219-229.

13. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

14. Schick-Makaroff K, Thummapol O, Thompson S, et al. Strategies for incorporating patient-reported outcomes in the care of people with chronic kidney disease (PRO kidney): a protocol for a realist synthesis. Clin Gastroenterol Hepatol. 2018;16:648-663.

15. Nelson EC, Dixon-Woods M, Batalden PB, et al. Patient focused registries can improve health, care, and science. BMJ. 2016;354:i3319.

16. Oliver BJ, Nelson EC, Kerrigan CL. Turning feed-forward and feedback processes on patient-reported data into intelligent action and informed decision-making: case studies and principles. Med Care. 2019;57 Suppl 1:S31-s37.

17. Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: A new era in clinical research. Perspect Clin Res. 2011;2:137-144.

18. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9:100-103.

19. Payne SA. A study of quality of life in cancer patients receiving palliative chemotherapy. Soc Sci Med. 1992;35:1505-1509.

20. Borgaonkar MR, Irvine EJ. Quality of life measurement in gastrointestinal and liver disorders. Gut. 2000;47:444-454.

21. Macdonell R, Nagels G, Laplaud DA, et al. Improved patient-reported health impact of multiple sclerosis: The ENABLE study of PR-fampridine. Multiple Sclerosis. 2016;22:944-954.

22. Hobart J, Freeman J, Lamping D, et al. The SF-36 in multiple sclerosis: why basic assumptions must be tested. J Neurol Neurosurg Psychiatry. 2001;71:363-370.

23. Lins L, Carvalho FM. SF-36 total score as a single measure of health-related quality of life: Scoping review. SAGE Open Med. 2016;4:2050312116671725.

24. Parkinson’s Disease Society of the United Kingdom. The Parkinson’s Disease Questionnaire (PDQ-39). https://www.parkinsons.org.uk/professionals/resources/parkinsons-disease-questionnaire-pdq-39. Accessed October 20, 2019.

25. Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362:865-869.

26. Calvert M, Brundage M, Jacobsen PB, et al. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes. 2013;11:184.

27. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

28. Franks P, Fiscella K, Shields CG, et al. Are patients’ ratings of their physicians related to health outcomes? Ann Fam Med. 2005;3:229-234.

29. Hostetter M, Klein S. Using patient-reported outcomes to improve health care quality. The Commonwealth Fund 2019. www.commonwealthfund.org/publications/newsletter-article/using-patient-reported-outcomes-improve-health-care-quality. Accessed October 24, 2019.

30. Charlotte Kingsley SP. Patient-reported outcome measures and patient-reported experience measures. BJA Education. 2017;17:137-144.

31. Weldring T, Smith SM. Patient-Reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Services Insights. 2013;6:61-68.

32. Elwyn G, Barr PJ, Grande SW, et al. Developing CollaboRATE: A fast and frugal patient-reported measure of shared decision making in clinical encounters. Patient Educ Couns. 2013;93:102-107.

33. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33:1444-1452.

34. Rudick RA, Miller D, Clough JD, et al. Quality of life in multiple sclerosis. Comparison with inflammatory bowel disease and rheumatoid arthritis. Arch Neurol. 1992;49:1237-1242.

35. Benito-Leon J, Morales JM, Rivera-Navarro J, Mitchell A. A review about the impact of multiple sclerosis on health-related quality of life. Disabil Rehabil. 2003;25:1291-1303.

36. RAND Corporation. 36-Item Short Form Survey (SF-36). [https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html. Accessed October 20, 2019.

37. Bergner M, Bobbitt RA, Carter WB, Gilson BS. The sickness impact profile: development and final revision of a health status measure. Medical Care. 1981;19:787-805.

38. Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1:54.

39. Kinkel RP, Laforet G, You X. Disease-related determinants of quality of life 10 years after clinically isolated syndrome. Int J MS Care. 2015;17:26-34.

40. Baumstarck-Barrau K, Simeoni MC, Reuter F, et al. Cognitive function and quality of life in multiple sclerosis patients: a cross-sectional study. BMC Neurology. 2011;11:17.

41. Samartzis L, Gavala E, Zoukos Y, et al. Perceived cognitive decline in multiple sclerosis impacts quality of life independently of depression. Rehabil Res Pract. 2014;2014:128751.

42. Vitkova M, Rosenberger J, Krokavcova M, et al. Health-related quality of life in multiple sclerosis patients with bladder, bowel and sexual dysfunction. Disabil Rehabil. 2014;36:987-992.

43. Khurana V, Sharma H, Afroz N, et al. Patient-reported outcomes in multiple sclerosis: a systematic comparison of available measures. Eur J Neurol. 2017;24:1099-1107.

44. Hobart J, Lamping D, Fitzpatrick R, et al. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(Pt 5):962-973.

45. Lily O, McFadden E, Hensor E, et al. Disease-specific quality of life in multiple sclerosis: the effect of disease modifying treatment. Multiple Sclerosis. 2006;12:808-813.

46. Ford HL, Gerry E, Tennant A, et al. Developing a disease-specific quality of life measure for people with multiple sclerosis. Clin Rehabil. 2001;15:247-258.

47. Cella DF, Dineen K, Arnason B, et al. Validation of the functional assessment of multiple sclerosis quality of life instrument. Neurology. 1996;47:129-139.

48. Gold SM, Heesen C, Schulz H, et al. Disease specific quality of life instruments in multiple sclerosis: validation of the Hamburg Quality of Life Questionnaire in Multiple Sclerosis (HAQUAMS). Multiple Sclerosis. 2001;7:119-130.

49. Vickrey BG, Hays RD, Harooni R, et al. A health-related quality of life measure for multiple sclerosis. Qual Life Res. 1995;4:187-206.

50. Simeoni M, Auquier P, Fernandez O, et al. Validation of the Multiple Sclerosis International Quality of Life questionnaire. Multiple Sclerosis. 2008;14:219-230.

51. Doward LC, McKenna SP, Meads DM, et al. The development of patient-reported outcome indices for multiple sclerosis (PRIMUS). Multiple Sclerosis. 2009;15:1092-1102.

52. Ozakbas S, Akdede BB, Kosehasanogullari G, et al. Difference between generic and multiple sclerosis-specific quality of life instruments regarding the assessment of treatment efficacy. J Neurol Sci. 2007;256:30-34.

53. Cella DF, Wiklund I, Shumaker SA, Aaronson NK. Integrating health-related quality of life into cross-national clinical trials. Qual Life Res. 1993;2:433-440.

54. Nowinski CJ, Miller DM, Cella D. Evolution of patient-reported outcomes and their role in multiple sclerosis clinical trials. Neurotherapeutics. 2017;14:934-944.

55. Cella D, Nowinski C, Peterman A, et al. The neurology quality-of-life measurement initiative. Arch Phys Med Rehabil. 2011;92(10 Suppl):S28-S36.

56. HealthMeasures: PROMIS. http://www.healthmeasures.net/explore-measurement-systems/promis. Accessed October 20, 2019.

57. Valderas JM, Ferrer M, Mendivil J, et al. Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures. Value Health. 2008;11:700-708.

58. Bach K, Martling C, Mork PJ, et al. Design of a clinician dashboard to facilitate co-decision making in the management of non-specific low back pain. J Intelligent Helath Syst. 2019;52:269-284.

59. Karami M, Safdari R, Rahimi A. Effective radiology dashboards: key research findings. Radiology Management. 2013;35:42-45.

60. Dowding D, Randell R, Gardner P, et al. Dashboards for improving patient care: review of the literature. Int J Med Informatic. 2015;84:87-100.

61. Mlaver E, Schnipper JL, Boxer RB, et al. User-centered collaborative design and development of an inpatient safety dashboard. Jt Comm J Qual Patient Saf. 2017;43:676-685.

62. Dowding D, Merrill J, Russell D. Using feedback intervention theory to guide clinical dashboard design. AMIA Annu Symp Proc. 2018;2018:395-403.

63. Hartzler AL, Izard JP, Dalkin BL, et al. Design and feasibility of integrating personalized PRO dashboards into prostate cancer care. J Am Med Inform Assoc. 2016;23:38-47.

64. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

65. U.S. Centers for Medicare & Medicaid Services. Comprehensive Care for Joint Replacement Model. https://innovation.cms.gov/initiatives/CJR. Accessed August 3, 2019.

66. National Quality Forum. Patient-reported outcomes: Accessed August 3, 2019. http://www.qualityforum.org/Patient-Reported_Outcomes.aspx. Accessed October 20, 2019.

67. Institute of Medicine Roundtable on Evidence-Based Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Olsen LA, Aisner D, McGinnis JM, eds. The Learning Healthcare System: Workshop Summary. Washington (DC): National Academies Press (US).National Academy of Sciences; 2007.

68. About Learning Health Systems: Agency for Healthcare Research and Quality. https://www.ahrq.gov/learning-health-systems/about.html. Accessed August 3, 2019.

69. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington (DC): National Academies Press; 2013.

70. Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.

71. Oliver BJ, for the MS-CQI Investigators. The Multiple Sclerosis Continuous improvement collaborative: the first coproduction learning health system improvement science research collaborative for multiple sclerosis. The International Society for Quality in Health Care (ISQua) Annual International Conference; October 2019; Cape Town, South Africa.

72. Britto MT, Fuller SC, Kaplan HC, et al. Using a network organisational architecture to support the development of Learning Healthcare Systems. BMJ Qual Saf. 2018;27:937-946.

73. Care Centers: Cystic Fibrosis Foundation. https://www.cff.org/Care/Care-Centers/. Accessed August 3, 2019.

74. Schechter MS, Fink AK, Homa K, Goss CH. The Cystic Fibrosis Foundation patient registry as a tool for use in quality improvement. BMJ Qual Saf. 2014;23(Suppl 1):i9-i14.

75. Mogayzel PJ, Dunitz J, Marrow LC, Hazle LA. Improving chronic care delivery and outcomes: the impact of the cystic fibrosis Care Center Network. BMJ Qual Saf. 2014;23(Suppl 1):i3-i8.

76. Godfrey MM, Oliver BJ. Accelerating the rate of improvement in cystic fibrosis care: contributions and insights of the learning and leadership collaborative. BMJ Qual Saf. 2014;23(Suppl 1):i23-i32.

77. Nelson EC, Godfrey MM. Quality by Design: A Clinical Microsystems Approach. San Francisco, California: Jossey-Bass; 2007.

78. Crohn’s & Colitis Foundation.Quality of Care: IBD Qorus: https://www.crohnscolitisfoundation.org/research/ibd-qorus. Accessed October 23, 2019.

79. Johnson LC, Melmed GY, Nelson EC, et al. Fostering collaboration through creation of an ibd learning health system. Am J Gastroenterol. 2017;112:406-468.

80. Fernandez-Munoz JJ, Moron-Verdasco A, Cigaran-Mendez M, et al. Disability, quality of life, personality, cognitive and psychological variables associated with fatigue in patients with multiple sclerosis. Acta Neurologica Scandinavica. 2015;132:118-124.

81. Flachenecker P, Kumpfel T, Kallmann B, et al. Fatigue in multiple sclerosis: a comparison of different rating scales and correlation to clinical parameters. Multiple Sclerosis. 2002;8:523-526.

82. Tellez N, Rio J, Tintore M, et al. Does the Modified Fatigue Impact Scale offer a more comprehensive assessment of fatigue in MS? Multiple Sclerosis. 2005;11:198-202.

83. Salter A, Fox RJ, Tyry T, et al. The association of fatigue and social participation in multiple sclerosis as assessed using two different instruments. Mult Scler Relat Disord. 2019;31:165-72.

84. Solaro C, Trabucco E, Messmer Uccelli M. Pain and multiple sclerosis: pathophysiology and treatment. Curr Neurol Neurosci Rep. 2013;13:320.

85. Jawahar R, Oh U, Yang S, Lapane KL. A systematic review of pharmacological pain management in multiple sclerosis. Drugs. 2013;73:1711-1722.

86. Rintala A, Hakkinen A, Paltamaa J. Ten-year follow-up of health-related quality of life among ambulatory persons with multiple sclerosis at baseline. Qual Life Res. 2016;25:3119-3127.

87. Tepavcevic DK, Pekmezovic T, Stojsavljevic N, et al. Change in quality of life and predictors of change among patients with multiple sclerosis: a prospective cohort study. Qual Life Res. 2014;23:1027-1037.

88. DasGupta R, Fowler CJ. Bladder, bowel and sexual dysfunction in multiple sclerosis: management strategies. Drugs. 2003;63:153-166.

89. Marck CH, Jelinek PL, Weiland TJ, et al. Sexual function in multiple sclerosis and associations with demographic, disease and lifestyle characteristics: an international cross-sectional study. BMC Neurology. 2016;16:210.

90. Gajofatto A, Benedetti MD. Treatment strategies for multiple sclerosis: When to start, when to change, when to stop? World J Clinical Cases. 2015;3:545-555.

91. National Multiple Sclerosis Society. Disease-modifying therapies for MS. 2018.

92. Rudick RA, Panzara MA. Natalizumab for the treatment of relapsing multiple sclerosis. Biologics. 2008;2:189-199.

93. Cohen JA, Cutter GR, Fischer JS, et al. Benefit of interferon beta-1a on MSFC progression in secondary progressive MS. Neurology. 2002;59:679-687.

94. Patti F, Pappalardo A, Montanari E, et al. Interferon-beta-1a treatment has a positive effect on quality of life of relapsing-remitting multiple sclerosis: results from a longitudinal study. J Neurol Sci. 2014;337:180-185.

95. Novartis. Exploring the efficacy and safety of Siponimod in patients with secondary progressive multiple sclerosis (EXPAND). Available from clinicaltrials.gov/ct2/show/NCT01665144. NLM identifier: NCT01665144.

96. Singal AG, Higgins PD, Waljee AK. A primer on effectiveness and efficacy trials. Clin Transl Gastroenterol. 2014;5:e45.

97. Jongen PJ. Health-related quality of life in patients with multiple sclerosis: impact of disease-modifying drugs. CNS Drugs. 2017;31:585-602.

98. Coretti S, Ruggeri M, McNamee P. The minimum clinically important difference for EQ-5D index: a critical review. Expert Rev Pharmacoecon Outcomes Res. 2014;14:221-233.

99. Clinical Review Report: Ocrelizumab (Ocrevus). CADTH Common Drug Review. 2018:Appendix 4, Validity of Outcome Measures.

100. iCounquer MS; Empowering patients: how individuals with ms are contributing to the fight to find a cure: 2018. https://www.iconquerms.org/empowering-patients-how-individuals-ms-are-contributing-fight-find-cure. Accessed October 23, 2019.

101. K M. Accelerated Cure Project Announces Collaboration with EMD Serono to Advance Patient-Focused Drug Development in Multiple Sclerosis2018. https://www.iconquerms.org/accelerated-cure-project-announces-collaboration-emd-serono-advance-patient-focused-drug-development. Accessed October 24, 2019.

102. Bebo BF Jr, Fox RJ, Lee K, et al. Landscape of MS patient cohorts and registries: Recommendations for maximizing impact. Multiple Sclerosis. 2018;24:579-586.

103. Hedstrom AK, Hillert J, Olsson T, Alfredsson L. Alcohol as a modifiable lifestyle factor affecting multiple sclerosis risk. JAMA Neurology. 2014;71:300-305.

104. Hedstrom AK, Baarnhielm M, Olsson T, Alfredsson L. Tobacco smoking, but not Swedish snuff use, increases the risk of multiple sclerosis. Neurology. 2009;73:696-701.

105. Hedstrom AK, Akerstedt T, Hillert J, et al. Shift work at young age is associated with increased risk for multiple sclerosis. Ann Neurol. 2011;70:733-741.

106. Hadjimichael O, Vollmer T, Oleen-Burkey M. Fatigue characteristics in multiple sclerosis: the North American Research Committee on Multiple Sclerosis (NARCOMS) survey. Health Qual Life Outcomes. 2008;6:100.

107. Fox RJ, Salter AR, Tyry T, et al. Treatment discontinuation and disease progression with injectable disease-modifying therapies: findings from the North American research committee on multiple sclerosis database. Int J MS Care. 2013;15:194-201.

108. Reeve BB, Wyrwich KW, Wu AW, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22:1889-1905.

109. Jacobs LD, Wende KE, Brownscheidle CM, et al. A profile of multiple sclerosis: the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 1999;5:369-376.

110. Weinstock-Guttman B, Jacobs LD, Brownscheidle CM, et al. Multiple sclerosis characteristics in African American patients in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2003;9:293-298.

111. Raffel J, Wallace A, Gveric D, et al. Patient-reported outcomes and survival in multiple sclerosis: A 10-year retrospective cohort study using the Multiple Sclerosis Impact Scale-29. PLoS Med. 2017;14:e1002346.

112. Vaughn CB, Kavak KS, Dwyer MG, et al. Fatigue at enrollment predicts EDSS worsening in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2018:1352458518816619.

113. Alroughani RA, Akhtar S, Ahmed SF, Al-Hashel JY. Clinical predictors of disease progression in multiple sclerosis patients with relapsing onset in a nation-wide cohort. Int J Neuroscience. 2015;125:831-837.

114. Dolan JG, Veazie PJ, Russ AJ. Development and initial evaluation of a treatment decision dashboard. BMC Med Inform Decision Mak. 2013;13:51.

115. Stuifbergen AK, Becker H, Blozis S, et al. A randomized clinical trial of a wellness intervention for women with multiple sclerosis. Arch Phys Med Rehabil. 2003;84:467-476.

116. Finkelstein J, Martin C, Bhushan A, et al. Feasibility of computer-assisted education in patients with multiple sclerosis. In: Proceedings of the IEEE Symposium on Computer-Based Medical Systems. Bethesda, MD; 2004.

117. Batalden P. Getting more health from healthcare: quality improvement must acknowledge patient coproduction—an essay by Paul Batalden. BMJ. 2018;362:k3617.

118. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Health Care. 2007;16:2-3.

119. Ovretveit J, Zubkoff L, Nelson EC, et al. Using patient-reported outcome measurement to improve patient care. Int J Qual Health Care. 2017;29:874-879.

120. Prodinger B, Taylor P. Improving quality of care through patient-reported outcome measures (PROMs): expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples. BMC Health Services Res. 2018;18:87.

121. Prinsen CA, Vohra S, Rose MR, et al. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” – a practical guideline. Trials. 2016;17:449.

122. NINDS. NINDS Common Data Elements: Streamline Your Neuroscience Clinical Research National Institute of Health. https://www.commondataelements.ninds.nih.gov/#page=Default. Accessed October 23, 2019.

123. Francis DO, McPheeters ML, Noud M, et al. Checklist to operationalize measurement characteristics of patient-reported outcome measures. Systematic Rev. 2016;5:129.

124. National Quality Forum. Patient-reported outcomes (PROs) in performance measurement. 2013. https://www.qualityforum.org/Publications/2012/12/Patient-Reported_Outcomes_in_Performance_Measurement.aspx. Accessed October 15, 2019.

125. Dawson J, Doll H, Fitzpatrick R, et al. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186.

126. Aaronson N ET, Greenlhalgh J, Halyard M, et al. User’s guide to implementation of patient reported outcomes assessment in clinical practice. International Society for Quality of Life. 2015.

127. Chan EKH, Edwards TC, Haywood K, et al. Implementing patient-reported outcomes mesaures in clinical practice: a companion guide to the ISOQOL user’s guide. Qual Life Res. 2018;28:621-627.

128. Snyder CF, Wu AW, Miller RS, et al. The role of informatics in promoting patient-centered care. Cancer J. 2011;17:211-218

129. Osborn R, Moulds D, Schneider EC, et al. Primary care physicians in ten countries report challenges caring for patients with complex health needs. Health Affairs. 2015;34:2104-2112.

130. Wu AW, Kharrazi H, Boulware LE, Snyder CF. Measure once, cut 0wice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research. J Clin Epidemiol. 2013;66(8 Suppl):S12-S20.

131. Trojano M, Bergamaschi R, Amato MP, et al. The Italian multiple sclerosis register. Neurol Sci. 2019;40:155-165.

132. Moorhead SA, Hazlett DE, Harrison L, et al. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res. 2013;15:e85.

133. Luigi L, Francesco B, Marcello M, et al. e-Health and multiple sclerosis: An update. Multiple Sclerosis J. 2018;24:1657-1664.

134. Marrie RA, Leung S, Tyry T, et al. Use of eHealth and mHealth technology by persons with multiple sclerosis. Mult Scler Relat Dis. 2019;27:13-19.

135. Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E. Exploring the specific needs of persons with multiple sclerosis for mhealth solutions for physical activity: mixed-methods study. JMIR Mhealth Uhealth. 2018;6:e37.

136. Spooner KK, Salemi JL, Salihu HM, Zoorob RJ. eHealth patient-provider communication in the United States: interest, inequalities, and predictors. J Am Med Inform Assoc. 2017;24(e1):e18-e27.

137. Safdar N, Abbo LM, Knobloch MJ, Seo SK. Research methods in healthcare epidemiology: survey and qualitative research. Infect Control Hosp Epidemiol. 2016;37:1272-1277.

138. Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101-1108.

139. Chiu C, Bishop M, Pionke JJ, et al. Barriers to the accessibility and continuity of health-care services in people with multiple sclerosis: a literature review. Int J MS Care. 2017;19:313-321.

140. Atreja A, Mehta N, Miller D, et al. One size does not fit all: using qualitative methods to inform the development of an Internet portal for multiple sclerosis patients. AMIA Annu Symp Proc Symp. 2005:16-20.

141. Snyder CF, Blackford AL, Brahmer JR, et al. Needs assessments can identify scores on HRQOL questionnaires that represent problems for patients: an illustration with the Supportive Care Needs Survey and the QLQ-C30. Qual Life Res. 2010;19:837-845.

142. de Vet HC, Terwee CB. The minimal detectable change should not replace the minimal important difference. J Clin Epidemiol. 2010;63:804-805.

143. Snyder CF, Aaronson NK, Choucair AK, et al. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life. 2012;21:1305-1314.

144. Myla DG, Melanie DW, Robert WM, et al. Identification and validation of clinically meaningful benchmarks in the 12-item Multiple Sclerosis Walking Scale. Multiple Sclerosis J. 2017;23:1405-1414.

145. van Munster CEP, Uitdehaag BMJ. Outcome measures in clinical trials for multiple sclerosis. CNS Drugs. 2017;31:217-236.

146. Snyder CF, Jensen R, Courtin SO, Wu AW. PatientViewpoint: a website for patient-reported outcomes assessment. Quality Life Res. 2009;18:793-800.

147. Snyder CF, Smith KC, Bantug ET, et al. What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer. 2017;123:1848-1859.

148. Squitieri L, Bozic KJ, Pusic AL. The role of patient-reported outcome measures in value-based payment reform. Value Health. 2017;20:834-836.

149. Boyce MB, Browne JP. The effectiveness of providing peer benchmarked feedback to hip replacement surgeons based on patient-reported outcome measures—results from the PROFILE trial: a cluster randomised controlled study. BMJ Open. 2015;5:e008325.

References

1. Goldenberg MM. Multiple sclerosis review. PT. 2012;37:175-184.

2. Doshi A, Chataway J. Multiple sclerosis, a treatable disease. Clin Med. 2016;16(Suppl 6):s53-s9.

3. Perrin Ross A. Management of multiple sclerosis. Am J Managed Care. 2013;19(16 Suppl):s301-s306.

4. Batalden M, Batalden P, Margolis P, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25:509-517.

5. Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.

6. Knaup C, Koesters M, Schoefer D, et al. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatr. 2009;195:15-22.

7. Dudgeon D. The impact of measuring patient-reported outcome measures on quality of and access to palliative care. J Palliat Med. 2018;21(S1):S76-s80.

8. Snyder CF, Herman JM, White SM, et al. When using patient-reported outcomes in clinical practice, the measure matters: a randomized controlled trial. J Oncol Pract. 2014;10:e299-e306.

9. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.

10. de Jong MJ, Huibregtse R, Masclee AAM, et al. Patient-reported outcome measures for use in clinical trials and clinical practice in inflammatory bowel diseases: a systematic review. Clin Gastroenterol Hepatol. 2018;16:648-663.

11. Roman D, Osborne-Stafsnes J, Amy CH, et al. Early lessons from four ‘aligning forces for quality’ communities bolster the case for patient-centered care. Health Affairs. 2013;32:232-241.

12. Ehde DM, Alschuler KN, Sullivan MD, et al. Improving the quality of depression and pain care in multiple sclerosis using collaborative care: The MS-care trial protocol. Contemporary Clinical Trials. 2018;64:219-229.

13. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

14. Schick-Makaroff K, Thummapol O, Thompson S, et al. Strategies for incorporating patient-reported outcomes in the care of people with chronic kidney disease (PRO kidney): a protocol for a realist synthesis. Clin Gastroenterol Hepatol. 2018;16:648-663.

15. Nelson EC, Dixon-Woods M, Batalden PB, et al. Patient focused registries can improve health, care, and science. BMJ. 2016;354:i3319.

16. Oliver BJ, Nelson EC, Kerrigan CL. Turning feed-forward and feedback processes on patient-reported data into intelligent action and informed decision-making: case studies and principles. Med Care. 2019;57 Suppl 1:S31-s37.

17. Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: A new era in clinical research. Perspect Clin Res. 2011;2:137-144.

18. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9:100-103.

19. Payne SA. A study of quality of life in cancer patients receiving palliative chemotherapy. Soc Sci Med. 1992;35:1505-1509.

20. Borgaonkar MR, Irvine EJ. Quality of life measurement in gastrointestinal and liver disorders. Gut. 2000;47:444-454.

21. Macdonell R, Nagels G, Laplaud DA, et al. Improved patient-reported health impact of multiple sclerosis: The ENABLE study of PR-fampridine. Multiple Sclerosis. 2016;22:944-954.

22. Hobart J, Freeman J, Lamping D, et al. The SF-36 in multiple sclerosis: why basic assumptions must be tested. J Neurol Neurosurg Psychiatry. 2001;71:363-370.

23. Lins L, Carvalho FM. SF-36 total score as a single measure of health-related quality of life: Scoping review. SAGE Open Med. 2016;4:2050312116671725.

24. Parkinson’s Disease Society of the United Kingdom. The Parkinson’s Disease Questionnaire (PDQ-39). https://www.parkinsons.org.uk/professionals/resources/parkinsons-disease-questionnaire-pdq-39. Accessed October 20, 2019.

25. Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362:865-869.

26. Calvert M, Brundage M, Jacobsen PB, et al. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes. 2013;11:184.

27. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

28. Franks P, Fiscella K, Shields CG, et al. Are patients’ ratings of their physicians related to health outcomes? Ann Fam Med. 2005;3:229-234.

29. Hostetter M, Klein S. Using patient-reported outcomes to improve health care quality. The Commonwealth Fund 2019. www.commonwealthfund.org/publications/newsletter-article/using-patient-reported-outcomes-improve-health-care-quality. Accessed October 24, 2019.

30. Charlotte Kingsley SP. Patient-reported outcome measures and patient-reported experience measures. BJA Education. 2017;17:137-144.

31. Weldring T, Smith SM. Patient-Reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Services Insights. 2013;6:61-68.

32. Elwyn G, Barr PJ, Grande SW, et al. Developing CollaboRATE: A fast and frugal patient-reported measure of shared decision making in clinical encounters. Patient Educ Couns. 2013;93:102-107.

33. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33:1444-1452.

34. Rudick RA, Miller D, Clough JD, et al. Quality of life in multiple sclerosis. Comparison with inflammatory bowel disease and rheumatoid arthritis. Arch Neurol. 1992;49:1237-1242.

35. Benito-Leon J, Morales JM, Rivera-Navarro J, Mitchell A. A review about the impact of multiple sclerosis on health-related quality of life. Disabil Rehabil. 2003;25:1291-1303.

36. RAND Corporation. 36-Item Short Form Survey (SF-36). [https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html. Accessed October 20, 2019.

37. Bergner M, Bobbitt RA, Carter WB, Gilson BS. The sickness impact profile: development and final revision of a health status measure. Medical Care. 1981;19:787-805.

38. Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1:54.

39. Kinkel RP, Laforet G, You X. Disease-related determinants of quality of life 10 years after clinically isolated syndrome. Int J MS Care. 2015;17:26-34.

40. Baumstarck-Barrau K, Simeoni MC, Reuter F, et al. Cognitive function and quality of life in multiple sclerosis patients: a cross-sectional study. BMC Neurology. 2011;11:17.

41. Samartzis L, Gavala E, Zoukos Y, et al. Perceived cognitive decline in multiple sclerosis impacts quality of life independently of depression. Rehabil Res Pract. 2014;2014:128751.

42. Vitkova M, Rosenberger J, Krokavcova M, et al. Health-related quality of life in multiple sclerosis patients with bladder, bowel and sexual dysfunction. Disabil Rehabil. 2014;36:987-992.

43. Khurana V, Sharma H, Afroz N, et al. Patient-reported outcomes in multiple sclerosis: a systematic comparison of available measures. Eur J Neurol. 2017;24:1099-1107.

44. Hobart J, Lamping D, Fitzpatrick R, et al. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(Pt 5):962-973.

45. Lily O, McFadden E, Hensor E, et al. Disease-specific quality of life in multiple sclerosis: the effect of disease modifying treatment. Multiple Sclerosis. 2006;12:808-813.

46. Ford HL, Gerry E, Tennant A, et al. Developing a disease-specific quality of life measure for people with multiple sclerosis. Clin Rehabil. 2001;15:247-258.

47. Cella DF, Dineen K, Arnason B, et al. Validation of the functional assessment of multiple sclerosis quality of life instrument. Neurology. 1996;47:129-139.

48. Gold SM, Heesen C, Schulz H, et al. Disease specific quality of life instruments in multiple sclerosis: validation of the Hamburg Quality of Life Questionnaire in Multiple Sclerosis (HAQUAMS). Multiple Sclerosis. 2001;7:119-130.

49. Vickrey BG, Hays RD, Harooni R, et al. A health-related quality of life measure for multiple sclerosis. Qual Life Res. 1995;4:187-206.

50. Simeoni M, Auquier P, Fernandez O, et al. Validation of the Multiple Sclerosis International Quality of Life questionnaire. Multiple Sclerosis. 2008;14:219-230.

51. Doward LC, McKenna SP, Meads DM, et al. The development of patient-reported outcome indices for multiple sclerosis (PRIMUS). Multiple Sclerosis. 2009;15:1092-1102.

52. Ozakbas S, Akdede BB, Kosehasanogullari G, et al. Difference between generic and multiple sclerosis-specific quality of life instruments regarding the assessment of treatment efficacy. J Neurol Sci. 2007;256:30-34.

53. Cella DF, Wiklund I, Shumaker SA, Aaronson NK. Integrating health-related quality of life into cross-national clinical trials. Qual Life Res. 1993;2:433-440.

54. Nowinski CJ, Miller DM, Cella D. Evolution of patient-reported outcomes and their role in multiple sclerosis clinical trials. Neurotherapeutics. 2017;14:934-944.

55. Cella D, Nowinski C, Peterman A, et al. The neurology quality-of-life measurement initiative. Arch Phys Med Rehabil. 2011;92(10 Suppl):S28-S36.

56. HealthMeasures: PROMIS. http://www.healthmeasures.net/explore-measurement-systems/promis. Accessed October 20, 2019.

57. Valderas JM, Ferrer M, Mendivil J, et al. Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures. Value Health. 2008;11:700-708.

58. Bach K, Martling C, Mork PJ, et al. Design of a clinician dashboard to facilitate co-decision making in the management of non-specific low back pain. J Intelligent Helath Syst. 2019;52:269-284.

59. Karami M, Safdari R, Rahimi A. Effective radiology dashboards: key research findings. Radiology Management. 2013;35:42-45.

60. Dowding D, Randell R, Gardner P, et al. Dashboards for improving patient care: review of the literature. Int J Med Informatic. 2015;84:87-100.

61. Mlaver E, Schnipper JL, Boxer RB, et al. User-centered collaborative design and development of an inpatient safety dashboard. Jt Comm J Qual Patient Saf. 2017;43:676-685.

62. Dowding D, Merrill J, Russell D. Using feedback intervention theory to guide clinical dashboard design. AMIA Annu Symp Proc. 2018;2018:395-403.

63. Hartzler AL, Izard JP, Dalkin BL, et al. Design and feasibility of integrating personalized PRO dashboards into prostate cancer care. J Am Med Inform Assoc. 2016;23:38-47.

64. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Affairs. 2016;35:575-582.

65. U.S. Centers for Medicare & Medicaid Services. Comprehensive Care for Joint Replacement Model. https://innovation.cms.gov/initiatives/CJR. Accessed August 3, 2019.

66. National Quality Forum. Patient-reported outcomes: Accessed August 3, 2019. http://www.qualityforum.org/Patient-Reported_Outcomes.aspx. Accessed October 20, 2019.

67. Institute of Medicine Roundtable on Evidence-Based Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Olsen LA, Aisner D, McGinnis JM, eds. The Learning Healthcare System: Workshop Summary. Washington (DC): National Academies Press (US).National Academy of Sciences; 2007.

68. About Learning Health Systems: Agency for Healthcare Research and Quality. https://www.ahrq.gov/learning-health-systems/about.html. Accessed August 3, 2019.

69. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington (DC): National Academies Press; 2013.

70. Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.

71. Oliver BJ, for the MS-CQI Investigators. The Multiple Sclerosis Continuous improvement collaborative: the first coproduction learning health system improvement science research collaborative for multiple sclerosis. The International Society for Quality in Health Care (ISQua) Annual International Conference; October 2019; Cape Town, South Africa.

72. Britto MT, Fuller SC, Kaplan HC, et al. Using a network organisational architecture to support the development of Learning Healthcare Systems. BMJ Qual Saf. 2018;27:937-946.

73. Care Centers: Cystic Fibrosis Foundation. https://www.cff.org/Care/Care-Centers/. Accessed August 3, 2019.

74. Schechter MS, Fink AK, Homa K, Goss CH. The Cystic Fibrosis Foundation patient registry as a tool for use in quality improvement. BMJ Qual Saf. 2014;23(Suppl 1):i9-i14.

75. Mogayzel PJ, Dunitz J, Marrow LC, Hazle LA. Improving chronic care delivery and outcomes: the impact of the cystic fibrosis Care Center Network. BMJ Qual Saf. 2014;23(Suppl 1):i3-i8.

76. Godfrey MM, Oliver BJ. Accelerating the rate of improvement in cystic fibrosis care: contributions and insights of the learning and leadership collaborative. BMJ Qual Saf. 2014;23(Suppl 1):i23-i32.

77. Nelson EC, Godfrey MM. Quality by Design: A Clinical Microsystems Approach. San Francisco, California: Jossey-Bass; 2007.

78. Crohn’s & Colitis Foundation.Quality of Care: IBD Qorus: https://www.crohnscolitisfoundation.org/research/ibd-qorus. Accessed October 23, 2019.

79. Johnson LC, Melmed GY, Nelson EC, et al. Fostering collaboration through creation of an ibd learning health system. Am J Gastroenterol. 2017;112:406-468.

80. Fernandez-Munoz JJ, Moron-Verdasco A, Cigaran-Mendez M, et al. Disability, quality of life, personality, cognitive and psychological variables associated with fatigue in patients with multiple sclerosis. Acta Neurologica Scandinavica. 2015;132:118-124.

81. Flachenecker P, Kumpfel T, Kallmann B, et al. Fatigue in multiple sclerosis: a comparison of different rating scales and correlation to clinical parameters. Multiple Sclerosis. 2002;8:523-526.

82. Tellez N, Rio J, Tintore M, et al. Does the Modified Fatigue Impact Scale offer a more comprehensive assessment of fatigue in MS? Multiple Sclerosis. 2005;11:198-202.

83. Salter A, Fox RJ, Tyry T, et al. The association of fatigue and social participation in multiple sclerosis as assessed using two different instruments. Mult Scler Relat Disord. 2019;31:165-72.

84. Solaro C, Trabucco E, Messmer Uccelli M. Pain and multiple sclerosis: pathophysiology and treatment. Curr Neurol Neurosci Rep. 2013;13:320.

85. Jawahar R, Oh U, Yang S, Lapane KL. A systematic review of pharmacological pain management in multiple sclerosis. Drugs. 2013;73:1711-1722.

86. Rintala A, Hakkinen A, Paltamaa J. Ten-year follow-up of health-related quality of life among ambulatory persons with multiple sclerosis at baseline. Qual Life Res. 2016;25:3119-3127.

87. Tepavcevic DK, Pekmezovic T, Stojsavljevic N, et al. Change in quality of life and predictors of change among patients with multiple sclerosis: a prospective cohort study. Qual Life Res. 2014;23:1027-1037.

88. DasGupta R, Fowler CJ. Bladder, bowel and sexual dysfunction in multiple sclerosis: management strategies. Drugs. 2003;63:153-166.

89. Marck CH, Jelinek PL, Weiland TJ, et al. Sexual function in multiple sclerosis and associations with demographic, disease and lifestyle characteristics: an international cross-sectional study. BMC Neurology. 2016;16:210.

90. Gajofatto A, Benedetti MD. Treatment strategies for multiple sclerosis: When to start, when to change, when to stop? World J Clinical Cases. 2015;3:545-555.

91. National Multiple Sclerosis Society. Disease-modifying therapies for MS. 2018.

92. Rudick RA, Panzara MA. Natalizumab for the treatment of relapsing multiple sclerosis. Biologics. 2008;2:189-199.

93. Cohen JA, Cutter GR, Fischer JS, et al. Benefit of interferon beta-1a on MSFC progression in secondary progressive MS. Neurology. 2002;59:679-687.

94. Patti F, Pappalardo A, Montanari E, et al. Interferon-beta-1a treatment has a positive effect on quality of life of relapsing-remitting multiple sclerosis: results from a longitudinal study. J Neurol Sci. 2014;337:180-185.

95. Novartis. Exploring the efficacy and safety of Siponimod in patients with secondary progressive multiple sclerosis (EXPAND). Available from clinicaltrials.gov/ct2/show/NCT01665144. NLM identifier: NCT01665144.

96. Singal AG, Higgins PD, Waljee AK. A primer on effectiveness and efficacy trials. Clin Transl Gastroenterol. 2014;5:e45.

97. Jongen PJ. Health-related quality of life in patients with multiple sclerosis: impact of disease-modifying drugs. CNS Drugs. 2017;31:585-602.

98. Coretti S, Ruggeri M, McNamee P. The minimum clinically important difference for EQ-5D index: a critical review. Expert Rev Pharmacoecon Outcomes Res. 2014;14:221-233.

99. Clinical Review Report: Ocrelizumab (Ocrevus). CADTH Common Drug Review. 2018:Appendix 4, Validity of Outcome Measures.

100. iCounquer MS; Empowering patients: how individuals with ms are contributing to the fight to find a cure: 2018. https://www.iconquerms.org/empowering-patients-how-individuals-ms-are-contributing-fight-find-cure. Accessed October 23, 2019.

101. K M. Accelerated Cure Project Announces Collaboration with EMD Serono to Advance Patient-Focused Drug Development in Multiple Sclerosis2018. https://www.iconquerms.org/accelerated-cure-project-announces-collaboration-emd-serono-advance-patient-focused-drug-development. Accessed October 24, 2019.

102. Bebo BF Jr, Fox RJ, Lee K, et al. Landscape of MS patient cohorts and registries: Recommendations for maximizing impact. Multiple Sclerosis. 2018;24:579-586.

103. Hedstrom AK, Hillert J, Olsson T, Alfredsson L. Alcohol as a modifiable lifestyle factor affecting multiple sclerosis risk. JAMA Neurology. 2014;71:300-305.

104. Hedstrom AK, Baarnhielm M, Olsson T, Alfredsson L. Tobacco smoking, but not Swedish snuff use, increases the risk of multiple sclerosis. Neurology. 2009;73:696-701.

105. Hedstrom AK, Akerstedt T, Hillert J, et al. Shift work at young age is associated with increased risk for multiple sclerosis. Ann Neurol. 2011;70:733-741.

106. Hadjimichael O, Vollmer T, Oleen-Burkey M. Fatigue characteristics in multiple sclerosis: the North American Research Committee on Multiple Sclerosis (NARCOMS) survey. Health Qual Life Outcomes. 2008;6:100.

107. Fox RJ, Salter AR, Tyry T, et al. Treatment discontinuation and disease progression with injectable disease-modifying therapies: findings from the North American research committee on multiple sclerosis database. Int J MS Care. 2013;15:194-201.

108. Reeve BB, Wyrwich KW, Wu AW, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22:1889-1905.

109. Jacobs LD, Wende KE, Brownscheidle CM, et al. A profile of multiple sclerosis: the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 1999;5:369-376.

110. Weinstock-Guttman B, Jacobs LD, Brownscheidle CM, et al. Multiple sclerosis characteristics in African American patients in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2003;9:293-298.

111. Raffel J, Wallace A, Gveric D, et al. Patient-reported outcomes and survival in multiple sclerosis: A 10-year retrospective cohort study using the Multiple Sclerosis Impact Scale-29. PLoS Med. 2017;14:e1002346.

112. Vaughn CB, Kavak KS, Dwyer MG, et al. Fatigue at enrollment predicts EDSS worsening in the New York State Multiple Sclerosis Consortium. Multiple Sclerosis. 2018:1352458518816619.

113. Alroughani RA, Akhtar S, Ahmed SF, Al-Hashel JY. Clinical predictors of disease progression in multiple sclerosis patients with relapsing onset in a nation-wide cohort. Int J Neuroscience. 2015;125:831-837.

114. Dolan JG, Veazie PJ, Russ AJ. Development and initial evaluation of a treatment decision dashboard. BMC Med Inform Decision Mak. 2013;13:51.

115. Stuifbergen AK, Becker H, Blozis S, et al. A randomized clinical trial of a wellness intervention for women with multiple sclerosis. Arch Phys Med Rehabil. 2003;84:467-476.

116. Finkelstein J, Martin C, Bhushan A, et al. Feasibility of computer-assisted education in patients with multiple sclerosis. In: Proceedings of the IEEE Symposium on Computer-Based Medical Systems. Bethesda, MD; 2004.

117. Batalden P. Getting more health from healthcare: quality improvement must acknowledge patient coproduction—an essay by Paul Batalden. BMJ. 2018;362:k3617.

118. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Health Care. 2007;16:2-3.

119. Ovretveit J, Zubkoff L, Nelson EC, et al. Using patient-reported outcome measurement to improve patient care. Int J Qual Health Care. 2017;29:874-879.

120. Prodinger B, Taylor P. Improving quality of care through patient-reported outcome measures (PROMs): expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples. BMC Health Services Res. 2018;18:87.

121. Prinsen CA, Vohra S, Rose MR, et al. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” – a practical guideline. Trials. 2016;17:449.

122. NINDS. NINDS Common Data Elements: Streamline Your Neuroscience Clinical Research National Institute of Health. https://www.commondataelements.ninds.nih.gov/#page=Default. Accessed October 23, 2019.

123. Francis DO, McPheeters ML, Noud M, et al. Checklist to operationalize measurement characteristics of patient-reported outcome measures. Systematic Rev. 2016;5:129.

124. National Quality Forum. Patient-reported outcomes (PROs) in performance measurement. 2013. https://www.qualityforum.org/Publications/2012/12/Patient-Reported_Outcomes_in_Performance_Measurement.aspx. Accessed October 15, 2019.

125. Dawson J, Doll H, Fitzpatrick R, et al. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186.

126. Aaronson N ET, Greenlhalgh J, Halyard M, et al. User’s guide to implementation of patient reported outcomes assessment in clinical practice. International Society for Quality of Life. 2015.

127. Chan EKH, Edwards TC, Haywood K, et al. Implementing patient-reported outcomes mesaures in clinical practice: a companion guide to the ISOQOL user’s guide. Qual Life Res. 2018;28:621-627.

128. Snyder CF, Wu AW, Miller RS, et al. The role of informatics in promoting patient-centered care. Cancer J. 2011;17:211-218

129. Osborn R, Moulds D, Schneider EC, et al. Primary care physicians in ten countries report challenges caring for patients with complex health needs. Health Affairs. 2015;34:2104-2112.

130. Wu AW, Kharrazi H, Boulware LE, Snyder CF. Measure once, cut 0wice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research. J Clin Epidemiol. 2013;66(8 Suppl):S12-S20.

131. Trojano M, Bergamaschi R, Amato MP, et al. The Italian multiple sclerosis register. Neurol Sci. 2019;40:155-165.

132. Moorhead SA, Hazlett DE, Harrison L, et al. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res. 2013;15:e85.

133. Luigi L, Francesco B, Marcello M, et al. e-Health and multiple sclerosis: An update. Multiple Sclerosis J. 2018;24:1657-1664.

134. Marrie RA, Leung S, Tyry T, et al. Use of eHealth and mHealth technology by persons with multiple sclerosis. Mult Scler Relat Dis. 2019;27:13-19.

135. Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E. Exploring the specific needs of persons with multiple sclerosis for mhealth solutions for physical activity: mixed-methods study. JMIR Mhealth Uhealth. 2018;6:e37.

136. Spooner KK, Salemi JL, Salihu HM, Zoorob RJ. eHealth patient-provider communication in the United States: interest, inequalities, and predictors. J Am Med Inform Assoc. 2017;24(e1):e18-e27.

137. Safdar N, Abbo LM, Knobloch MJ, Seo SK. Research methods in healthcare epidemiology: survey and qualitative research. Infect Control Hosp Epidemiol. 2016;37:1272-1277.

138. Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101-1108.

139. Chiu C, Bishop M, Pionke JJ, et al. Barriers to the accessibility and continuity of health-care services in people with multiple sclerosis: a literature review. Int J MS Care. 2017;19:313-321.

140. Atreja A, Mehta N, Miller D, et al. One size does not fit all: using qualitative methods to inform the development of an Internet portal for multiple sclerosis patients. AMIA Annu Symp Proc Symp. 2005:16-20.

141. Snyder CF, Blackford AL, Brahmer JR, et al. Needs assessments can identify scores on HRQOL questionnaires that represent problems for patients: an illustration with the Supportive Care Needs Survey and the QLQ-C30. Qual Life Res. 2010;19:837-845.

142. de Vet HC, Terwee CB. The minimal detectable change should not replace the minimal important difference. J Clin Epidemiol. 2010;63:804-805.

143. Snyder CF, Aaronson NK, Choucair AK, et al. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life. 2012;21:1305-1314.

144. Myla DG, Melanie DW, Robert WM, et al. Identification and validation of clinically meaningful benchmarks in the 12-item Multiple Sclerosis Walking Scale. Multiple Sclerosis J. 2017;23:1405-1414.

145. van Munster CEP, Uitdehaag BMJ. Outcome measures in clinical trials for multiple sclerosis. CNS Drugs. 2017;31:217-236.

146. Snyder CF, Jensen R, Courtin SO, Wu AW. PatientViewpoint: a website for patient-reported outcomes assessment. Quality Life Res. 2009;18:793-800.

147. Snyder CF, Smith KC, Bantug ET, et al. What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer. 2017;123:1848-1859.

148. Squitieri L, Bozic KJ, Pusic AL. The role of patient-reported outcome measures in value-based payment reform. Value Health. 2017;20:834-836.

149. Boyce MB, Browne JP. The effectiveness of providing peer benchmarked feedback to hip replacement surgeons based on patient-reported outcome measures—results from the PROFILE trial: a cluster randomised controlled study. BMJ Open. 2015;5:e008325.

Issue
Journal of Clinical Outcomes Management - 26(6)
Issue
Journal of Clinical Outcomes Management - 26(6)
Page Number
277-288
Page Number
277-288
Publications
Publications
Topics
Article Type
Display Headline
Patient-Reported Outcomes in Multiple Sclerosis: An Overview
Display Headline
Patient-Reported Outcomes in Multiple Sclerosis: An Overview
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.
Article PDF Media

Decreasing Overutilization of Echocardiograms and Abdominal Imaging in the Evaluation of Children with Fungemia

Article Type
Changed
Display Headline
Decreasing Overutilization of Echocardiograms and Abdominal Imaging in the Evaluation of Children with Fungemia

From the University of Miami, Department of Pediatrics and Department of Medicine, Miami, FL.

Abstract

  • Objective: Pediatric fungemia is associated with a low risk of fungal endocarditis and renal infections. The majority of current guidelines do not recommend routine abdominal imaging/echocardiograms in the evaluation of fungemia, but such imaging has been routinely ordered for patients on the pediatric gastroenterology service at our institution. Our goals were to assess the financial impact of this deviation from current clinical guidelines and redefine the standard work to reduce overutilization of abdominal ultrasounds and echocardiograms. Specifically, our goal was to reduce imaging by 50% by 18 months.
  • Methods: Root cause analysis showed a lack of familiarity with current evidence. Using this data, countermeasures were implemented, including practitioner education of guidelines and creation of a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Balancing measures were missed episodes of fungal endocarditis and renal infection.
  • Results: During the period January 1, 2016 to November 19, 2017, 18 of 21 episodes of fungemia in our pediatric institution occurred in patients admitted to the pediatric gastroenterology service. Abdominal imaging and echocardiograms were done 100% of the time, with no positive findings and an estimated cost of approximately $58,000. Post-intervention from November 20, 2017 to April 3, 2019, 7 of 13 episodes of fungemia occurred on this service. Frequency of abdominal imaging and echocardiograms decreased to 43% and 57%, respectively. No episodes of fungal endocarditis or renal infection were identified.
  • Conclusion: Overutilization of abdominal imaging and echocardiograms in pediatric fungemia evaluation can be safely decreased.

Keywords: guidelines; cost; candidemia; endocarditis.

Practitioners may remain under the impression that routine abdominal ultrasounds (US) and echocardiograms (echo) are indicated in fungemia to evaluate for fungal endocarditis and renal infection, although these conditions are rare and limited to a subset of the population.1-10 Risk factors include prematurity, immunosuppression, prior bacterial endocarditis, abnormal cardiac valves, and previous urogenital surgeries.11

The 2016 Infectious Diseases Society of America (IDSA) guidelines do not recommend routine US or echo but rather provide scenarios in which Candida endocarditis should be suspected, and these include: persistently positive blood cultures, persistent fevers despite appropriate therapy, and clinical signs that may suggest endocarditis, such as a new heart murmur, heart failure, or embolic phenomena.11 IDSA recommends abdominal imaging in neonates with persistently positive blood cultures to evaluate the urogenital system, in addition to the liver and spleen. They also recommend abdominal imaging in symptomatic ascending Candida pyelonephritis beyond the neonatal period and in chronic disseminated candidiasis; the latter is uncommon and seen almost exclusively in patients recovering from neutropenia with a hematologic malignancy.11

We also reviewed guidelines on fungemia originating outside the United States. The 2010 Canadian clinical guidelines on invasive candidiasis do not explicitly recommend routine imaging, but rather state that various imaging studies, including US and echo among others, may be helpful.12 The German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy published a joint recommendation against routine US and echo in uncomplicated candidemia in 2011.13

The European Society for Clinical Microbiology and Infectious Diseases is the only society that recommends routine echo. Their 2012 guidelines on candidiasis recommend transesophageal echo in adults14 and echocardiography in children,15 as well as abdominal imaging in the diagnosis of chronic disseminated candidiasis in adults with hematological malignancies/hematopoietic stem cell transplantation.16

 

 

The 2013 Brazilian guidelines explicitly recommend against routine abdominal imaging and echo because of the low frequency of visceral lesions in adults with candidemia and recommend reserving imaging for those with persistently positive blood cultures or with clinical signs/symptoms suggestive of endocarditis/abdominal infection or clinical deterioration.17 The 2014 Japanese guidelines recommend ruling out chronic disseminated candidiasis in these patients with symptoms during the neutrophil recovery phase, but do not mention routinely imaging other patients. They do not address the role of echocardiography.18

Although physicians in the United Sates typically follow IDSA guidelines, abdominal US and echo were ordered routinely for patients with fungemia on the pediatric gastroenterology service at our institution, leading to higher medical costs and waste of medical resources. Our goals were to assess the current standard work for fungemia evaluation on this service, assess the impact of its deviation from current clinical guidelines, and redefine the standard work by (1) presenting current evidence to practitioners taking care of patients on this service, (2) providing a clinical pathway that allowed for variations where appropriate, and (3) providing a plan for pediatric fungemia management. Our SMART (Specific, Measurable, Attainable, Relevant and Timely) goal was to reduce overutilization of abdominal US and echo in pediatric patients with fungemia on the pediatric gastroenterology service by 50%.

 

Methods

Study, Setting, and Participants

We executed this quality improvement project at a quaternary care pediatric hospital affiliated with a school of medicine. The project scope consisted of inpatient pediatric patients with fungemia on the pediatric gastroenterology service admitted to the wards or pediatric critical care unit at this institution, along with the practitioners caring for these patients. The project was part of an institutional quality improvement initiative program. The quality improvement team included quality improvement experts from the departments of medicine and pediatrics, a pediatric resident and student, and physicians from the divisions of pediatric infectious disease, pediatric critical care, and pediatric gastroenterology. This study qualified for Institutional Review Board (IRB) exemption based on the University’s IRB stipulations.

Current Condition

Root cause analysis was performed by creating a process map of the current standard work and a fishbone diagram (Figure 1). We incorporated feedback from voice of the customer in the root cause analysis. In this analysis, the voice of the customer came from the bedside floor nurses, ultrasound clerk and sonographer, echo technician, cardiology fellow, and microbiology medical technician. We got their feedback on our process map, its accuracy and ways to expand, their thoughts on the problem and why we have this problem, and any solutions they could offer to help improve the problem. Some of the key points obtained were: echos were not routinely done on the floors and were not considered urgent as they often did not change management; the sonographer and those from the cardiology department felt imaging was often overutilized because of misconceptions and lack of available hospital guidelines. Suggested solutions included provider education with reference to Duke’s criteria and establishing a clinical pathway approved by all concerned departments.

Root cause analysis: fishbone diagram.

Prior to education, we surveyed current practices of practitioners on teams caring for these patients, which included physicians of all levels (attendings, fellows, residents) as well as nurse practitioners and medical students from the department of pediatrics and divisions of pediatric gastroenterology, pediatric infectious disease, and pediatric critical care medicine.

 

 

Countermeasures

Practitioner Education. In October 2017 practitioners were given a 20-minute presentation on the latest international guidelines on fungemia. Fifty-nine practitioners completed pre- and post-test surveys. Eight respondents were excluded due to incomplete surveys. We compared self-reported frequencies of ordering abdominal imaging and echo before the presentation with intention to order post education. Intention to change clinical practice after the presentation was also surveyed.

Clinical Pathway. Education alone may not result in sustainability, and thus we provided a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Inter-department buy-in was also necessary for success. It was important to get the input from the various teams (infectious disease, cardiology, gastroenterology, and critical care), which was done by incorporating members from those divisions in the project or getting their feedback through voice of the customer analysis.

We redefined standard work based on current evidence and created a clinical pathway during March 2018 that included variations when appropriate (Figure 2). We presented the clinical pathway to practitioners and distributed it via email. We also made it available to pediatric residents and fellows on their mobile institutional work resource application.

Clinical pathway for pediatric fungemia evaluation. This pathway applies to the immunocompetent host and excludes neonates, premature infants, bone marrow transplant recipients, and patients on immunosuppressive therapy.

Electronic Order Set. We created an electronic order set for pediatric fungemia management and made it available in the electronic health record May 2018.

 

Measurement

Cases of fungemia were identified through the electronic health record pre-intervention (January 1, 2016 through November 19, 2017) and post-intervention (November 20, 2019 through April 3, 2019). An episode of fungemia was defined as an encounter with 1 or more positive blood culture(s) for Candida species or Cryptococcus species. We manually identified patients belonging to the pediatric gastroenterology service and reviewed these charts to determine the presenting complaint, organism isolated, transplant status, central lines status, risk factors, if abdominal imaging or echocardiography were done for the episode of fungemia, and their corresponding results. We calculated overall and per patient medical charges by using the average charges at our institution of US and echocardiography with a cardiology consult. These average charges were provided by patient financial services and the pediatric cardiology department, respectively. To address non-technical expenditures, we calculated the average time taken for transport to and from radiology and the echo suite for each identified patient. We identified missed fungal endocarditis and fungal balls as balancing measures.

 

 

Results

Survey

Among the 51 practitioners surveyed, 36% were performing routine echo and 22% self-reported performing routine abdominal imaging. After education, no respondents planned to routinely do echo or abdominal imaging. All but 1 respondent planned to change their practice for evaluation of fungemia patients based on the presentation (eFigure 1).

Results of survey: Pre- and post-test frequency pie charts of echocardiograms and abdominal imaging.

Baseline Data

Over the 23-month period from January 1, 2016 to November 19, 2017, there were 21 episodes of fungemia, 18 of which occurred in patients on the pediatric gastroenterology service (2 of the 18 were transplant recipients). For the 18 episodes on this service, abdominal imaging and echo were done 100% of the time, with 0 positive findings (eFigure 2).

Pie charts of services with episodes of candidemia and flow diagrams of abdominal imaging and echocardiogram on episodes on the pediatric gastroenterology service before and after countermeasures.

Of those 18 episodes, the average age was 4.6 years, with two-thirds of the population being male. There were 3 patients with multiple episodes that accounted for 8 of the episodes (3, 3, and 2 episodes each). Fever was the most common presenting complaint. The most common organism was Candida parapsilosis (6 of the 18 episodes). All episodes but one involved a central line, and all central lines were removed when present except for one case. Of the risk factors, 3 episodes occurred in neutropenic patients, and for 1 episode the patient had a questionable history of fungal endocarditis (and was on fungal prophylaxis). There were no patients with recent cardiac/urogenital surgery or prior fungal balls. No episodes had clinical symptoms suggestive of fungal endocarditis or fungal balls.

 

Post-Intervention Data

Over the subsequent 17-month period (November 11, 2017 to April 3, 2019), there were 13 episodes of candidemia. There were no episodes of Cryptococcus fungemia. Seven episodes occurred in patients on the pediatric gastroenterology service (2 of the 7 occurred in transplant recipients). Abdominal imaging was done in 3 of these episodes (43%), and in 2 of these 3 episodes, imaging was done at an outside institution prior to arrival, with no positive results (eFigure 2).

Echocardiography was done 57% of the time (n = 4), with echo being done at an outside institution prior to arrival half of the time (n = 2), with no endocarditis identified. The cases of abdominal imaging and echo done at outside institutions prior to arrival were not impacted by the countermeasures. Excluding those 2 patients who had both abdominal imaging and echocardiography done prior to arrival, the overall rate of imaging (both abdominal imaging and echo) done after countermeasures were instituted was 30% (Figure 3).

Run chart showing percentage of fungemia cases in which imaging (abdominal and echocardiography) was done.

 

 

Of those 7 episodes, the average age was 6.8 years (57% female). There were no patients with multiple episodes. The most common presenting complaint was fever. The most common organism was Candida albicans (3 of the 7 episodes). All episodes involved a central line, which was removed in all cases except for one. Of the risk factors, 2 episodes were in neutropenic patients, and 1 episode had a history of bacterial endocarditis (not related to fungemia). No episodes occurred in patients with prior fungal renal infection, urogenital malformations, or recent cardiac/urogenital surgery. No episodes had clinical symptoms suggestive of fungal endocarditis or renal infection. No episodes of fungal endocarditis or renal infection were identified.

On average, a patient at our institution undergoing abdominal US and echo with a cardiology consult results in medical waste of approximately $3200 per patient. This cost does not take into account other miscellaneous charges possibly incurred, such as the radiologist interpreting the findings and transportation. Baseline data calculations show that patients waste on average 55 minutes in physical transport, and this does not take into account wait times.

Discussion

Candidemia contributes to 10% of central-line associated blood stream infections (CLABSI).19 Increased usage of indwelling central catheters for administration of parenteral nutrition will inevitably result in practitioners encountering cases of candidemia when caring for this population. As seen from our results, the majority of episodes of candidemia at our institution occurred on the pediatric gastroenterology service, and thus redefining standard work on this service will be impactful.

Candida parapsilosis and Candida albicans were the most common causative agents before and after intervention, respectively, but overall the most common organism was Candida albicans, which is in keeping with that of CLABSI in the literature.19 Growth of Candida parapsilosis has been particularly linked to CLABSI.19 The third most common organism in our study was Candida glabrata, which is the second most common cause of candidemia in CLABSI.19

The cases of positive abdominal imaging in fungemia in the literature are limited to the neonatal population1-4 and chronic disseminated candidiasis in patients with hematologic malignancies/neutropenia/immunosuppression.5,6 In fungal endocarditis, the reported cases were generally in neonates,1,3,7 critically ill patients,8 patients with hematologic malignancies/neutropenia/immunosuppression,6,9 or those with a cardiac history.9,10 This population differs from the patient population on the pediatric gastroenterology service. Patients on this service may not need US or echo. Performing abdominal US and echo in fungemia patients in whom such imaging is not indicated may result in medical waste of approximately $3200 per patient. There is also a waste of medical resources and time.

 

 

We found almost all practitioners are willing to change clinical practice once provided with current guidelines. Face-to-face oral presentations allowed for questions and interaction, making this form of information dissemination better than e-mails or handouts.

Though the numbers were small over the short study period, we were able to decrease overutilization of abdominal imaging and echo after implementing countermeasures. Frequency decreased from 100% to 43% and 57% for abdominal imaging and echo, respectively. Imaging that was done after the countermeasures were implemented was mainly attributed to imaging patients underwent prior to presenting to our institution. This reinforces the need for education at other institutions as well. Of the balancing measures assessed, there were no missed cases of fungal balls or fungal endocarditis. Additionally, of the total 34 episodes of fungemia assessed (21 before and 13 after), even among those with risk factors, there were no cases of fungal endocarditis or renal infection.

The findings from this quality improvement project underscore current recommendations that, despite common misconceptions, routine abdominal US and echo are not indicated in all cases of fungemia. Case-by-case assessment based on the clinical scenario remains key to management of fungemia to avoid unnecessary medical interventions.

Corresponding author: Donna Cheung, MBBS, 200 Hawkins Drive, BT 1120-G, Iowa City, IA 52242; donna.ann.cheung@gmail.com.

Financial support: None.

References

1. Benjamin DK Jr, Poole C, Steinbach WJ, et al. Neonatal candidemia and end-organ damage: a critical appraisal of the literature using meta-analytic techniques. Pediatrics. 2003;112:634-640.

2. Wynn JL, Tan S, Gantz MG, et al. Outcomes following candiduria in extremely low birth weight infants. Clin Infect Dis. 2012;54:331-339.

3. Noyola DE, Fernandez M, Moylett EH, et al. Ophthalmologic, visceral, and cardiac involvement in neonates with candidemia. Clin Infect Dis. 2001;32:1018-1023.

4. Phillips JR, Karlowicz MG Prevalence of Candida species in hospital-acquired urinary tract infections in a neonatal intensive care unit. Pediatr Infect Dis J. 1997;16:190-194.

5. Pagano L, Mele L, Fianchi L, et al. Chronic disseminated candidiasis in patients with hematologic malignancies. Clinical features and outcome of 29 episodes. Haematologica. 2002;87:535-541.

6. Zaoutis TE, Greves HM, Lautenbach E, et al. Risk factors for disseminated candidiasis in children with candidemia. Pediatr Infect Dis J. 2004;23:635-641.

7. Levy I, Shalit I, Birk E, et al. Candida endocarditis in neonates: report of five cases and review of the literature. Mycoses. 2006;49:43-48.

8. Aspesberro F, Beghetti M, Oberhansli I, et al. Fungal endocarditis in critically ill children. Eur J Pediatr. 1999;158:275-280.

9. Fernandez-Cruz A, Cruz Menarguez M, Munoz P, et al. The search for endocarditis in patients with candidemia: a systematic recommendation for echocardiography? A prospective cohort. Eur J Clin Microbiol Infect Dis. 2015;34:1543-1549.

10. Hernandez-Torres A, Garcia-Vazquez E, Laso-Ortiz A, et al. [Candida sp endocarditis. Experience in a third-level hospital and review of the literature]. Rev Esp Quimioter. 2013;26:51-55.

11. Pappas PG, Kauffman CA, Andes DR, et al. Clinical practice guideline for the management of candidiasis: 2016 Update by the Infectious Diseases Society of America. Clin Infect Dis. 2016;62:e1-50.

12. Bow EJ, Evans G, Fuller J, et al. Canadian clinical practice guidelines for invasive candidiasis in adults. Can J Infect Dis Med Microbiol. 2010;21:e122-50.

13. Ruhnke M, Rickerts V, Cornely OA, et al. Diagnosis and therapy of Candida infections: joint recommendations of the German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy. Mycoses. 2011;54:279-310.

14. Cornely OA, Bassetti M, Calandra T, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: non-neutropenic adult patients. Clin Microbiol Infect. 2012;18 Suppl 7:19-37.

15. Hope WW, Castagnola E, Groll AH, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: prevention and management of invasive infections in neonates and children caused by Candida spp. Clin Microbiol Infect. 2012;18 Suppl 7:38-52.

16. Ullmann AJ, Akova M, Herbrecht R, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: adults with haematological malignancies and after haematopoietic stem cell transplantation (HCT). Clin Microbiol Infect. 2012;18 Suppl 7:53-67.

17. Colombo AL, Guimaraes T, Camargo LF, et al. Brazilian guidelines for the management of candidiasis - a joint meeting report of three medical societies: Sociedade Brasileira de Infectologia, Sociedade Paulista de Infectologia and Sociedade Brasileira de Medicina Tropical. Braz J Infect Dis. 2013;17:283-312.

18. Kohno S, Tamura K, Niki Y, et al. Executive Summary of Japanese Domestic guidelines for management of deep-seated mycosis 2014. Med Mycol J. 2016;57:E117-E163.

19. Kojic EM, Darouiche RO. Candida infections of medical devices. Clin Microbiology Rev. 2004;17:255-267.

Article PDF
Issue
Journal of Clinical Outcomes Management - 26(6)
Publications
Topics
Page Number
270-276
Sections
Article PDF
Article PDF

From the University of Miami, Department of Pediatrics and Department of Medicine, Miami, FL.

Abstract

  • Objective: Pediatric fungemia is associated with a low risk of fungal endocarditis and renal infections. The majority of current guidelines do not recommend routine abdominal imaging/echocardiograms in the evaluation of fungemia, but such imaging has been routinely ordered for patients on the pediatric gastroenterology service at our institution. Our goals were to assess the financial impact of this deviation from current clinical guidelines and redefine the standard work to reduce overutilization of abdominal ultrasounds and echocardiograms. Specifically, our goal was to reduce imaging by 50% by 18 months.
  • Methods: Root cause analysis showed a lack of familiarity with current evidence. Using this data, countermeasures were implemented, including practitioner education of guidelines and creation of a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Balancing measures were missed episodes of fungal endocarditis and renal infection.
  • Results: During the period January 1, 2016 to November 19, 2017, 18 of 21 episodes of fungemia in our pediatric institution occurred in patients admitted to the pediatric gastroenterology service. Abdominal imaging and echocardiograms were done 100% of the time, with no positive findings and an estimated cost of approximately $58,000. Post-intervention from November 20, 2017 to April 3, 2019, 7 of 13 episodes of fungemia occurred on this service. Frequency of abdominal imaging and echocardiograms decreased to 43% and 57%, respectively. No episodes of fungal endocarditis or renal infection were identified.
  • Conclusion: Overutilization of abdominal imaging and echocardiograms in pediatric fungemia evaluation can be safely decreased.

Keywords: guidelines; cost; candidemia; endocarditis.

Practitioners may remain under the impression that routine abdominal ultrasounds (US) and echocardiograms (echo) are indicated in fungemia to evaluate for fungal endocarditis and renal infection, although these conditions are rare and limited to a subset of the population.1-10 Risk factors include prematurity, immunosuppression, prior bacterial endocarditis, abnormal cardiac valves, and previous urogenital surgeries.11

The 2016 Infectious Diseases Society of America (IDSA) guidelines do not recommend routine US or echo but rather provide scenarios in which Candida endocarditis should be suspected, and these include: persistently positive blood cultures, persistent fevers despite appropriate therapy, and clinical signs that may suggest endocarditis, such as a new heart murmur, heart failure, or embolic phenomena.11 IDSA recommends abdominal imaging in neonates with persistently positive blood cultures to evaluate the urogenital system, in addition to the liver and spleen. They also recommend abdominal imaging in symptomatic ascending Candida pyelonephritis beyond the neonatal period and in chronic disseminated candidiasis; the latter is uncommon and seen almost exclusively in patients recovering from neutropenia with a hematologic malignancy.11

We also reviewed guidelines on fungemia originating outside the United States. The 2010 Canadian clinical guidelines on invasive candidiasis do not explicitly recommend routine imaging, but rather state that various imaging studies, including US and echo among others, may be helpful.12 The German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy published a joint recommendation against routine US and echo in uncomplicated candidemia in 2011.13

The European Society for Clinical Microbiology and Infectious Diseases is the only society that recommends routine echo. Their 2012 guidelines on candidiasis recommend transesophageal echo in adults14 and echocardiography in children,15 as well as abdominal imaging in the diagnosis of chronic disseminated candidiasis in adults with hematological malignancies/hematopoietic stem cell transplantation.16

 

 

The 2013 Brazilian guidelines explicitly recommend against routine abdominal imaging and echo because of the low frequency of visceral lesions in adults with candidemia and recommend reserving imaging for those with persistently positive blood cultures or with clinical signs/symptoms suggestive of endocarditis/abdominal infection or clinical deterioration.17 The 2014 Japanese guidelines recommend ruling out chronic disseminated candidiasis in these patients with symptoms during the neutrophil recovery phase, but do not mention routinely imaging other patients. They do not address the role of echocardiography.18

Although physicians in the United Sates typically follow IDSA guidelines, abdominal US and echo were ordered routinely for patients with fungemia on the pediatric gastroenterology service at our institution, leading to higher medical costs and waste of medical resources. Our goals were to assess the current standard work for fungemia evaluation on this service, assess the impact of its deviation from current clinical guidelines, and redefine the standard work by (1) presenting current evidence to practitioners taking care of patients on this service, (2) providing a clinical pathway that allowed for variations where appropriate, and (3) providing a plan for pediatric fungemia management. Our SMART (Specific, Measurable, Attainable, Relevant and Timely) goal was to reduce overutilization of abdominal US and echo in pediatric patients with fungemia on the pediatric gastroenterology service by 50%.

 

Methods

Study, Setting, and Participants

We executed this quality improvement project at a quaternary care pediatric hospital affiliated with a school of medicine. The project scope consisted of inpatient pediatric patients with fungemia on the pediatric gastroenterology service admitted to the wards or pediatric critical care unit at this institution, along with the practitioners caring for these patients. The project was part of an institutional quality improvement initiative program. The quality improvement team included quality improvement experts from the departments of medicine and pediatrics, a pediatric resident and student, and physicians from the divisions of pediatric infectious disease, pediatric critical care, and pediatric gastroenterology. This study qualified for Institutional Review Board (IRB) exemption based on the University’s IRB stipulations.

Current Condition

Root cause analysis was performed by creating a process map of the current standard work and a fishbone diagram (Figure 1). We incorporated feedback from voice of the customer in the root cause analysis. In this analysis, the voice of the customer came from the bedside floor nurses, ultrasound clerk and sonographer, echo technician, cardiology fellow, and microbiology medical technician. We got their feedback on our process map, its accuracy and ways to expand, their thoughts on the problem and why we have this problem, and any solutions they could offer to help improve the problem. Some of the key points obtained were: echos were not routinely done on the floors and were not considered urgent as they often did not change management; the sonographer and those from the cardiology department felt imaging was often overutilized because of misconceptions and lack of available hospital guidelines. Suggested solutions included provider education with reference to Duke’s criteria and establishing a clinical pathway approved by all concerned departments.

Root cause analysis: fishbone diagram.

Prior to education, we surveyed current practices of practitioners on teams caring for these patients, which included physicians of all levels (attendings, fellows, residents) as well as nurse practitioners and medical students from the department of pediatrics and divisions of pediatric gastroenterology, pediatric infectious disease, and pediatric critical care medicine.

 

 

Countermeasures

Practitioner Education. In October 2017 practitioners were given a 20-minute presentation on the latest international guidelines on fungemia. Fifty-nine practitioners completed pre- and post-test surveys. Eight respondents were excluded due to incomplete surveys. We compared self-reported frequencies of ordering abdominal imaging and echo before the presentation with intention to order post education. Intention to change clinical practice after the presentation was also surveyed.

Clinical Pathway. Education alone may not result in sustainability, and thus we provided a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Inter-department buy-in was also necessary for success. It was important to get the input from the various teams (infectious disease, cardiology, gastroenterology, and critical care), which was done by incorporating members from those divisions in the project or getting their feedback through voice of the customer analysis.

We redefined standard work based on current evidence and created a clinical pathway during March 2018 that included variations when appropriate (Figure 2). We presented the clinical pathway to practitioners and distributed it via email. We also made it available to pediatric residents and fellows on their mobile institutional work resource application.

Clinical pathway for pediatric fungemia evaluation. This pathway applies to the immunocompetent host and excludes neonates, premature infants, bone marrow transplant recipients, and patients on immunosuppressive therapy.

Electronic Order Set. We created an electronic order set for pediatric fungemia management and made it available in the electronic health record May 2018.

 

Measurement

Cases of fungemia were identified through the electronic health record pre-intervention (January 1, 2016 through November 19, 2017) and post-intervention (November 20, 2019 through April 3, 2019). An episode of fungemia was defined as an encounter with 1 or more positive blood culture(s) for Candida species or Cryptococcus species. We manually identified patients belonging to the pediatric gastroenterology service and reviewed these charts to determine the presenting complaint, organism isolated, transplant status, central lines status, risk factors, if abdominal imaging or echocardiography were done for the episode of fungemia, and their corresponding results. We calculated overall and per patient medical charges by using the average charges at our institution of US and echocardiography with a cardiology consult. These average charges were provided by patient financial services and the pediatric cardiology department, respectively. To address non-technical expenditures, we calculated the average time taken for transport to and from radiology and the echo suite for each identified patient. We identified missed fungal endocarditis and fungal balls as balancing measures.

 

 

Results

Survey

Among the 51 practitioners surveyed, 36% were performing routine echo and 22% self-reported performing routine abdominal imaging. After education, no respondents planned to routinely do echo or abdominal imaging. All but 1 respondent planned to change their practice for evaluation of fungemia patients based on the presentation (eFigure 1).

Results of survey: Pre- and post-test frequency pie charts of echocardiograms and abdominal imaging.

Baseline Data

Over the 23-month period from January 1, 2016 to November 19, 2017, there were 21 episodes of fungemia, 18 of which occurred in patients on the pediatric gastroenterology service (2 of the 18 were transplant recipients). For the 18 episodes on this service, abdominal imaging and echo were done 100% of the time, with 0 positive findings (eFigure 2).

Pie charts of services with episodes of candidemia and flow diagrams of abdominal imaging and echocardiogram on episodes on the pediatric gastroenterology service before and after countermeasures.

Of those 18 episodes, the average age was 4.6 years, with two-thirds of the population being male. There were 3 patients with multiple episodes that accounted for 8 of the episodes (3, 3, and 2 episodes each). Fever was the most common presenting complaint. The most common organism was Candida parapsilosis (6 of the 18 episodes). All episodes but one involved a central line, and all central lines were removed when present except for one case. Of the risk factors, 3 episodes occurred in neutropenic patients, and for 1 episode the patient had a questionable history of fungal endocarditis (and was on fungal prophylaxis). There were no patients with recent cardiac/urogenital surgery or prior fungal balls. No episodes had clinical symptoms suggestive of fungal endocarditis or fungal balls.

 

Post-Intervention Data

Over the subsequent 17-month period (November 11, 2017 to April 3, 2019), there were 13 episodes of candidemia. There were no episodes of Cryptococcus fungemia. Seven episodes occurred in patients on the pediatric gastroenterology service (2 of the 7 occurred in transplant recipients). Abdominal imaging was done in 3 of these episodes (43%), and in 2 of these 3 episodes, imaging was done at an outside institution prior to arrival, with no positive results (eFigure 2).

Echocardiography was done 57% of the time (n = 4), with echo being done at an outside institution prior to arrival half of the time (n = 2), with no endocarditis identified. The cases of abdominal imaging and echo done at outside institutions prior to arrival were not impacted by the countermeasures. Excluding those 2 patients who had both abdominal imaging and echocardiography done prior to arrival, the overall rate of imaging (both abdominal imaging and echo) done after countermeasures were instituted was 30% (Figure 3).

Run chart showing percentage of fungemia cases in which imaging (abdominal and echocardiography) was done.

 

 

Of those 7 episodes, the average age was 6.8 years (57% female). There were no patients with multiple episodes. The most common presenting complaint was fever. The most common organism was Candida albicans (3 of the 7 episodes). All episodes involved a central line, which was removed in all cases except for one. Of the risk factors, 2 episodes were in neutropenic patients, and 1 episode had a history of bacterial endocarditis (not related to fungemia). No episodes occurred in patients with prior fungal renal infection, urogenital malformations, or recent cardiac/urogenital surgery. No episodes had clinical symptoms suggestive of fungal endocarditis or renal infection. No episodes of fungal endocarditis or renal infection were identified.

On average, a patient at our institution undergoing abdominal US and echo with a cardiology consult results in medical waste of approximately $3200 per patient. This cost does not take into account other miscellaneous charges possibly incurred, such as the radiologist interpreting the findings and transportation. Baseline data calculations show that patients waste on average 55 minutes in physical transport, and this does not take into account wait times.

Discussion

Candidemia contributes to 10% of central-line associated blood stream infections (CLABSI).19 Increased usage of indwelling central catheters for administration of parenteral nutrition will inevitably result in practitioners encountering cases of candidemia when caring for this population. As seen from our results, the majority of episodes of candidemia at our institution occurred on the pediatric gastroenterology service, and thus redefining standard work on this service will be impactful.

Candida parapsilosis and Candida albicans were the most common causative agents before and after intervention, respectively, but overall the most common organism was Candida albicans, which is in keeping with that of CLABSI in the literature.19 Growth of Candida parapsilosis has been particularly linked to CLABSI.19 The third most common organism in our study was Candida glabrata, which is the second most common cause of candidemia in CLABSI.19

The cases of positive abdominal imaging in fungemia in the literature are limited to the neonatal population1-4 and chronic disseminated candidiasis in patients with hematologic malignancies/neutropenia/immunosuppression.5,6 In fungal endocarditis, the reported cases were generally in neonates,1,3,7 critically ill patients,8 patients with hematologic malignancies/neutropenia/immunosuppression,6,9 or those with a cardiac history.9,10 This population differs from the patient population on the pediatric gastroenterology service. Patients on this service may not need US or echo. Performing abdominal US and echo in fungemia patients in whom such imaging is not indicated may result in medical waste of approximately $3200 per patient. There is also a waste of medical resources and time.

 

 

We found almost all practitioners are willing to change clinical practice once provided with current guidelines. Face-to-face oral presentations allowed for questions and interaction, making this form of information dissemination better than e-mails or handouts.

Though the numbers were small over the short study period, we were able to decrease overutilization of abdominal imaging and echo after implementing countermeasures. Frequency decreased from 100% to 43% and 57% for abdominal imaging and echo, respectively. Imaging that was done after the countermeasures were implemented was mainly attributed to imaging patients underwent prior to presenting to our institution. This reinforces the need for education at other institutions as well. Of the balancing measures assessed, there were no missed cases of fungal balls or fungal endocarditis. Additionally, of the total 34 episodes of fungemia assessed (21 before and 13 after), even among those with risk factors, there were no cases of fungal endocarditis or renal infection.

The findings from this quality improvement project underscore current recommendations that, despite common misconceptions, routine abdominal US and echo are not indicated in all cases of fungemia. Case-by-case assessment based on the clinical scenario remains key to management of fungemia to avoid unnecessary medical interventions.

Corresponding author: Donna Cheung, MBBS, 200 Hawkins Drive, BT 1120-G, Iowa City, IA 52242; donna.ann.cheung@gmail.com.

Financial support: None.

From the University of Miami, Department of Pediatrics and Department of Medicine, Miami, FL.

Abstract

  • Objective: Pediatric fungemia is associated with a low risk of fungal endocarditis and renal infections. The majority of current guidelines do not recommend routine abdominal imaging/echocardiograms in the evaluation of fungemia, but such imaging has been routinely ordered for patients on the pediatric gastroenterology service at our institution. Our goals were to assess the financial impact of this deviation from current clinical guidelines and redefine the standard work to reduce overutilization of abdominal ultrasounds and echocardiograms. Specifically, our goal was to reduce imaging by 50% by 18 months.
  • Methods: Root cause analysis showed a lack of familiarity with current evidence. Using this data, countermeasures were implemented, including practitioner education of guidelines and creation of a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Balancing measures were missed episodes of fungal endocarditis and renal infection.
  • Results: During the period January 1, 2016 to November 19, 2017, 18 of 21 episodes of fungemia in our pediatric institution occurred in patients admitted to the pediatric gastroenterology service. Abdominal imaging and echocardiograms were done 100% of the time, with no positive findings and an estimated cost of approximately $58,000. Post-intervention from November 20, 2017 to April 3, 2019, 7 of 13 episodes of fungemia occurred on this service. Frequency of abdominal imaging and echocardiograms decreased to 43% and 57%, respectively. No episodes of fungal endocarditis or renal infection were identified.
  • Conclusion: Overutilization of abdominal imaging and echocardiograms in pediatric fungemia evaluation can be safely decreased.

Keywords: guidelines; cost; candidemia; endocarditis.

Practitioners may remain under the impression that routine abdominal ultrasounds (US) and echocardiograms (echo) are indicated in fungemia to evaluate for fungal endocarditis and renal infection, although these conditions are rare and limited to a subset of the population.1-10 Risk factors include prematurity, immunosuppression, prior bacterial endocarditis, abnormal cardiac valves, and previous urogenital surgeries.11

The 2016 Infectious Diseases Society of America (IDSA) guidelines do not recommend routine US or echo but rather provide scenarios in which Candida endocarditis should be suspected, and these include: persistently positive blood cultures, persistent fevers despite appropriate therapy, and clinical signs that may suggest endocarditis, such as a new heart murmur, heart failure, or embolic phenomena.11 IDSA recommends abdominal imaging in neonates with persistently positive blood cultures to evaluate the urogenital system, in addition to the liver and spleen. They also recommend abdominal imaging in symptomatic ascending Candida pyelonephritis beyond the neonatal period and in chronic disseminated candidiasis; the latter is uncommon and seen almost exclusively in patients recovering from neutropenia with a hematologic malignancy.11

We also reviewed guidelines on fungemia originating outside the United States. The 2010 Canadian clinical guidelines on invasive candidiasis do not explicitly recommend routine imaging, but rather state that various imaging studies, including US and echo among others, may be helpful.12 The German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy published a joint recommendation against routine US and echo in uncomplicated candidemia in 2011.13

The European Society for Clinical Microbiology and Infectious Diseases is the only society that recommends routine echo. Their 2012 guidelines on candidiasis recommend transesophageal echo in adults14 and echocardiography in children,15 as well as abdominal imaging in the diagnosis of chronic disseminated candidiasis in adults with hematological malignancies/hematopoietic stem cell transplantation.16

 

 

The 2013 Brazilian guidelines explicitly recommend against routine abdominal imaging and echo because of the low frequency of visceral lesions in adults with candidemia and recommend reserving imaging for those with persistently positive blood cultures or with clinical signs/symptoms suggestive of endocarditis/abdominal infection or clinical deterioration.17 The 2014 Japanese guidelines recommend ruling out chronic disseminated candidiasis in these patients with symptoms during the neutrophil recovery phase, but do not mention routinely imaging other patients. They do not address the role of echocardiography.18

Although physicians in the United Sates typically follow IDSA guidelines, abdominal US and echo were ordered routinely for patients with fungemia on the pediatric gastroenterology service at our institution, leading to higher medical costs and waste of medical resources. Our goals were to assess the current standard work for fungemia evaluation on this service, assess the impact of its deviation from current clinical guidelines, and redefine the standard work by (1) presenting current evidence to practitioners taking care of patients on this service, (2) providing a clinical pathway that allowed for variations where appropriate, and (3) providing a plan for pediatric fungemia management. Our SMART (Specific, Measurable, Attainable, Relevant and Timely) goal was to reduce overutilization of abdominal US and echo in pediatric patients with fungemia on the pediatric gastroenterology service by 50%.

 

Methods

Study, Setting, and Participants

We executed this quality improvement project at a quaternary care pediatric hospital affiliated with a school of medicine. The project scope consisted of inpatient pediatric patients with fungemia on the pediatric gastroenterology service admitted to the wards or pediatric critical care unit at this institution, along with the practitioners caring for these patients. The project was part of an institutional quality improvement initiative program. The quality improvement team included quality improvement experts from the departments of medicine and pediatrics, a pediatric resident and student, and physicians from the divisions of pediatric infectious disease, pediatric critical care, and pediatric gastroenterology. This study qualified for Institutional Review Board (IRB) exemption based on the University’s IRB stipulations.

Current Condition

Root cause analysis was performed by creating a process map of the current standard work and a fishbone diagram (Figure 1). We incorporated feedback from voice of the customer in the root cause analysis. In this analysis, the voice of the customer came from the bedside floor nurses, ultrasound clerk and sonographer, echo technician, cardiology fellow, and microbiology medical technician. We got their feedback on our process map, its accuracy and ways to expand, their thoughts on the problem and why we have this problem, and any solutions they could offer to help improve the problem. Some of the key points obtained were: echos were not routinely done on the floors and were not considered urgent as they often did not change management; the sonographer and those from the cardiology department felt imaging was often overutilized because of misconceptions and lack of available hospital guidelines. Suggested solutions included provider education with reference to Duke’s criteria and establishing a clinical pathway approved by all concerned departments.

Root cause analysis: fishbone diagram.

Prior to education, we surveyed current practices of practitioners on teams caring for these patients, which included physicians of all levels (attendings, fellows, residents) as well as nurse practitioners and medical students from the department of pediatrics and divisions of pediatric gastroenterology, pediatric infectious disease, and pediatric critical care medicine.

 

 

Countermeasures

Practitioner Education. In October 2017 practitioners were given a 20-minute presentation on the latest international guidelines on fungemia. Fifty-nine practitioners completed pre- and post-test surveys. Eight respondents were excluded due to incomplete surveys. We compared self-reported frequencies of ordering abdominal imaging and echo before the presentation with intention to order post education. Intention to change clinical practice after the presentation was also surveyed.

Clinical Pathway. Education alone may not result in sustainability, and thus we provided a readily accessible clinical pathway and an electronic order set for pediatric fungemia management. Inter-department buy-in was also necessary for success. It was important to get the input from the various teams (infectious disease, cardiology, gastroenterology, and critical care), which was done by incorporating members from those divisions in the project or getting their feedback through voice of the customer analysis.

We redefined standard work based on current evidence and created a clinical pathway during March 2018 that included variations when appropriate (Figure 2). We presented the clinical pathway to practitioners and distributed it via email. We also made it available to pediatric residents and fellows on their mobile institutional work resource application.

Clinical pathway for pediatric fungemia evaluation. This pathway applies to the immunocompetent host and excludes neonates, premature infants, bone marrow transplant recipients, and patients on immunosuppressive therapy.

Electronic Order Set. We created an electronic order set for pediatric fungemia management and made it available in the electronic health record May 2018.

 

Measurement

Cases of fungemia were identified through the electronic health record pre-intervention (January 1, 2016 through November 19, 2017) and post-intervention (November 20, 2019 through April 3, 2019). An episode of fungemia was defined as an encounter with 1 or more positive blood culture(s) for Candida species or Cryptococcus species. We manually identified patients belonging to the pediatric gastroenterology service and reviewed these charts to determine the presenting complaint, organism isolated, transplant status, central lines status, risk factors, if abdominal imaging or echocardiography were done for the episode of fungemia, and their corresponding results. We calculated overall and per patient medical charges by using the average charges at our institution of US and echocardiography with a cardiology consult. These average charges were provided by patient financial services and the pediatric cardiology department, respectively. To address non-technical expenditures, we calculated the average time taken for transport to and from radiology and the echo suite for each identified patient. We identified missed fungal endocarditis and fungal balls as balancing measures.

 

 

Results

Survey

Among the 51 practitioners surveyed, 36% were performing routine echo and 22% self-reported performing routine abdominal imaging. After education, no respondents planned to routinely do echo or abdominal imaging. All but 1 respondent planned to change their practice for evaluation of fungemia patients based on the presentation (eFigure 1).

Results of survey: Pre- and post-test frequency pie charts of echocardiograms and abdominal imaging.

Baseline Data

Over the 23-month period from January 1, 2016 to November 19, 2017, there were 21 episodes of fungemia, 18 of which occurred in patients on the pediatric gastroenterology service (2 of the 18 were transplant recipients). For the 18 episodes on this service, abdominal imaging and echo were done 100% of the time, with 0 positive findings (eFigure 2).

Pie charts of services with episodes of candidemia and flow diagrams of abdominal imaging and echocardiogram on episodes on the pediatric gastroenterology service before and after countermeasures.

Of those 18 episodes, the average age was 4.6 years, with two-thirds of the population being male. There were 3 patients with multiple episodes that accounted for 8 of the episodes (3, 3, and 2 episodes each). Fever was the most common presenting complaint. The most common organism was Candida parapsilosis (6 of the 18 episodes). All episodes but one involved a central line, and all central lines were removed when present except for one case. Of the risk factors, 3 episodes occurred in neutropenic patients, and for 1 episode the patient had a questionable history of fungal endocarditis (and was on fungal prophylaxis). There were no patients with recent cardiac/urogenital surgery or prior fungal balls. No episodes had clinical symptoms suggestive of fungal endocarditis or fungal balls.

 

Post-Intervention Data

Over the subsequent 17-month period (November 11, 2017 to April 3, 2019), there were 13 episodes of candidemia. There were no episodes of Cryptococcus fungemia. Seven episodes occurred in patients on the pediatric gastroenterology service (2 of the 7 occurred in transplant recipients). Abdominal imaging was done in 3 of these episodes (43%), and in 2 of these 3 episodes, imaging was done at an outside institution prior to arrival, with no positive results (eFigure 2).

Echocardiography was done 57% of the time (n = 4), with echo being done at an outside institution prior to arrival half of the time (n = 2), with no endocarditis identified. The cases of abdominal imaging and echo done at outside institutions prior to arrival were not impacted by the countermeasures. Excluding those 2 patients who had both abdominal imaging and echocardiography done prior to arrival, the overall rate of imaging (both abdominal imaging and echo) done after countermeasures were instituted was 30% (Figure 3).

Run chart showing percentage of fungemia cases in which imaging (abdominal and echocardiography) was done.

 

 

Of those 7 episodes, the average age was 6.8 years (57% female). There were no patients with multiple episodes. The most common presenting complaint was fever. The most common organism was Candida albicans (3 of the 7 episodes). All episodes involved a central line, which was removed in all cases except for one. Of the risk factors, 2 episodes were in neutropenic patients, and 1 episode had a history of bacterial endocarditis (not related to fungemia). No episodes occurred in patients with prior fungal renal infection, urogenital malformations, or recent cardiac/urogenital surgery. No episodes had clinical symptoms suggestive of fungal endocarditis or renal infection. No episodes of fungal endocarditis or renal infection were identified.

On average, a patient at our institution undergoing abdominal US and echo with a cardiology consult results in medical waste of approximately $3200 per patient. This cost does not take into account other miscellaneous charges possibly incurred, such as the radiologist interpreting the findings and transportation. Baseline data calculations show that patients waste on average 55 minutes in physical transport, and this does not take into account wait times.

Discussion

Candidemia contributes to 10% of central-line associated blood stream infections (CLABSI).19 Increased usage of indwelling central catheters for administration of parenteral nutrition will inevitably result in practitioners encountering cases of candidemia when caring for this population. As seen from our results, the majority of episodes of candidemia at our institution occurred on the pediatric gastroenterology service, and thus redefining standard work on this service will be impactful.

Candida parapsilosis and Candida albicans were the most common causative agents before and after intervention, respectively, but overall the most common organism was Candida albicans, which is in keeping with that of CLABSI in the literature.19 Growth of Candida parapsilosis has been particularly linked to CLABSI.19 The third most common organism in our study was Candida glabrata, which is the second most common cause of candidemia in CLABSI.19

The cases of positive abdominal imaging in fungemia in the literature are limited to the neonatal population1-4 and chronic disseminated candidiasis in patients with hematologic malignancies/neutropenia/immunosuppression.5,6 In fungal endocarditis, the reported cases were generally in neonates,1,3,7 critically ill patients,8 patients with hematologic malignancies/neutropenia/immunosuppression,6,9 or those with a cardiac history.9,10 This population differs from the patient population on the pediatric gastroenterology service. Patients on this service may not need US or echo. Performing abdominal US and echo in fungemia patients in whom such imaging is not indicated may result in medical waste of approximately $3200 per patient. There is also a waste of medical resources and time.

 

 

We found almost all practitioners are willing to change clinical practice once provided with current guidelines. Face-to-face oral presentations allowed for questions and interaction, making this form of information dissemination better than e-mails or handouts.

Though the numbers were small over the short study period, we were able to decrease overutilization of abdominal imaging and echo after implementing countermeasures. Frequency decreased from 100% to 43% and 57% for abdominal imaging and echo, respectively. Imaging that was done after the countermeasures were implemented was mainly attributed to imaging patients underwent prior to presenting to our institution. This reinforces the need for education at other institutions as well. Of the balancing measures assessed, there were no missed cases of fungal balls or fungal endocarditis. Additionally, of the total 34 episodes of fungemia assessed (21 before and 13 after), even among those with risk factors, there were no cases of fungal endocarditis or renal infection.

The findings from this quality improvement project underscore current recommendations that, despite common misconceptions, routine abdominal US and echo are not indicated in all cases of fungemia. Case-by-case assessment based on the clinical scenario remains key to management of fungemia to avoid unnecessary medical interventions.

Corresponding author: Donna Cheung, MBBS, 200 Hawkins Drive, BT 1120-G, Iowa City, IA 52242; donna.ann.cheung@gmail.com.

Financial support: None.

References

1. Benjamin DK Jr, Poole C, Steinbach WJ, et al. Neonatal candidemia and end-organ damage: a critical appraisal of the literature using meta-analytic techniques. Pediatrics. 2003;112:634-640.

2. Wynn JL, Tan S, Gantz MG, et al. Outcomes following candiduria in extremely low birth weight infants. Clin Infect Dis. 2012;54:331-339.

3. Noyola DE, Fernandez M, Moylett EH, et al. Ophthalmologic, visceral, and cardiac involvement in neonates with candidemia. Clin Infect Dis. 2001;32:1018-1023.

4. Phillips JR, Karlowicz MG Prevalence of Candida species in hospital-acquired urinary tract infections in a neonatal intensive care unit. Pediatr Infect Dis J. 1997;16:190-194.

5. Pagano L, Mele L, Fianchi L, et al. Chronic disseminated candidiasis in patients with hematologic malignancies. Clinical features and outcome of 29 episodes. Haematologica. 2002;87:535-541.

6. Zaoutis TE, Greves HM, Lautenbach E, et al. Risk factors for disseminated candidiasis in children with candidemia. Pediatr Infect Dis J. 2004;23:635-641.

7. Levy I, Shalit I, Birk E, et al. Candida endocarditis in neonates: report of five cases and review of the literature. Mycoses. 2006;49:43-48.

8. Aspesberro F, Beghetti M, Oberhansli I, et al. Fungal endocarditis in critically ill children. Eur J Pediatr. 1999;158:275-280.

9. Fernandez-Cruz A, Cruz Menarguez M, Munoz P, et al. The search for endocarditis in patients with candidemia: a systematic recommendation for echocardiography? A prospective cohort. Eur J Clin Microbiol Infect Dis. 2015;34:1543-1549.

10. Hernandez-Torres A, Garcia-Vazquez E, Laso-Ortiz A, et al. [Candida sp endocarditis. Experience in a third-level hospital and review of the literature]. Rev Esp Quimioter. 2013;26:51-55.

11. Pappas PG, Kauffman CA, Andes DR, et al. Clinical practice guideline for the management of candidiasis: 2016 Update by the Infectious Diseases Society of America. Clin Infect Dis. 2016;62:e1-50.

12. Bow EJ, Evans G, Fuller J, et al. Canadian clinical practice guidelines for invasive candidiasis in adults. Can J Infect Dis Med Microbiol. 2010;21:e122-50.

13. Ruhnke M, Rickerts V, Cornely OA, et al. Diagnosis and therapy of Candida infections: joint recommendations of the German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy. Mycoses. 2011;54:279-310.

14. Cornely OA, Bassetti M, Calandra T, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: non-neutropenic adult patients. Clin Microbiol Infect. 2012;18 Suppl 7:19-37.

15. Hope WW, Castagnola E, Groll AH, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: prevention and management of invasive infections in neonates and children caused by Candida spp. Clin Microbiol Infect. 2012;18 Suppl 7:38-52.

16. Ullmann AJ, Akova M, Herbrecht R, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: adults with haematological malignancies and after haematopoietic stem cell transplantation (HCT). Clin Microbiol Infect. 2012;18 Suppl 7:53-67.

17. Colombo AL, Guimaraes T, Camargo LF, et al. Brazilian guidelines for the management of candidiasis - a joint meeting report of three medical societies: Sociedade Brasileira de Infectologia, Sociedade Paulista de Infectologia and Sociedade Brasileira de Medicina Tropical. Braz J Infect Dis. 2013;17:283-312.

18. Kohno S, Tamura K, Niki Y, et al. Executive Summary of Japanese Domestic guidelines for management of deep-seated mycosis 2014. Med Mycol J. 2016;57:E117-E163.

19. Kojic EM, Darouiche RO. Candida infections of medical devices. Clin Microbiology Rev. 2004;17:255-267.

References

1. Benjamin DK Jr, Poole C, Steinbach WJ, et al. Neonatal candidemia and end-organ damage: a critical appraisal of the literature using meta-analytic techniques. Pediatrics. 2003;112:634-640.

2. Wynn JL, Tan S, Gantz MG, et al. Outcomes following candiduria in extremely low birth weight infants. Clin Infect Dis. 2012;54:331-339.

3. Noyola DE, Fernandez M, Moylett EH, et al. Ophthalmologic, visceral, and cardiac involvement in neonates with candidemia. Clin Infect Dis. 2001;32:1018-1023.

4. Phillips JR, Karlowicz MG Prevalence of Candida species in hospital-acquired urinary tract infections in a neonatal intensive care unit. Pediatr Infect Dis J. 1997;16:190-194.

5. Pagano L, Mele L, Fianchi L, et al. Chronic disseminated candidiasis in patients with hematologic malignancies. Clinical features and outcome of 29 episodes. Haematologica. 2002;87:535-541.

6. Zaoutis TE, Greves HM, Lautenbach E, et al. Risk factors for disseminated candidiasis in children with candidemia. Pediatr Infect Dis J. 2004;23:635-641.

7. Levy I, Shalit I, Birk E, et al. Candida endocarditis in neonates: report of five cases and review of the literature. Mycoses. 2006;49:43-48.

8. Aspesberro F, Beghetti M, Oberhansli I, et al. Fungal endocarditis in critically ill children. Eur J Pediatr. 1999;158:275-280.

9. Fernandez-Cruz A, Cruz Menarguez M, Munoz P, et al. The search for endocarditis in patients with candidemia: a systematic recommendation for echocardiography? A prospective cohort. Eur J Clin Microbiol Infect Dis. 2015;34:1543-1549.

10. Hernandez-Torres A, Garcia-Vazquez E, Laso-Ortiz A, et al. [Candida sp endocarditis. Experience in a third-level hospital and review of the literature]. Rev Esp Quimioter. 2013;26:51-55.

11. Pappas PG, Kauffman CA, Andes DR, et al. Clinical practice guideline for the management of candidiasis: 2016 Update by the Infectious Diseases Society of America. Clin Infect Dis. 2016;62:e1-50.

12. Bow EJ, Evans G, Fuller J, et al. Canadian clinical practice guidelines for invasive candidiasis in adults. Can J Infect Dis Med Microbiol. 2010;21:e122-50.

13. Ruhnke M, Rickerts V, Cornely OA, et al. Diagnosis and therapy of Candida infections: joint recommendations of the German Speaking Mycological Society and the Paul-Ehrlich-Society for Chemotherapy. Mycoses. 2011;54:279-310.

14. Cornely OA, Bassetti M, Calandra T, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: non-neutropenic adult patients. Clin Microbiol Infect. 2012;18 Suppl 7:19-37.

15. Hope WW, Castagnola E, Groll AH, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: prevention and management of invasive infections in neonates and children caused by Candida spp. Clin Microbiol Infect. 2012;18 Suppl 7:38-52.

16. Ullmann AJ, Akova M, Herbrecht R, et al. ESCMID* guideline for the diagnosis and management of Candida diseases 2012: adults with haematological malignancies and after haematopoietic stem cell transplantation (HCT). Clin Microbiol Infect. 2012;18 Suppl 7:53-67.

17. Colombo AL, Guimaraes T, Camargo LF, et al. Brazilian guidelines for the management of candidiasis - a joint meeting report of three medical societies: Sociedade Brasileira de Infectologia, Sociedade Paulista de Infectologia and Sociedade Brasileira de Medicina Tropical. Braz J Infect Dis. 2013;17:283-312.

18. Kohno S, Tamura K, Niki Y, et al. Executive Summary of Japanese Domestic guidelines for management of deep-seated mycosis 2014. Med Mycol J. 2016;57:E117-E163.

19. Kojic EM, Darouiche RO. Candida infections of medical devices. Clin Microbiology Rev. 2004;17:255-267.

Issue
Journal of Clinical Outcomes Management - 26(6)
Issue
Journal of Clinical Outcomes Management - 26(6)
Page Number
270-276
Page Number
270-276
Publications
Publications
Topics
Article Type
Display Headline
Decreasing Overutilization of Echocardiograms and Abdominal Imaging in the Evaluation of Children with Fungemia
Display Headline
Decreasing Overutilization of Echocardiograms and Abdominal Imaging in the Evaluation of Children with Fungemia
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.
Article PDF Media