We Need to Embrace All Forms of Evidence to Accelerate the Pace of Research in Lyme Disease
Research Disadvantaged Diseases Create Research Engines Using Patient Registries
Chronic Lyme disease is a research disadvantaged disease. Compared to other diseases very little clinical research has been conducted—particularly for the treatment of chronic Lyme disease where patients remain ill for six or more months following a short course of antibiotics. The National Institute of Health has funded just three clinical trial grants for the treatment of chronic Lyme disease.
Although Lyme disease is estimated to have over 400,000 cases per year, data from clinicaltrial.gov indicates that research for Lyme disease trails behind leprosy, which has an incidence of less than 200 cases a year (Goswami 2013). To date, pharma has shown no interest in developing new treatment drugs for chronic Lyme disease.
This means that even though it is not a rare disease, Lyme disease faces the same research challenges that rare diseases encounter. One way research disadvantaged diseases address their unmet needs is to build a research engine that facilitates and accelerates the pace of research by linking patient registries, biorepositories, and clinical data networks (Groft 2014). The NIH and the Patient Centered Research Outcomes Institute (PCORI) as well as the Agency for Healthcare Research and Quality have led efforts in this area. Dr. Francis Collins recently acknowledged the vital role that the patient led research in characterizing long haul COVID-19 (NIH Directors Blog 2020). Research in chronic Lyme disease needs to move forward at a much more rapid pace than it has historically. To do this it needs to take advantage of all forms of research, including observational research using patient registries.
[tweet_box]Although Lyme disease is estimated to have over 400,000 cases per year – research for Lyme disease trails behind leprosy, which has an incidence of less than 200 cases a year.[/tweet_box]
The MyLymeData Patient Registry and Research Platform
In 2015, LymeDisease.org (LDo) launched the first national patient registry and research platform for Lyme disease, MyLymeData, which was developed as part of PCORnet, PCORI’s patient-driven research effort, when I served on its Executive Committee. I continue to serve as a subject matter expert in patient registries for PCORnet registries through the University of Chicago.
MyLymeData has enrolled over 14,000 patients, collected over 5 million data points, published five peer-reviewed studies, and seven white papers and scientific posters (Johnson 2011, 2014, 2016, 2018, 2019, 2020). It has been highlighted in two chapters in college text books and three government white papers on patient registries (Johnson 2019, Peay 2020). We collaborate with academic researchers at UCLA and the University of Washington as well as the Lyme Biobank, a project of the Bay Area Lyme Foundation. We just published our fifth big data study with UCLA researchers who received a National Science Foundation grant to explore artificial intelligence techniques using data from the registry.
All Forms of Evidence Are Essential and Each has Unique Advantages and Limitations
When the optimal treatment, duration, or combination of treatments is unknown, as it is in Lyme disease, the process of conducting back-to-back sequential randomized controlled trials to determine the best treatment approach is not realistic (Savor 2001). To accelerate the slow pace of research and to provide real-world evidence, observational data like those collected in patient registries hold enormous appeal for the type of detailed analysis essential to precision medicine (Kent 2018).
All data sources have their strengths and limitations depending on their source and characteristics. For example, randomized controlled trials are uniquely valued because of their ability to determine cause and effect, but they do so in a process that is inherently time intensive and expensive, typically measuring the effect of a single intervention at a time and generating knowledge sequentially. As one researcher noted:
“It can take more than a decade for a trial to progress from the idea stage to actionable information, and cost and complexity mean that many questions will never be addressed with such trials” (Howie 2014)
In addition, small exclusionary RCT trials, such as the NIH CLD treatment trials, are not generalizable to most patients seen clinically.
RCT trials often use average treatment effects from small, highly selective samples. Applying these results to the clinical population is problematic because of the lack of generalizability of these trials. Many clinical trials conducted in the US report on average treatment results, with some concluding that there is no treatment effect (Guyatt 2008). In essence, these studies are reporting on results for the “average” patient despite the variation in patient characteristics and outcomes seen in clinical practice (Kent 2018).
In contrast, patient registries reflect real-world behavior and practices and employ fewer inclusion and exclusion criteria (Dryer 2018). Studies with small sample sizes also preclude the type of subgroup analysis essential to identify treatment responders and only are able to detect large treatment effects (Kent 2018). Sample sizes in the thousands or tens of thousands are required to detect the small or moderate treatment effects that most patients would regard as meaningful (Guyatt 2008). Although a treatment may be clinically significant, the signal may not be apparent in a small study sample (National Academies of the Sciences, Engineering and Medicine 2017).
Because patient registries reflect real-world behavior and practices and employ fewer inclusion and exclusion criteria, they are more inclusive than randomized controlled trials and more generalizable to patients seen in clinical practice (Dryer 2018). They can also assess multiple treatment interventions used by clinicians in the real world and may reflect greater geographic diversity because they are internet based. Although patient registry samples are self-selected and rely on self-reported information, self-reported information is reported to improve accuracy of patient data and has been found to have acceptable levels of reliability when compared to medical chart information (Dryer 2018).
Similarly, convenience samples drawn from clinicians may have inherent sample bias reflecting the geographic location of the office as well as the treating style of the physician (and whether patients select to be treated by the physician). Insurance databases are broad but are limited to the data they collect and only include those whose treatment is covered by the insurance plan. (Many Lyme patients report that their physicians do not accept insurance.) Electronic health records may be limited by their intended utilitarian focus (billing claims).
The bottom line is that each form of evidence is vital in research despite the limitations inherent in each. Often ground truth is established when different forms of research evidence produce corroborating findings. Patient registries play a critical role in characterizing a disease, assessing real world treatments used in clinical settings, evaluating the effectiveness of different standards of care, and documenting treatment side effects. As such, they should be a central part of the research tool kit to improve patient care in Lyme disease.
If you are a patient who is not enrolled in MyLymeData, please enroll today. If you are a researcher who wants to collaborate with us, please contact me directly.
The MyLymeData Viz Blog is written by Lorraine Johnson, JD, MBA, who is the Chief Executive Officer of LymeDisease.org. You can contact her at lbjohnson@lymefaces.com. On Twitter, follow her @lymepolicywonk.
We invite you to comment on our Facebook page.
Visit LymeDisease.org Facebook Page