Exposing Flaws in Acupuncture Research

12 months ago 41

??Since founding the “Acupuncture Now Foundation” 5 years ago, one of our goals was to bring attention to problems with research protocols that cause an underestimation of acupuncture’s effectiveness.  We took a big step toward achieving that goal with...

Picture

?

?Since founding the “Acupuncture Now Foundation” 5 years ago, one of our goals was to bring attention to problems with research protocols that cause an underestimation of acupuncture’s effectiveness.  We took a big step toward achieving that goal with the publication of an editorial article in a peer reviewed journal; the March 2020 issue of the “Integrative Medicine Research” journal. You can download a free copy of that article here.

I am going to be blunt here – in my opinion, the world of acupuncture research is a hot mess. There are many reasons for this but the biggest one is because the acupuncture community has never produced clinical practice guidelines. Without such guidelines hundreds of acupuncture trials have been conducted using clinical protocols that do not allow acupuncture to be as effective as it could be and this has severely slowed acupuncture’s acceptance.

Imagine hundreds of studies being done on a drug where those conducting the research don’t know what the most effective dose of that drug might be and you have an idea what has been happening for decades with acupuncture research. These poor clinical quality trials have polluted the body of evidence on acupuncture and continue to do so. In this blog post, I want to summarize 10 key points we detail in our article.If the number and frequency of acupuncture treatments did not matter, there would never be a need to do more than one treatment. Dosage matters but there are no guidelines on dosage to guide researchers.In China, acupuncture treatments are often begun at a daily or every other day frequency and dozens of treatments might be used in total especially for chronic conditions. While socio-economic factors no doubt play a role in the treatment dosages seen in China, that does not mean clinical factors do not also play a role.Chinese research on acupuncture often reports much higher effectiveness rates than typically seen in Western research.There may well be a relationship between the higher dosage of treatments used in Chinese research and the higher effectiveness rates reported there.U.S. managed care health plans are usually obligated to keep paying for therapy that can be expected to provide benefit but are not obligated to provide care once the therapy reaches the maximum therapeutic benefit (known as reaching MTB).A managed care policy showing how many treatments may be needed to reach MTB for musculoskeletal conditions treated with physical therapy, chiropractic and acupuncture concluded it can take up to 12 weeks of at least twice weekly treatments to reach MTB.Very few acupuncture research studies done in the West employ anywhere near that number and frequency of treatments.Some acupuncture studies were not intended to test how effective acupuncture could be but rather to test a limited application of acupuncture. However, because there are no reporting guidelines encouraging researchers to make clear if their study is intended to test a limited application or to test acupuncture’s MTB, those limited studies can be mistaken for full effectiveness studies.A surprising trend in sham (placebo) controlled acupuncture trials is that real and sham acupuncture can show equal effectiveness for pain control at up to 8 weeks but real acupuncture can become more effective than sham at 12 weeks and beyond. Conclusion: Many acupuncture studies can be underestimating acupuncture’s actual effectiveness because they use too few and infrequent treatments, limited studies can be mistaken for full effect studies, and while real vs. sham acupuncture can demonstrate equal effectiveness in the early stages of treatment, real acupuncture may then surpass sham if enough treatments are done and monitored over a long enough period of time.  
In addition to identifying these problems and the evidence that supports these concerns, our article also offers five recommendations for how to address these issues moving forward.

We believe we have made a well-reasoned and evidence-based case for the need to address these problems and we are doing all we can to raise awareness of these issues. However, there needs to be more discussion of these issues both within the acupuncture research community and the practitioner community. We especially need experienced clinicians to offer their opinions on the issue of treatment dosage. Ultimately, the practitioner community needs to develop clinical practice guidelines.  

Research that has found modest effectiveness for acupuncture and especially for little, if any, benefit beyond sham has done more to harm acupuncture’s acceptance than anything else. Judgments have been made not just about how effective acupuncture may be but if acupuncture is even a legitimate therapy at all. Countless people around the world including those in the media and in policymaking positions have accepted the judgement that acupuncture has been “proven” to be nothing more than a placebo. And, while we are seeing this resistance to acupuncture slowly start to fade in the U.S., the problems with research we detail is still slowing acupuncture’s acceptance in the U.S. In many parts of the world that resistance is very strong.

After having spent 5 years trying to raise awareness about these problems I can tell you this: There is no acupuncture research police out there checking to see if the hundreds of trials “investigating” acupuncture each year are using quality clinical protocols. The handful of ANF volunteers who have reviewed hundreds of trials trying to better understand why so many find mediocre effectiveness rates have only scratched the surface. We do not, nor does anyone else I am aware of, have the resources to investigate the great number of trials that are being published each year to see if their findings are legitimate. The only ones doing this are the skeptics that will rip apart any trial that finds good outcomes for acupuncture. Everyone who wants to see acupuncture become more accepted should be concerned and maybe even angry over this and what we detail in our article.

Please download and read our article and encourage your colleagues to do the same. And here is the link to the managed care policy on Maximum Therapeutic Benefit we reference. If you are a member of an acupuncture/TCM organization, ask your leadership if they are aware of our article and what they think and are doing about it. We also invite you to comment here on this blog site and will respond as time allows. Thank you.
Matthew Bauer, L.Ac.
President, The Acupuncture Now Foundation


View Entire Post

Read Entire Article