Randomized controlled trial

Poetry of reality Science

We must know. We will know.

Physics Chemistry Biology Astronomy Geology

A view from the shoulders of giants.

Experimenter bias Observer effect Leap second Historical and operational science Doomsday scenario Face masks Michael Mann Unguided evolution v - t - e

A randomized controlled trial (RCT), also known as a prospective study, is a type of study that tries to evaluate a particular treatment or intervention, usually in a medical field. It is considered the most powerful and convincing form of evidence in medicine because of the number of variables that can be controlled.

Methodology

A basic RCT requires that a group of people be split randomly into two groups. One group receives the treatment under scrutiny, the other receives a suitable experimental control. The performance of the two groups is then compared to see if the new idea is worth adopting on a wider scale. This isn't a new idea; a similar non-randomized method was described in the Bible and is dated to around 600 BCE. However, it is only relatively recently that the idea has been applied to medicine.

RCTs provide a way to reduce various research biases as well as provide a comparison of outcomes in groups that differ only in the treatment received through three mechanisms: randomization, control, and blinding.

Randomization

One of the main ways that bias can creep into a medical trial is by insufficient or lack of randomization. This is because doctors can, subconsciously or intentionally, influence which patient can go into which group. Researchers who are aware of the medical history of their patients may put the ones most likely to respond in the group to receive treatment, and those with a low probability of response in the control group. This will unfairly skew the results and make them less applicable to a wider scale. Even poor randomization schemes are vulnerable to bias when the next allocation can be guessed and the treatments are inadequately blinded.

Randomization's primary purpose is to assure that each arm has roughly the same mix of subjects, such that all imaginable confounders are equally balanced across the arms. In reality, a specific randomization may be imbalanced, even severely imbalanced, but, on average, it will be reasonably balanced.

While statistical methods exist to adjust for non-random allocation, non-randomized trials often show greater apparent efficacy than their randomized counterparts. This occurs for various reasons, but, among the most common is a degree of self-selection where those finding benefit in a particular group, enroll in or stay in that group. Others select themselves out. Imagine, for example, a non-randomized trial comparing parents' satisfaction with homeschooling versus public schools. Could you predict the result ahead of time? Sure you can!

Control

To just administer a group of people a treatment gives no useful data, such as with the fish oil "trials" to test if they improved the performance of school children. A simple RCT, therefore, splits its participants into two groups, "A" and "B." One is given a treatment and the other acts as a "control," that is, a group where the outcome is known. Importantly, the control group isn't just given "nothing," as anything will usually do better than nothing. The control group is usually given a placebo, to determine if the clinical effects are real or due to the placebo effect. However, as many active drugs are likely to be better than placebos (as well as the ethics behind using placebos), the control group can also be given a medication that has a known effect. This option also provides the advantage of allowing a comparison between a current treatment and a new treatment, to see if a new treatment is worth adopting.

Blinding

One of the more important aspects is blinding. This is where a patient is unaware if they are receiving a real treatment or a control treatment, thus preventing the placebo effect and early dropout from disappointed control group members. A group of patients who are told they are receiving a new treatment are likely to respond more positively to it, therefore it should be hidden from them. Similarly, the researchers themselves should be blinded. This prevents researchers from redoing or reinterpreting data to suit their interests, even when it isn't intentional or malicious. To be utterly complete, the blinding should not allow anyone to know that two people are in the same group (even if they don't know what that group is). When both patient and researcher are blinded, it is known as "double-blind".

"Blinding", the term, is not without controversy, particularly in opthalmological studies, where the word "masking" is suggested as an alternative.

Opposition

Proponents of alternative medicines often claim that RCTs are not good means of testing their wares. Within homeopathy, one claim is that the treatment process is extremely individualized and can't be carried out in a strict protocol. Instead, they advocate "pragmatic" trials wherein the treatment skips the typical step of proving efficacy and moves straight into effectiveness trials.

Alternately, objections to RCT may be because RCTs invariably show that alternative medicine isn't effective — indeed, if an alternative medicine is shown to be effective by RCT, it ceases to be "alternative" and merely becomes "medicine". There are numerous specific claims, from the claim that "there's more to life than evidence" to the idea that certain alternative medicines like homeopathy can't have proper placebos generated for them. Given that even very theatrical placebo operations have been carried out to test the efficacy of key-hole surgery, there are clearly very few things where a suitable placebo cannot be devised.

To be fair, RCTs are not best used in the discovery phase of research. but rather for confirmation of efficacy. Still, to claim efficacy, an RCT is hard to beat.

Use outside medical research

Noted woo-exposer Dr. Ben Goldacre has argued that politicians ought to use randomised controlled trials for testing their policies. For example, a proposal to decrease class sizes in schools to increase educational performance could be tested by dividing a group of schools into two subgroups at random. Dr. Goldacre has expressed frustration that politicians seem to think implementing a policy without any scientifically-gathered evidence behind it — or even in defiance of all the evidence — is perfectly fine.

Ironically, RCTs already have been used in developing countries in this way, but are generally politically "unthinkable" in developed countries.

Doing politics via experiments raises serious ethical issues. However, simply subjecting an entire population to a new policy on the basis that "my buddies in the think tank paid by multinational corporations assure me it's a very good idea, and we can sell it to the electorate in such a way that it polls tolerably well" arguably also raises serious ethical issues. Especially when those same corporations stand to benefit handsomely from the policy (regulatory capture) — but hey, how likely is that, right?