Ratio Scientiae
RATIO SCIENTIAE BLOG
  • Home
  • Meet the Author
  • Ratio Scientiae Blog
  • Random Science
  • Writing & News
  • Nonfiction Books
    • Science Can Be Right Because It Can Be Wrong
    • The Gift of Science
    • Random Science
  • Fiction Books
    • The Sun Zebra
    • Spirit Women
  • Science Cat (Mascot)
  • Contact

9/27/2022

Do’s and Don’ts Regarding How To Assess Scientific Studies in the Age of the Internet and Social Media

2 Comments

Read Now
 
Picture
A positive aspect of the advent of the internet is that scientific studies can be made public as soon as they are ready to be published. However, these studies are highly technical publications that are intended for scientists to study and analyze. Thus, one negative effect of greater accessibility to the scientific literature is that individuals without the education and technical knowledge necessary to evaluate the studies can now gain access to them. As a result, these individuals may disseminate in their blogs, podcasts, social media, and other outlets erroneous claims about these studies either because they misunderstood them, or because they may have an agenda directed at favoring certain interpretations of the studies, even if these interpretations are not supported by the data.
 
I have lost track of the number of times I have seen someone on Twitter making claims about some issue by citing the latest published scientific article. Invariably the purpose of the individuals making these claims is not to discover or debate the truth, but rather to support their political or social agendas. I have tried to explain that truth in science is not established by one or even a few studies, even if they are published in peer-reviewed journals. Scientists have to debate the merits and flaws of each other’s studies, and this is a process that will take time. During this process scientists may make claims that they may later recant when more evidence becomes available, or a study that was heralded as a good study may fall in disfavor if it is realized that certain variables that turn out to be important were not controlled. But when scientists do these normal things that are part of the scientific process, they are accused of flip-flopping or selling out to special interests.
 
The above process is amplified by various types of media which reach millions of people and contribute to create confusion and suspicion when people see narratives change. I saw this happen with hydroxychloroquine. A study would come out indicating hydroxychloroquine (HCQ) had an effect against COVID-19, and all the HCQ proponents would brag about how the issue was settled and HCQ worked. Then another study would come out showing that HCQ did not have an effect, and all the HCQ critics would claim HCQ did not work. In the middle of the storm, certain responsible scientists or organizations would comment about the studies pointing out flaws or strengths, and they would be denounced by the pro or con side. Eventually enough studies accumulated, and they showed not only that HCQ does not work against COVID-19, but also why it does not work. However, by then HCQ had lost its appeal as a political issue.
 
I have seen this happening again with the drug ivermectin. A study came out of Brazil using a population of 88,012 subjects where ivermectin brought about a reduction of 92% in COVID-19 mortality rate. The pro-ivermectin crowd declared victory, bragged about how they had been right all along, and pointed out that the withholding of ivermectin had led to many preventable deaths from COVID-19. The truth, however, was very different. This was an observational study where the allocation of patients to treatments was not randomized, which can lead to serious biases in the data. And while a sample size of 88,012 subjects sounds impressive, the actual comparisons were performed on much smaller subsets. For example, the 92% result came from comparing 283 ivermectin users to 283 non-users. Additional problems involved the exclusion of a large number of subjects and the non-control of ivermectin use. Finally, there is no way that an effect of such a large magnitude (92%) would not have been detected when performing better designed and controlled trials, but that has not been the case.
 
As I have pointed out before, the politization of science creates a caustic environment where the work of scientists is mischaracterized or attacked by unscrupulous individuals, and this makes the process of science much harder than it already is.
 
To avoid all the problems mentioned above, I have put together a list of do’s and don’ts regarding how to assess scientific studies in the age of the internet and social media.
 
1) Do listen to what scientists have to say about the studies. They are experts in their field, and an expert is called that for a reason. They have studied many years and trained to do what they are doing. Do not assume you know more than the experts. Do not merely quote a study in your blog or social media to defend a position. Rather, do report on the debate among scientists regarding the strengths and weaknesses of the study and identify unanswered questions.
 
2) Do give scientists the time to evaluate and debate the studies and to reassess the studies as more information becomes available. Do not attack scientists for changing their minds.
 
3) To make up your mind, do wait for several studies to accumulate and for the majority of scientists to reach a consensus regarding the studies. However, this consensus will not be arrived at based on the total number of studies, but rather on their quality. One study of good quality can be more meaningful than dozens of low-quality studies, and the community of scientists (not a single scientist) is the ultimate arbiter regarding the quality of the studies.
 
4) Do not judge scientists or the results from their studies by their affiliations to companies or other organizations. The studies have to be judged on their merits. Do not make offhand claims that conflicts of interest have corrupted the science if you don’t have any evidence for it. Hearsay, innuendo, and ignorance are not proof of anything.
 
5) Success in science is measured by the ability of scientists to convince their peers. Scientists who have been unable to convince their peers and who bypass the normal scientific process to take their case to “the people” are a huge red flag. Do not blindly trust the renegade scientists who claim they are ignored by their peers. These scientists are often ignored because their studies are deficient and their ideas are unconvincing.
 
6) Do not defend and promote a scientific claim just because a celebrity or politician whom you trust or like has endorsed it. Endorsement by a non-scientist of a scientific claim without any hard evidence is irrelevant to the scientific debate. Science is not politics.
 
If everyone follows these guidelines, we can hopefully restore a measure of rationality to the scientific discourse among the public.

 
Image by Tumisu from pixabay is free for commercial use and was modified.


Share

2 Comments
Details

    Categories

    All
    911
    Absence Of Evidence
    Adrenaline
    Adrenochrome
    Advances In War Medicine
    Affidavits
    Airplane On Conveyor Belt
    Alder's Razor
    Alfred Wegener
    Alzheimer's Disease
    Amyloid Theory
    Ancient Astronauts
    Animal Rights
    Animals
    Anthony Fauci
    Anthropomorphism
    Antibodies
    Anti Vaccination
    Astronauts
    Authority Figure
    Autumn
    Bambi
    Believers
    Bias
    Big Bang Theory Sitcom
    Bigfoot
    Bill Ney
    Black Death
    Black Holes
    Blind Experimental Design
    Brain
    Brains
    Building 7
    Buoyancy
    Cancer
    Cannonballs
    Carnivores
    Catoctin Mountains
    Cell Culture
    Center Of Mass
    Challenger
    Chance
    Chemical Names
    Chemical Reactions
    Chemtrails
    Chesapeake Bay
    Child Abuse
    Child Testimonies
    Chimborazo
    Citations
    Citogenesis
    Civil War
    Climate Change
    Climategate
    Climate Skeptics
    Clinical Trial
    Coelacanth
    Coincidence
    Cold-Stress
    Communicating Science
    Completeness Of Scientific Theories
    Consciousness
    Conspiracy
    Contrails
    Controls
    Coquina Rock
    Coronavirus
    Counterintuitive Facts
    COVID19
    COVID 19 Vaccine
    COVID-19 Vaccine
    Creationism
    Cross-Sectional Method
    Cryptozoology
    Dan Shechtman
    Demonic Possession
    Density
    Devotion To Science
    Dihydrogen Monoxide
    Dinosaurs
    Discrimination
    Disgust
    Dishonesty In Science
    Diversity In Methodologies
    Diversity In Scientists
    DNA
    Doctors
    Dog Experiments
    Donald Trump
    Double Slit Experiment
    Do Your Own Research
    Dreams
    Dr. Gloom's Crypt Of Curiosities
    Drugs
    Dust Bunnies
    Eclipse
    Efrain Racker
    Einstein
    Elections 2020
    End Of The World
    Erosion
    Established Science
    Everest
    Evidence
    Evolution
    Exorcism
    Experimenter Bias
    Experiments You Can Do In Your Home
    Experts
    Extinction
    Face Masks
    Facts
    Faith
    Faith Healing
    Fall
    Falsifiability
    Fantastical Claims
    Fauna
    Fear
    Feynman
    Finger Snapping
    Fosbury Flop
    Francis Crick
    Frankenstein
    Fraud
    Frederick's Municipal Forest
    Free Will
    Friction
    Fruit Fly
    Funerals
    Funny
    Galaxies
    Genes
    Genius
    Geology
    Ghost
    Global Warming
    Global Warming Denial
    God
    Gravitational Lens
    Gravitational Waves
    Gravity
    Gun Violence
    Hanlon’s Razor
    Hearing
    Hearing Aids
    Hearing Loss
    HeLa Cells
    Henrietta Lacks
    Heroic Science
    Hitchens's Razor
    Hoax
    Homosexuality
    HPV Vaccine
    Human Experimentation
    Human Folly
    Hunting
    Hurricane
    Hydroxychloroquine
    Hypothesis
    Ignaz Semmelweis
    Ignorance As Evidence
    Immunotherapy
    Infamy Or Glory
    Influenza
    Insults
    Intelligence
    Intelligence Tests
    Intelligent Design
    Intersex
    Iraq War
    Irish Washerwoman
    Isaac Asimov
    James T. Kirk
    James Watson
    Katherine Hayhoe
    Language
    Lazarus Effect
    Left Fork Rocks
    Level Of Detail
    Libet Experiment
    Lightning
    Limericks
    Limitations Of Science
    Loch Ness Monster
    Lord Howe Island Stick Insect
    Loud Music
    Luck
    Mad Scientist
    Magnus Effect
    Malaria Vaccine
    Max Planck
    Medical Risks
    Medical Terms
    Mediums
    Men
    Mental Illness
    Mice
    Microbiome
    Milgram Experiment
    Mind
    Mind In The Gutter
    Misuse Of Science
    MMR Vaccine
    Mnemonic Devices
    Moments Of Discovery
    Monty Hall Puzzle
    Moon
    Movies
    NASA
    Natural
    Nature
    Nature Of Science
    Negative Evidence
    Nerds
    Newton
    Nobel Prize
    NOMA
    N-Rays
    Obesity
    Occam's Razor
    Open Mind
    Ouija Board
    Outreau
    Oxbow Lakes
    Para-Dimethylaminobenzaldehyde
    Paranormal
    Pasteur Louis
    Peak Of Illusion
    Peers
    Perception
    Philosophy
    Phobias
    Phrenology
    Physics
    Pink Lady's Slippers
    Plague
    Politicization Of Science
    Polywater
    Popper’s Falsifiability Principle
    Possible/Impossible
    Power To The People!
    Predatory Journals
    Pregnancy
    Premonitions
    Probability
    Propaganda
    Prophesy
    Pseudoscience
    Psychic
    Publication
    Puerperal Fever
    QAnon
    Quack
    Quackery
    Quantum Mechanics
    Quartzite
    Racism
    Radical New Ideas
    Radioactivity
    Radium
    Randomness
    Ratio Sapientiae
    Ratio Scientiae
    Reality
    Reason
    Religion
    Rock Climbing
    Rosalyn Franklin
    RSV Vaccine
    Sagan's Standard
    Salem Witch Trials
    Sample Size
    Science Fiction
    Science Jokes
    Science Pranks
    Scientific Consensus
    Scientific Establishment
    Scientific Guidelines
    Scientific Journals
    Scientific Method
    Scientific Names
    Scientific Question
    Scientific Terms
    Scientific Theories
    Seashells
    Self-Experimentation
    Shape Of The Earth
    Skepticism
    Skeptics
    Skin Color
    Slavery
    Snake Oil
    Soccer
    Sonic Hedgehog
    Space
    Spanish Flu
    Spontaneous Generation
    Stanley Prusiner
    Stars
    Star Trek
    Statistical Significance
    Statistics
    Sublime/Ridiculous
    Suicide
    Sun
    Superstition
    Surface To Volume Ratio
    Swanson Conversion
    Swine Flu
    Tangier Island
    Taxonomy
    Technical Details
    The Support Of God
    Thomas Young
    Timeline Method
    Tooth Worm
    Transposable Elements
    Trusted Messenger
    Trust In Scientists
    Truth
    Tyranny Of Fantasy
    Understanding
    Universe
    Vaccine Hesitancy
    Vaccines
    Vacuum
    VAERS
    Valley Of Despair
    Values
    Video Games
    West Side Story
    West Virginia Penitentiary
    Wikipedia
    William Shatner
    Wolf Rock
    Women
    World Trade Center
    Xenophobia
    Y Chromosome
    Zinc
    Zombies

    Archives

    October 2024
    September 2024
    August 2024
    July 2024
    June 2024
    May 2024
    April 2024
    December 2023
    November 2023
    October 2023
    September 2023
    May 2023
    April 2023
    March 2023
    February 2023
    January 2023
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    May 2017
    April 2017

    RSS Feed

Proudly powered by Weebly
  • Home
  • Meet the Author
  • Ratio Scientiae Blog
  • Random Science
  • Writing & News
  • Nonfiction Books
    • Science Can Be Right Because It Can Be Wrong
    • The Gift of Science
    • Random Science
  • Fiction Books
    • The Sun Zebra
    • Spirit Women
  • Science Cat (Mascot)
  • Contact