Ratio Scientiae
Ratio Scientiae Blog
  • Home
  • Meet the Author
  • Ratio Scientiae Blog
  • Random Science
  • Writing & News
  • Nonfiction Books
    • Science Can Be Right Because It Can Be Wrong
  • Fiction Books
    • The Sun Zebra
    • Spirit Women
  • Science Cat (Mascot)
  • Contact

7/5/2018

Gaming the System in Science

0 Comments

Read Now
 
A long time ago I had a conversation with a colleague regarding another scientist. This other scientist was a seemingly successful individual who had published more than a hundred articles in peer-reviewed journals. My colleague stated that he thought that this individual was not a real researcher because he had merely “gamed the system”.
 
Somewhat puzzled I inquired as to why he thought this individual, whom everyone regarded as a successful scientist, was not a researcher. He responded that this individual’s research was devoid of any guiding set of questions. It was disjointed and chaotic. Many of this individual’s publications resembled a mass production conveyor belt set up in collaboration with other labs with the aim of churning out articles that addressed low risk questions. Additionally, my colleague argued that in many publications this individual had been included as an author solely because of access granted to other researchers to technology or tissue samples that they would not have otherwise had. He concluded by stating that this individual had made a career by drilling where drilling is easy and mastering the art of serial scientific publishing. My colleague again added, “This person is not a real researcher, he has just figured out how to game the system.”
 
Now, many scientists are opinionated individuals with strong personalities, and more often than not they don’t have the nicest things to say about other scientists with whom they have butted heads. I don’t know if my colleague was right, but most scientists will tell you that they know someone who fits the unflattering description that my colleague made of this other scientist. There are indeed scientists that use several methods to game the system, and these methods range from those that don’t quite follow the “spirit” of what science should be to those which are flagrantly criminal.
 
Here I list some of these methods:
​
Picture
1) In science there is a huge pressure to publish. The axiom “publish or perish” embodies this conception of results-oriented science. The upside of this approach is that you can gauge the productivity of researchers by their number of publications. This approach allows accountability and rational planning in the allocation of resources based on performance. The downside of this approach is that it encourages researchers to think about publications rather than science. Thus there will invariably be individuals who will excel at publishing rather than at answering meaningful scientific questions. These individuals have mastered the art of breaking up scientific problems into many little parts each of which will generate sufficient data to produce at least one publication (what has been dubbed the LPU or least publishable unit), and they team up with other like-minded labs to produce a steady stream of publications where they are coauthors in each other’s articles. 
​

2) Another metric employed to evaluate scientists is citations. The concept is very straightforward. If what you publish is of interest to other scientists, they will cite your published articles in their publications. This metric allows evaluators to go beyond the mere volume of published articles in evaluating scientists. Thus scientists who publish a lot of inconsequential articles can be singled out using this metric and separated from those whose publications generate a lot of excitement within the scientific community. However, a way around this approach has been found in the form of the citation tit for tat (i.e. I will cite your articles if you cite mine). The extent to which this practice occurs is difficult to gauge, but it ranges from something that may happen among a few labs in an uncoordinated way to full-fledged “citations cartels” whose individuals blatantly engage in boosting each other’s citations.
 
3) In each field of science there are a series of top journals in which all scientists in the field wish to publish. Publication in a top journal means more exposure, more prestige, and more citations. In fact the quality of the journals in which scientists publish is also a metric that is taken into account when evaluating them. But what is a scientist to do if the work they are doing is not good enough to be published in a top journal? As it turns out, you can buy the authorship! In certain areas of the world there are black markets where scientists can purchase a slot in a publication as a coauthor for a certain amount of money.
 
4) In today’s fragmented scientific landscape where practically a lifetime of study and research is required to become an expert even in relatively small scientific fields, it is virtually impossible for a journal to have enough reviewers to cover the full breadth of topics represented by the articles that are submitted for publication. To remedy this, many journals allow authors to recommend reviewers for their articles. This practice has led to abuses ranging from authors recommending their friends to review their papers, to outright fake positive reviews.
 
And last, but definitely not least, we come to the most infamous practice of them all to game the system.
 
5) In the idealized notion of science, scientists formulate hypotheses, perform experiments, and learn from the outcome of these experiments whether it supports their hypotheses or not. However, the cold hard truth is that if none of your hypotheses prove to be true and this goes on for too long, your career may be in serious trouble. Look at it from the point of view of the agencies that fund scientific research. Why support someone who keeps barking up the wrong tree? It is then that some individuals in this bind are tempted to engage in fraud by faking their results. This fakery can range from selective publishing, where positive data is reported and negative data is ignored, to massive and systematic forging of data on dozens of publications.
 
To be fair, the use of some of the above practices by scientists (with the exception of the most extreme forms of gaming the system) is not necessarily negative. Competent scientists may wish to tackle worthy scientific questions that may take years to solve with potentially little to show for it during the process.  However, these individuals realize that if they try to answer these questions head-on they will not be favored by the current evaluation system. Thus they divide their research into low risk “bread and butter” projects designed to meet pesky publication requirements, and those projects where they address the meaningful but risky questions they really want to tackle. These scientists may also figure out that if they collaborate with and cite the right people or recommend friendly reviewers, this will provide them with the stability they need to devote themselves to the important issues.
 
Many scientists have been known to engage in the more benign forms of gaming the system, but whereas most use these procedures to fulfil evaluation requirements while they address important scientific questions, some use these practices merely to survive and further their careers. Of course, the ultimate evaluation of the achievements of a researcher will come not from citation metrics or number of publications, but rather from the actual real world impact of their research.
 
This is a metric that can’t be gamed.

 
Figure by Selena N. B. H. used here under an Attribution 2.0 Generic (CC BY 2.0) license.

Share

0 Comments

Your comment will be posted after it is approved.


Leave a Reply.

Details

    Categories

    All
    911
    Absence Of Evidence
    Adrenaline
    Adrenochrome
    Advances In War Medicine
    Affidavits
    Alder's Razor
    Alfred Wegener
    Alzheimer's Disease
    Amyloid Theory
    Ancient Astronauts
    Animal Rights
    Animals
    Anthony Fauci
    Anthropomorphism
    Antibodies
    Anti Vaccination
    Astronauts
    Autumn
    Bambi
    Believers
    Bias
    Big Bang Theory Sitcom
    Bigfoot
    Bill Ney
    Black Death
    Blind Experimental Design
    Brain
    Brains
    Building 7
    Buoyancy
    Cancer
    Cannonballs
    Carnivores
    Catoctin Mountains
    Cell Culture
    Center Of Mass
    Challenger
    Chance
    Chemical Names
    Chemical Reactions
    Chemtrails
    Chesapeake Bay
    Chimborazo
    Citations
    Citogenesis
    Civil War
    Climate Change
    Climategate
    Climate Skeptics
    Clinical Trial
    Coelacanth
    Coincidence
    Cold-Stress
    Communicating Science
    Completeness Of Scientific Theories
    Consciousness
    Conspiracy
    Contrails
    Controls
    Coquina Rock
    Coronavirus
    Counterintuitive Facts
    COVID19
    COVID 19 Vaccine
    COVID-19 Vaccine
    Creationism
    Cross-Sectional Method
    Cryptozoology
    Dan Shechtman
    Demonic Possession
    Density
    Devotion To Science
    Dihydrogen Monoxide
    Dinosaurs
    Discrimination
    Disgust
    Dishonesty In Science
    Diversity In Methodologies
    Diversity In Scientists
    DNA
    Doctors
    Donald Trump
    Double Slit Experiment
    Do Your Own Research
    Dreams
    Dr. Gloom's Crypt Of Curiosities
    Drugs
    Dust Bunnies
    Eclipse
    Efrain Racker
    Einstein
    Elections 2020
    End Of The World
    Erosion
    Established Science
    Everest
    Evidence
    Evolution
    Exorcism
    Experimenter Bias
    Experiments You Can Do In Your Home
    Experts
    Extinction
    Face Masks
    Facts
    Faith
    Faith Healing
    Fall
    Falsifiability
    Fantastical Claims
    Fauna
    Fear
    Feynman
    Finger Snapping
    Fosbury Flop
    Francis Crick
    Frankenstein
    Fraud
    Frederick's Municipal Forest
    Free Will
    Fruit Fly
    Funerals
    Funny
    Galaxies
    Genes
    Genius
    Geology
    Global Warming
    Global Warming Denial
    Gravitational Waves
    Gravity
    Gun Violence
    Hanlon’s Razor
    HeLa Cells
    Henrietta Lacks
    Heroic Science
    Hitchens's Razor
    Hoax
    Homosexuality
    Human Experimentation
    Human Folly
    Hurricane
    Hydroxychloroquine
    Hypothesis
    Ignaz Semmelweis
    Ignorance As Evidence
    Immunotherapy
    Infamy Or Glory
    Influenza
    Insults
    Intelligence
    Intelligence Tests
    Intelligent Design
    Iraq War
    Irish Washerwoman
    Isaac Asimov
    James Watson
    Katherine Hayhoe
    Language
    Lazarus Effect
    Left Fork Rocks
    Level Of Detail
    Libet Experiment
    Lightning
    Limericks
    Limitations Of Science
    Loch Ness Monster
    Lord Howe Island Stick Insect
    Mad Scientist
    Magnus Effect
    Max Planck
    Medical Risks
    Medical Terms
    Mediums
    Mental Illness
    Mice
    Microbiome
    Mind
    Mind In The Gutter
    Misuse Of Science
    MMR Vaccine
    Mnemonic Devices
    Moments Of Discovery
    Monty Hall Puzzle
    Movies
    NASA
    Natural
    Nature
    Nature Of Science
    Negative Evidence
    Nerds
    Newton
    Nobel Prize
    N-Rays
    Obesity
    Occam's Razor
    Open Mind
    Ouija Board
    Oxbow Lakes
    Para-Dimethylaminobenzaldehyde
    Paranormal
    Pasteur Louis
    Peak Of Illusion
    Peers
    Perception
    Philosophy
    Phobias
    Physics
    Pink Lady's Slippers
    Plague
    Politicization Of Science
    Polywater
    Popper’s Falsifiability Principle
    Possible/Impossible
    Power To The People!
    Predatory Journals
    Pregnancy
    Premonitions
    Probability
    Prophesy
    Pseudoscience
    Psychic
    Publication
    Puerperal Fever
    QAnon
    Quack
    Quackery
    Quantum Mechanics
    Quartzite
    Racism
    Radical New Ideas
    Randomness
    Ratio Scientiae
    Reality
    Reason
    Religion
    Rock Climbing
    Rosalyn Franklin
    Sagan's Standard
    Salem Witch Trials
    Sample Size
    Science Fiction
    Science Jokes
    Science Pranks
    Scientific Consensus
    Scientific Establishment
    Scientific Guidelines
    Scientific Journals
    Scientific Method
    Scientific Names
    Scientific Question
    Scientific Terms
    Scientific Theories
    Seashells
    Self-Experimentation
    Shape Of The Earth
    Skepticism
    Skeptics
    Skin Color
    Slavery
    Snake Oil
    Soccer
    Sonic Hedgehog
    Spanish Flu
    Spontaneous Generation
    Stanley Prusiner
    Stars
    Star Trek
    Statistical Significance
    Statistics
    Sublime/Ridiculous
    Suicide
    Surface To Volume Ratio
    Swanson Conversion
    Swine Flu
    Tangier Island
    Taxonomy
    Technical Details
    Thomas Young
    Timeline Method
    Transposable Elements
    Trusted Messenger
    Trust In Scientists
    Truth
    Tyranny Of Fantasy
    Understanding
    Universe
    Vaccine Hesitancy
    Vaccines
    Vacuum
    VAERS
    Valley Of Despair
    Values
    Video Games
    West Side Story
    Wikipedia
    Wolf Rock
    Women
    World Trade Center
    Xenophobia
    Zinc
    Zombies

    Archives

    February 2023
    January 2023
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    May 2017
    April 2017

    RSS Feed

Powered by Create your own unique website with customizable templates.
  • Home
  • Meet the Author
  • Ratio Scientiae Blog
  • Random Science
  • Writing & News
  • Nonfiction Books
    • Science Can Be Right Because It Can Be Wrong
  • Fiction Books
    • The Sun Zebra
    • Spirit Women
  • Science Cat (Mascot)
  • Contact