AI-Generated Answers Fool Professors, Get Better Grades Than Human-Written Ones

Sharon Adarlo
·2-min read

Hidden Figures

In a sneaky but clever experiment, researchers at a United Kingdom university turned in AI-generated answers to real tests at their own institution, hoodwinking fellow professors and earning better grades than actual students.

The study, done at Reading University and published in the journal PLOS ONE, exemplifies how AI is upending education overall and giving instructors novel headaches as they try to figure out how to educate and assess students going forward.

"Our study highlights the responsibility we have as producers and consumers of information," Reading psychology professor and study coauthor Etienne Roesch said in a statement about the research. "We need to double down on our commitment to academic and research integrity."

For the study, the researchers took exams from several undergraduate courses on psychology, prompted OpenAI's ChatGPT to generate answers for them, and submitted the resulting work with fake student names. The exams either required short written answers of at most 200 words or essays of 1,500 words.

Other professors, who were unaware of the study, graded the exams and only called out the AI-generated answers at a dismal six percent, according to the paper, with the great majority passing as human-made. And significantly, the AI answers got higher marks compared to actual students at Reading.

What's Next

Calling it the "largest and most robust blind study of its kind" on AI's impact on education so far, the researchers claim the study demonstrates that ChatGPT can pass the Turing Test, a method to see if a computer can converse with a human being and fool that person in thinking that the computer is another person.

The researchers in the study also propose that the way students are assessed should change, suggesting that AI should be incorporated into education in some way.

On evaluating students and preventing AI-aided plagiarism, educators have already been examining their options, from oral exams to in-class work. Take-home exams or even tests done on a computer could quickly become a thing of the past, if they're not already on the way out.

But in terms of using AI in the classroom, that's a controversial subject that's sure to divide educators who either fall into panicky doom that future students will become helpless and rely on AI as a crutch, or optimism that AI is another cool tech tool with no significant downsides.

Time will tell where society is headed.

More on AI: In New Experiment, Young Children Destroy AI at Basic Tasks

  • Up next
  • Up next
  • Up next
  • Up next

Latest stories

  • For many teachers, summer break is no such thing

    The idea of summer as two months paid leave for America’s teachers is full of holes. Nearly half planned to take a second job, according to a recent survey, while 76 percent will be doing some kind of professional development — and not all of them are even paid by their districts over the…

  • Monzo launches tools to tackle phone thieves raiding savings

    The digital bank said the security control tools were the first of their kind to be launched across mobile banking.

  • Scientists find desert moss ‘that can survive on Mars’

    Moss that grows in Mojave desert and Antarctica may help establish life on the red planet, researchers say

  • People urged to donate unwanted smartphones to those in need

    The Community Calling scheme was established in 2020 in response to the Covid-19 pandemic.

  • How studying for the International Baccalaureate online has been life changing for one student

    When Rhiannon Clark found attending college difficult because of a debilitating condition, she discovered a new route to university that was perfect for her

  • New York police shoot and kill 13-year-old boy carrying replica handgun

    New York police have shot dead a 13-year-old boy who was carrying a replica handgun only capable of firing pellets.

  • NASA Is Having a Spacesuit Crisis

    Spacesuit Setback Earlier this week, NASA astronaut Tracy Dyson discovered to her horror that water was squirting from her spacesuit 31 minutes into her and fellow astronaut Mike Barratt's spacewalk outside of the International Space Station. Unsurprisingly, the space agency was forced to cut their journey short, with crews on board the orbital outpost investigating […]

  • An Arizona museum tells the stories of ancient animals through their fossilized poop

    One way to help tell how a Tyrannosaurus rex digested food is to look at its poop. Bone fragments in a piece of fossilized excrement at a new museum in northern Arizona — aptly called the Poozeum — are among the tinier bits of evidence that indicate T. rex wasn’t much of a chewer, but rather swallowed whole chunks of prey. The sample is one of more than 7,000 on display at the museum that opened in May in Williams, a town known for its Wild West shows along Route 66, wildlife attractions and a railway to Grand Canyon National Park.

  • Axelrod calls talk of replacing Biden ‘irrelevant today’

    Democratic strategist David Axelrod on Saturday called discussions about replacing President Biden at the top of the Democratic ticket “irrelevant,” as the party continues to face the fallout from the Thursday night debate. The former Obama White House senior adviser said the appropriate time to have the discussion would have been last year. “Reality check:…

  • How a group of butterflies flew 2,600 miles across the Atlantic Ocean without stopping

    A study found a group of painted lady butterflies traveled 2,600 miles across the Atlantic Ocean without stopping. Experts say it may be a world record for insects.

  • When is a student loan written off? Almost 1.8m people in the UK owe £50,000 or more

    UK student loan repayment plans depend on when you started your course, where you live after completing your studies, and how much you earn

  • Farage claims ‘bad apples are gone’ from Reform UK amid racism row

    The party leader said he would ‘never have them back’ following the withdrawal of support for three candidates.

  • A Quiet Place: 7 Questions I Have About The Aliens After Day One

    A Quiet Place: Day One gives us a deep look at the first day of the alien invasion, but we still have a bunch of questions.

  • Spotted Lanternflies: Scientists Studying How to Kill them

    Scientists have been researching the best method for killing spotted lanternflies, and they may have gotten some new leads this year through the insects' attraction to vibrations.

  • Children in Angela Rayner’s constituency risk being forced into ‘inadequate’ schools

    Children in Angela Rayner’s constituency face being pushed into “inadequate” state schools because of Labour’s tax raid on education, The Telegraph can reveal.

  • Ahead of Ariane 6 launch, what are the other big rockets?

    Europe's new Ariane 6 rocket is due to blast off for the first time next week, but it will launch into a quickly changing market for heavy space launchers increasingly dominated by SpaceX.Here are some of the other big rockets competing for the lucrative job of hauling satellites and other missions into space.- Ariane 6 - The first flight of the European Space Agency's biggest rocket launcher is scheduled from Europe's spaceport in Kourou, French Guiana, on July 9. It will replace the workhorse rocket Ariane 5, which in 2023 carried out the last of 117 launches over nearly three decades.When Ariane 6 launches with two boosters, it will be able to haul 4.5 tonnes of payload -- such as satellites -- into geostationary orbit at 36,000 kilometres above Earth. Satellites in geostationary orbit follow Earth's rotation, so they appear fixed at a set spot.It will also be able to take more than 10 tonnes into low Earth orbit, just hundreds of kilometres up. Unlike geostationary orbits, objects in low Earth orbit, including the International Space Station, spin around the world much faster and do not appear fixed.This lower region will be home to 85 percent of the satellites that will be launched by 2032, according to the firm Euroconsult.When Ariane 6 launches with four boosters, planned for next year, it will be able to deliver 11.5 tonnes into geostationary orbit and 21.6 tonnes into low Earth orbit.It will also be able to deploy constellations of satellites across different orbits thanks to the reusable Vinci engine in its upper stage.However the rest of the rocket is not reusable, unlike its chief competition, the Falcon 9 of billionaire Elon Musk's SpaceX.- Falcon 9, Starship - Falcon 9 is a reusable rocket that has come to dominate the market. Since 2010, it has launched 350 times, including 91 last year -- two-thirds of which were for SpaceX's own Starlink satellite internet constellation.Falcon 9 can take more than eight tonnes into geostationary orbit and nearly 23 tonnes into low Earth orbit.Competitor Arianespace accuses SpaceX of charging the US government and NASA a premium price to use the Falcon 9, which lets the US firm offer low prices to its other commercial customers.Also in SpaceX's stable of rockets is the larger and more powerful Falcon Heavy.And it is working on the massive Starship rocket, the most powerful ever built, which plans to carry up to 150 tonnes in its reusable form and 250 tonnes when not reusable.After three previous test flights ended with the Starship blowing up, last month the rocket held together and successfully splashed down for the first time.- New Glenn - After years of delays, the first flight of Blue Origin's reusable New Glenn is scheduled for September, according to its first customer NASA.The rocket is nearly 100 metres (330 feet) tall, compared to Ariane 6's height of 62 metres. It will be able to carry 13 tonnes into geostationary orbit and 45 tonnes into low Earth orbit.The US company founded by Amazon billionaire Jeff Bezos is keeping quiet about its order book, but the rocket is expected to help launch Amazon's Kuiper satellite internet constellation.- Vulcan Centaur -The United Launch Alliance, a joint venture between Boeing and Lockheed Martin, launched its Vulcan Centaur rocket for the first time in January.It is set to replace the company's workhorse Atlas V and Delta IV rockets, favourites of the United States for institutional launches.The rocket, which has reusable engines, will be able to have up to six boosters, delivering more than 15 tonnes into geostationary orbit and over 27 tonnes into low Earth orbit.- H3 -Japan's new flagship H3 rocket made its inaugural flight in February. It can have up to four boosters and launch 6.5 tonnes into geostationary orbit.- Angara A5 -Russia's replacement for its ageing Proton rockets made its maiden launch back in 2014 -- but a test flight in April was only its fourth since then.It can deliver 5.4 tonnes into geostationary orbit and 24.5 tonnes into low Earth orbit.- Long March 5 -China's Long March 5 has launched 12 times since 2016. It can take 14 tonnes into geostationary orbit and 25 tonnes into low Earth orbit.mra-dl/spb/js/mca

  • Sinkholes spread fear in Turkey's parched breadbasket

    Every time Turkish farmer Fatih Sik drives his tractor across his cornfields he knows the earth could open up and swallow him at any moment. "It's the first time I have seen this, it's impressive."

  • ‘State schools are struggling even before Labour’s tax raid – there are no places for my daughter’

    Sam Howell is running out of time. There are 61 days until the start of term and her daughter, Maddie, 4, who has autism, is facing the prospect of being left without a school place in September.

  • China Cracks Open First Ever Sample From Moon’s Far Side

    "Thicker and Stickier" After boldly going to the Moon's far side, China is now in possession of more than four pounds of lunar samples — the first ever collected in human history from that mysterious region. The state-run China Daily newspaper reports that the Chang'e 6 robotic lunar lander, which touched down back on Earth […]

  • Trees Blamed for Air Pollution

    In a controversial new study, scientists are claiming that trees in Los Angeles are contributing to the city's air pollution, challenging conventional notions about the positive role they play in their ecosystems. As New Scientist explains, this bold theory was born of a strange conundrum: despite efforts to decrease traffic exhaust and increase environmental protections, […]