NEW BOOK!
Explore a better way to work – one that promises more calm, clarity, and creativity.

The Perfect Cheating Machine?

Many predictions and concerns tumbled into the slipstream trailing ChatGPT’s dazzling, turbulent entrance onto the technology scene in late 2022. Few of these initial warnings felt more immediate than those of imminent disruptions to higher education.

“Could the chatbot, which provides coherent, quirky, and conversational responses to simple language inquires, inspire more students to cheat?”, asked an NBC News article, published only a week after ChatGPT’s initial launch. Several months later, a professor in the Texas A&M system took this warning to heart and failed his entire class after convincing himself that every one of his students had used AI to write their final assignments. (It turns out that his method of detection—asking ChatGPT itself whether it produced the submissions—was unreliable. He later changed the grades.)

“AI seems almost built for cheating,” explains Ethan Mollick, in his recent bestseller, Co-Intelligence. He predicted, in particular, that paper writing as a pedagogical tool might be on the way out, forcing institutions to adapt to other methods to teach composition: “In-school assignments on non-internet-enabled computers, combined with written exams, will ensure students learn basic writing skills.”

It’s hard to believe that it’s been almost two years since we first started hearing these concerns about ChatGPT providing students the perfect cheating machine. As a professor and writer myself, these issues interest me, especially when it comes to academic compositions. So in my most recent article for The New Yorker, published earlier this month, and titled “What Kind of Writer is ChatGPT?,” I set out to understand how these tools are currently being put to work by students tackling writing assignments.

My approach was to move beyond speculation and watch actual students use AI on actual assignments, with a particular focus on a graduate student I called Chris, who was using ChatGPT to write a significant anthropology paper.

As I explain in the article, what I observed Chris doing was more complicated than you might have guessed:

“He was not outsourcing his exam to ChatGPT; he rarely made use of the new text or revisions that the chatbot provided. He also didn’t seem to be streamlining or speeding up his writing process. If I had been Chris’s professor, I would have wanted him to disclose his use of the tool, but I don’t think I would have considered it cheating. So what was it?”

I recommend that you read the full article to learn the full answer. But to preview what I discovered: students aren’t simply outsourcing their writing to tools like ChatGPT, but they’re also not using them in clearly harmless ways either. The reality is something different and new; less a method to speed up the task of writing and more an approach to reducing its cognitive burden.

The bigger point to be made here, however, is about how we think about this new age of artificial intelligence in which we’ve been enveloped since late 2022. These tools are undeniably powerful. Accordingly, they will undeniably end up changing some things about our lives in major ways.

But predicting these changes has proven exceedingly difficult. If you’re interested in these trends, spend less time listening to people explaining how the next version of some model is going to change everything all at once, and instead directly observe what people are doing with the versions of the technology they have access to right now. The stories are less flashy, but as you look deeper you’ll find interesting things going on.

#####

In the latest episode of my podcast, Deep Questions, released earlier today, I take an unconventional look at the idea of discipline and how to improve it (listen | watch)

Have you read my new book, Slow Productivity: The Lost Art of Accomplishment without Burnout? If not, here’s yet another reason to consider doing so: Goodreads just listed Slow Productivity as #1 on their recently released list of the “Most Popular Self Help Books of 2024.”

6 thoughts on “The Perfect Cheating Machine?”

  1. Hi Cal. I have been using ChatGPT l to assist me in my writing and research, in my line of work. Your writing is spot on on the assistance part, as I have discovered to my delight. It does help me to expand and find new ideas.

    Reply
  2. The blog post discusses the concept of a “cheating machine,” which optimizes productivity by minimizing distractions and enhancing focus. It emphasizes creating an environment that supports deep work, using tools and techniques to streamline tasks effectively.

    Reply
  3. Hi Cal. I am currently studying a BA in Literature and Creative writing by correspondence, and have been using ChatGPT whilst I study to answer content related questions that come to me as I cover the material. Its like having an extremely knowledgeable professor on hand to answer questions as they occur to me, and Ive found it to greatly help my understanding of the material I’m covering, and widen the scope of what I’m learning; just as much as I need it to. Having said that, I’m busy writing a book and have stayed far away from ChatGPT for that – I’m reluctant to experiment in order to protect my ego, which relies on the originality of my ideas and writing. 🙂

    Reply
  4. There is a huge difference between grad students and undergrads. I have taught at a regional comprehensive university (for 28 years now), and many of my students use AI for EVERYTHING—even reflections, LMS discussion posts, journal entries, and emails, largely without edits. AI writing is terrible, but it sounds “smart” with little argument and word salad. Students are unduly impressed.

    I’ve stopped “detecting” AI and just grade the lousy writing it produces and students submit. Many of my students use AI to replace thinking/writing rather than as a tool to brainstorm and supplement their work. I’m not anti-AI; I use it in my own work, but many (not all) of my students use it as a shortcut rather than a powerful tool.

    Reply
  5. Teaching will have to change. The goal is the same, but the methods will have to adjust it’s not about output but explaining how you got there, defending it orally, being able to answer questions from peers, things that you can’t do with your hands on a phone 🙂

    and the Bet. The students need to understand if they turn in regurgitated information the only people who are losing ultimately are themselves.

    My brother says that elementary school kids coming in in the last 5 years expect to be entertained, because their parents have had hands on the phone and not interacted with the children.

    Learning is an awesome game, the way the information may be presented back may move to video, discussion groups, as well as writing papers.

    What’s the goal of the educational outcome? To be good communicators of knowledge, to find something and describe it to others?

    To know it well enough that you can write effectively and answer questions on the topic?

    Read Simak, Special Deliverance, and others :

    Ultimately you have to know your students, which takes time 🙂

    If you didn’t want help them be successful, why did you become a teacher 🙂

    Reply

Leave a Comment