Cheating to Learn: How a UCLA professor gamed a game theory midterm

View previous topic View next topic Go down

Cheating to Learn: How a UCLA professor gamed a game theory midterm

Post by Bryant on Thu May 09, 2013 2:19 pm

Cheating to Learn: How a UCLA professor gamed a game theory midterm
by Peter Nonacs
KCRW


On test day for my Behavioral Ecology class at UCLA, I walked into the classroom bearing an impossibly difficult exam. Rather than being neatly arranged in alternate rows with pen or pencil in hand, my students sat in one tight group, with notes and books and laptops open and available. They were poised to share each other’s thoughts and to copy the best answers. As I distributed the tests, the students began to talk and write. All of this would normally be called cheating. But it was completely okay by me.

Who in their right mind would condone and encourage cheating among UCLA juniors and seniors? Perhaps someone with the idea that concepts in animal behavior can be taught by making their students live those concepts.

Animals and their behavior have been my passions since my Kentucky boyhood, and I strive to nurture this love for nature in my students. Who isn’t amazed and entertained by videos of crafty animals, like Betty the tool-making crow, bending wires into hooks to retrieve baskets containing delicious mealworms? (And then hiding her rewards from a lummox of a mate who never works, but is all too good at purloining hard-won rewards of others?)

Nevertheless, I’m a realist. Almost none of my students will go on to be “me” – a university professor who makes a living observing animals. The vast majority take my classes as a prelude to medical, dental, pharmacy, or vet school. Still, I want my students to walk away with something more than, “Animals are cool.” I want them to leave my class thinking like behavioral ecologists.

Much of evolution and natural selection can be summarized in three short words: “Life is games.” In any game, the object is to win—be that defined as leaving the most genes in the next generation, getting the best grade on a midterm, or successfully inculcating critical thinking into your students. An entire field of study, Game Theory, is devoted to mathematically describing the games that nature plays. Games can determine why ant colonies do what they do, how viruses evolve to exploit hosts, or how human societies organize and function.

So last quarter I had an intriguing thought while preparing my Game Theory lectures. Tests are really just measures of how the Education Game is proceeding. Professors test to measure their success at teaching, and students take tests in order to get a good grade. Might these goals be maximized simultaneously? What if I let the students write their own rules for the test-taking game? Allow them to do everything we would normally call cheating?

A week before the test, I told my class that the Game Theory exam would be insanely hard—far harder than any that had established my rep as a hard prof. But as recompense, for this one time only, students could cheat. They could bring and use anything or anyone they liked, including animal behavior experts. (Richard Dawkins in town? Bring him!) They could surf the Web. They could talk to each other or call friends who’d taken the course before. They could offer me bribes. (I wouldn’t take them, but neither would I report it to the Dean.) Only violations of state or federal criminal law such as kidnapping my dog, blackmail, or threats of violence were out of bounds.

Gasps filled the room. The students sputtered. They fretted. This must be a joke. I couldn’t possibly mean it. What, they asked, is the catch?

“None,” I replied, “You are UCLA students. The brightest of the bright. Let’s see what you can accomplish when you have no restrictions, and the only thing that matters is getting the best answer possible.”

Once the shock wore off, they got sophisticated. In discussion section, they speculated, organized, and plotted. What would be the test’s payoff matrix? Would cooperation be rewarded or counter-productive? Would a large group work better, or smaller subgroups with specified tasks? What about “scroungers” who didn’t study but were planning to parasitize everyone else’s hard work? How much reciprocity would be demanded in order to share benefits? Was the test going to play out like a dog-eat-dog “Hunger Games”? In short, the students spent the entire week living Game Theory. It transformed a class where many did not even speak to each other into a coherent whole focused on a single task – beating their crazy professor’s nefarious scheme.

On the day of the hour-long test they faced a single question: “If evolution through natural selection is a game, what are the players, teams, rules, objectives and outcomes?” One student immediately ran to the chalkboard, and she began to organize the outputs for each question section. The class divided tasks. They debated. They worked on hypotheses. Weak ones were rejected, promising ones were developed. Supportive evidence was added. A schedule was established for writing the consensus answers. (I remained in the room, hoping someone would ask me for my answers, because I had several enigmatic clues to divulge. But nobody thought that far afield!) As the test progressed, the majority (whom I shall call the “Mob”) decided to share one set of answers. Individuals within the Mob took turns writing paragraphs and they all signed an author sheet to share the common grade. Three out of the 27 students opted out (I’ll call them the “Lone Wolves”). Although the Wolves listened and contributed to discussions, they preferred their individual variants over the Mob’s joint answer.

In the end, the students learned what social insects like ants and termites have known for hundreds of millions of years. To win at some games, cooperation is better than competition. Unity that arises through a diversity of opinion is stronger than any solitary competitor.

But did the students themselves realize this? To see, I presented the class with one last evil wrinkle two days later, after the test was graded but not yet returned. They had a choice, I said. Option A: They could get the test back and have it count toward their final grade. Option B: I would—sight unseen—shred the entire test. Poof, the grade would disappear as if it had never happened. But Option B meant they would never see their results; they would never know if their answers were correct.

“Oh, my, can we think about this for a couple of days?” they begged. No, I answered. More heated discussion followed. It was soon apparent that everyone had felt good about the process and their overall answers. The students unanimously chose to keep the test. Once again, the unity that arose through a diversity of opinion was right. The shared grade for the Mob was 20 percent higher than the averages on my previous, more normal, midterms. Among the Lone Wolves, one scored higher than the Mob, one about the same, and one scored lower.

Is the take-home message, then, that cheating is good? Well…no. Although by conventional test-taking rules, the students were cheating, they actually weren’t in this case. Instead, they were changing their goal in the Education Game from “Get a higher grade than my classmates” to “Get to the best answer.” This also required them to make new rules for test taking. Obviously, when you make the rules there is no reason to cheat. Furthermore, being the rule-makers let students behave in a way that makes us a quintessentially unique species. We recognize when we are in a game, and more so than just playing along, we always try to bend the rules to our advantage.

Morally, of course, games can be tricky. Theory predicts that outcomes are often not to the betterment of the group or society. Nevertheless, this case had an interesting result. When the students got carte blanche to set the rules, altruism and cooperation won the day. How unlike a “normal” test where all students are solitary competitors and teachers guard against any cheating! What my class showed was a very “human” trait: the ability to align what is “good for me” with what is “good for all” within the evolutionary games of our choosing.

In the end, the students achieved their goal – they earned an excellent grade. I also achieved my goal – I got them to spend a week thinking like behavioral ecologists. As a group they learned Game Theory better than any of my previous classes. In educational lingo, there’s a new phrase, “flipping the classroom,” meaning students are expected to prepare to come to class not for a lecture, but for a question-and-answer discussion. What I did was “flip the test.” Students were given all the intellectual tools beforehand and then, for an hour, they had to use them to generate well-reasoned answers to difficult questions.

The best tests will not only find out what students know but also stimulate thinking in novel ways. This is much more than regurgitating memorized facts. The test itself becomes a learning experience – where the very act of taking it leads to a deeper understanding of the subject.

Peter Nonacs is a Professor in the Ecology and Evolutionary Biology Department at UCLA. He studies the evolution of social behavior across species, ranging from viruses, to insects, to mammals and even occasionally humans. He wrote this for Zócalo Public Square.
avatar
Bryant
Admin

Posts : 1452
Join date : 2012-01-28
Age : 28
Location : John Day, Oregon

View user profile

Back to top Go down

Re: Cheating to Learn: How a UCLA professor gamed a game theory midterm

Post by Marconius on Thu May 09, 2013 8:38 pm

I agree with things like this. In the right setting, it promotes creative thought. It also breeds teamwork. Those two things are prolly the most important things in the workplace.

In engineering school, we were allowed to work as a team during some exams and of course all projects.

I do however, think that it is important to let the students know what it is you want to accomplish during these exercises. Many times it hits home harder if you tell them after the fact.

_________________
"If guns are supposed to kill people, then all of mine are defective..."
-The Honorable Ted Nugent

"We have four boxes used to guarantee our liberty: The soap box, the ballot box, the jury box and the cartridge box". -- Ambrose Bierce (1887)

"All right, they're on our left, they're on our right, they're in front of us, and they're behind us. They can't get away this time!" -Gen. L. "Chesty" Puller, CO, 1 MARDIV, in Korea surrounded by 22 enemy divisions

Had the Japanese got as far as India, Gandhi's theories of "passive resistance" would have floated down the Ganges River with his bayoneted, beheaded carcass. -- Mike Vanderboegh.
avatar
Marconius

Posts : 1800
Join date : 2012-01-31
Age : 47
Location : Opelousas Louisiana

View user profile

Back to top Go down

Re: Cheating to Learn: How a UCLA professor gamed a game theory midterm

Post by Miles1 on Fri May 10, 2013 5:42 am

speaking of good/bad teaching:




_________________
QVIDQVID LATINE DICTVM SIT, ALTVR PROFONDVS
avatar
Miles1

Posts : 1080
Join date : 2012-01-28
Age : 38
Location : Cork, IE

View user profile

Back to top Go down

Re: Cheating to Learn: How a UCLA professor gamed a game theory midterm

Post by Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum