The Power of Words

22171791392

[highly speculative, probably wrong, maybe patronizing, etc.]

I.

Does it matter whether we describe kids as being “gifted” or as “ready for more”?

Is it just harmless to describe things as crazy, or lame?

Should we refrain from using terms like misconception, mistake, or error when describing a student’s thinking of mathematical work?

Here is a perspective — I don’t think it’s my own — from which the answers to these questions are, yes, it matters, no, it’s not harmless, and of course we should refrain from those terms.

The reason is not so much because of how those words will impact others. Because the words are routine and normal, they wouldn’t really draw attention from other people, unless those people have already been woken up to the true implications of those words. The language isn’t harmless, but it doesn’t necessarily harm anybody.

The first source of harm is what the words you choose do to you. The words you use are sort of like an infection, from this perspective. They dive deep into your psyche and start unconsciously impacting the way you see things. They form the seeds of unconscious bias, silently impacting the way you see the world. If you’re always talking about mistakes and errors that a kid makes, that’s going to shape the grooves of your mind, making it easier to fall into noticing the negatives. Ditto with ableist language. The Sapir-Whorf hypothesis is true, and serious.

The second source of harm is about what you’re not doing when you don’t guard your language, which is you don’t correct your biases. The point is that word choice is a discipline, a moral discipline. Focusing intently on the words you use is an active way of cultivating a thoughtful, less-biased personality.

How? Say that you’re looking at a piece of student work, and you’re trying to describe it. You see something that from a certain perspective is mathematically inaccurate. You reach for a word. You think, hmm, should I call this a ‘mistake’? And you have a moment where you reflect and say, hey, I should not focus on what this kid does not know, I should think about what they can do. Repeat that reflection on word choice a dozen times a day, hundreds of times a month. Reflecting on word choice can change a person.

II.

Spring is here, and it’s math education conference week in the US. And, as usual, I’m feeling a contradictory slush of mixed feelings about sitting it out — relief that I don’t have to go and jealousy towards those who can.

Whether at conferences or following along at home, the main thing I feel is loneliness and alienation from the profession at large. This isn’t even necessarily a criticism of the math education profession. I just feel out of sync with things, that’s all. Things that lots and lots of other people find inspiring or useful, I just don’t find useful.

The flip side is true also, by the way. There are lots of things that I find meaningful and inspiring about teaching that generally don’t get much airtime in these conferences. Meaning, I’m not some sort of humorless scold, incapable of inspiration or fun. I guess there really isn’t any way to prove this and I am doth protesting too much but I think it’s true. Friends, family: a little support here??

I’m not exactly sure how to describe the things at conferences that feel orthogonal to the way I think. I think there are three big things that don’t fit with me naturally:

  1. expressing laws of teaching (e.g. do not teach by telling, ban worksheets and timed tests)
  2. inflating the stakes (e.g. mathematical violence)
  3. managing word choice (e.g. misconception, mistake)

Some time, over the next week, I’m going to see a slide from a conference presentation declaring “Let’s ban talk of misconceptions — it’s mathematical violence!” and I am going to be incredibly triggered and have to remind myself that I’m the one with the problem, not the speaker.

III.

Are words powerful? Yes and no, I guess is what I’d say.

I had been ready to dismiss the Sapir-Whorf hypothesis (that language determines thought), but Douglas Hofstadter gives me pause:

I myself was once most disdainful of this hypothesis, but over time came to realize how deeply human thought — even my own! — is channeled by habit and thus, in the last accounting, by the repertoire of mental chunks (i.e., perceptual attractors) that are available to the thinker. I now think that it is high time for the Sapir-Whorf hypothesis to be reinstated, at least in its milder forms.

(To a lesser extent George Lakoff gives me pause.)

I remain skeptical that self-consciously changing the language someone else uses could impact their thinking. Like, suppose that you actually could actually ban or mandate language. (Not legally, but as a social matter we definitely can do this.) If you really think that language choice unconsciously impacts your own thinking or the thinking of others, then (modulo some unsavory side-effects) you should probably think that a ban or a mandate would reduce harmful biases. People will use better words, the words will have a better impact on their psyche, and as a result their biases will be improved.

But psychological biases are strong, and reinforced by the strong forces of society and culture. Can they really be reduced by the unconscious, subtle grooving of word choice? And without a reflective, conscious effort to change one’s habits? I remain skeptical.

But maybe word choice can improve oneself. If it does, I think it would be in the way I outlined above, as a reflective, moral practice that allows the speaker to frequently reflect on their thoughts and actions.

In other words, I can see how word choice can function as a moral practice that resembles a lot of the religious practices I uphold. Does eating matzah on Passover make you a better person? Of course not, but it could give you a chance to. And it also serves an important social function, centering a community around a shared practice.

IV.

When I was in high school, I remember there was a poster outside my classroom. It exhorted us to guard our tongues and refrain from lashon hara, evil speech, gossip, mean remarks, etc.

There were people I knew who were exceptionally cautious to follow these Jewish laws of speech. These laws were only articulated fairly recently in the Jewish legal game, in 1873, by Rabbi Israel Meir Kagan, but they were entirely widespread when I was in yeshiva. These friends of mine lived in a state of mild panic, in fear they would accidentally utter a bit of unnecessary gossip.

(Complicating things, Kagan also says that accidentally listening to forbidden speech is forbidden, so those who kept these laws carefully had to always be on guard against someone saying something that they shouldn’t hear. To be really safe, you really end up just having fewer conversations.)

There are all sorts of exceptions and guidelines for the rules, but what Kagan changed, for a sliver of the population, was the basic assumption: speech isn’t neutral, and what you express might be forbidden.

Even in high school, this didn’t fit with me. I mean, I certainly felt guilty about how I spoke. But I was a kid that liked to make people laugh. It’s my go-to social coping strategy, and has been for three decades or so. As a student, I tried very hard to stay away from meanness, but, well, let’s just say that Kagan didn’t have a chapter on jokes. The entire enterprise was perilously close to forbidden.

I do believe that I should try not to harm people with my words, and that’s as far as I go with Kagan. I’m not scrupulous about this, just as I’m not scrupulous with my language in general. I try to be scrupulous about other things, and I do think that they “matter” more for me.

But who am I to begrudge anyone their discipline, the thing that stops them in their tracks, helps them to think about themselves and their bad habits? Everyone needs a discipline, and guarding one’s language seems pretty good to me.

The intellectual work that teachers can do but researchers probably can’t

[I’ve written versions of this post many times before. Here here here. Don’t read those, this version is probably better.]

Tomorrow night, I’m going to teach teachers about teaching. I think a legitimate question is, on what grounds am I claiming to know anything about teaching at all?

To be sure, I am pretty confident that I know something very important about my own teaching — in my school, with my students, in my courses, given my personality, etc. I observe my own classrooms (imperfectly) every day. The cumulative evidence of all that observation makes me pretty (not fully) sure that I’ve figured something out.

But the tricky thing about teaching is that this stuff often doesn’t translate to other situations. Just because something works in my classroom (according to me) doesn’t mean that it’ll work in vastly different contexts. To get really specific about this for a second, I teach students who are among the wealthiest children in America. This reality impacts my school in a bajillion ways. Who says that my dumb ideas about feedback will mean anything to the other teachers in my department. Teachers in other schools, and especially high-poverty schools? Forget about it.

(To be fair to myself for a second: I haven’t only taught in my school.)

The point is that there are obvious reasons to doubt that the things I think I know are really truths of teaching. This is even true if we move past the particular practices that I advocate and get behind the thinking and values that support those practices. I think I have a useful way of thinking about teaching, or I think I’ve identified some value that is important for the student experience. Who says that this is anything but my own thinking?

This is the natural place that research on teaching enters the conversation. Whatever you want to say about research, it’s not about my classroom. In general, it’s about forming generalizations in a way that improves upon (e.g.) my ability to make stuff up about my teaching.*

There are lots of interesting edge cases to consider, but I think the generalization about generalizations stands. Researchers might write cases grounded in particulars or engage in a teaching experiment, but the point of those is to contribute to the formation of generalizations that are broadly useful. 

This is getting pretty abstract so let me just get to the point: could researchers ever respect the generalizations that teachers make about teaching as knowledge that stands on par with their own?

The usual way of talking about teacher/researcher parity is to say that researchers excel at making generalizations, while teachers contribute crucial local knowledge. And it’s totally true that teachers do have local knowledge.

But does this really create parity between teachers and researchers? The whole point of broadly useful knowledge about teaching is that it goes beyond local knowledge — it makes a generalization. If what teachers can contribute is local knowledge, then I think we’re just saying that teachers are at best a source of data to the researcher. The teacher inputs local knowledge, the researcher generates broadly useful generalizations.

It’s true that there’s no reason to inherently value general vs. local knowledge, so in a certain sense there can be parity between teachers/researchers. But at the end of the day, what’s broadly useful are generalizations, and teacher knowledge can’t really compete with what researchers contribute.

Or…can we?

I want to speculate a bit about some different ways of sorting out the relationship between what researchers and teachers can contribute. To start, I want to ignore local knowledge for a second and talk about how teachers contribute to generalizations, i.e. researcher turf.

I have a few ideas here, and they’re very rough, so bear with me.

First, researchers are institutionalized while teachers are necessarily amateurs at producing generalizations. The relationship between teachers/researchers can then be folded into the general relationship between amateurs and experts. And, of course, we need experts. But the ecosystem isn’t healthy if it’s entirely populated by experts.

Amateurs play a lot of important roles, even when it comes to forming generalizations that are broadly useful. Here are a few that I’ve read about (too lazy to cite right now):

  • Amateurs can disrespect the boundaries of fields or sub-professions and put together ideas that from an institutional perspective are incongruous
  • Amateurism is in general lower stakes/lower payout than being an expert. If I’m an amateur and my ideas are wrong or useless, my career isn’t on the line. So there’s a way in which amateurs can attend to riskier ideas, or work on lines of thought that are perceived to be less rich in reward or are in general undervalued.
  • Amateurs play an important role in teaching and spreading expert generalizations, but in doing so amateurs often simplify or otherwise improve the results of experts in significant ways.

But this way of framing things — teachers as amateurs, researchers as experts — doesn’t really leave room for teachers to ever get institutional respect from experts as generators of generalizations about teaching, and two further points on that:

  • this is probably true
  • this is much more exciting to me than institutional respect

It’s not good for my $$$, but I am really quite fine accepting the role of an amateur in all this. It’s exciting to try to smash fields together and to not be beholden to conventional wisdom in the field. I can chase ideas about teaching, throw them out there for others and see what resonates for others. We make up the rules as we go. It’s fun!

That’s the spirit in which I’m going to teach this class tomorrow night. I’ve got this stuff I’ve figured out about teaching. I don’t want to make myself sound like a tin-hat Alex Jones-type, but I do think that what I’ve learned about teaching goes against a certain conventional, institutional, expert way of thinking. And it is the result of mashing up a bunch of things — trial-and-error in the classroom, reading research, experimenting by giving presentations to teachers. And if it’s not broadly useful as a generalization about teaching? Hey, that’s OK too. There’s very little at stake here.

So, I’m not an expert, and neither are you: maybe these ideas are useful to you? Let’s find out. That’s the way I approach this stuff right now, as an amateur.

What is retrieval practice when you’re learning math?

I’ve never really carefully read the retrieval practice literature, but I think it gets confusing when people talk about retrieval practice when talking about math skills, as opposed to mathematical facts.

Here is the description from @poojaagarwal‘s website, committed to promoting retrieval practice among practitioners:

Retrieval practice is a strategy in which calling information to mind subsequently enhances and boosts learning. Deliberately recalling information forces us to pull our knowledge “out” and examine what we know. For instance, I might have thought that I knew who the fourth U.S. President was, but I can’t be sure unless I try to come up with the answer myself (it was James Madison).

But how does this apply to math skills? Can trying a problem (i.e. practicing the skill) ever count as retrieval practice? Does it make sense to use the metaphor of ‘calling information to mind’ to describe what’s going with skills practice?

I think not. But I also am finding retrieval practice useful in my lesson planning. There is a great deal of knowledge that is useful for students to know when they’re learning something new. This sort of knowledge is the sort of thing that I’d like my students to know (i.e. retrieve from memory), more than I’d like them to derive.

Often, at the beginning of class, the first thing I ask my students to do is to remember some facts that they may (or may not yet) know from memory. Some constraints:

  • I don’t ask students to solve a problem and call it retrieval practice — that’s skills practice, not retrieval practice, and tickles other parts of the mind.
  • I only ask students questions that I think they could remember, even if it might be difficult to recall these things. Ideally, these would be things that either students could derive if they can’t recall them.
  • Because stuff from the last few days of class can often get forgotten really quickly, I often use these prompts to strengthen the memory of what we’ve recently done. (The prompt “Summarize what we did yesterday” is surprisingly difficult!)

Here are some prompts I’ve recently used with students:

“Draw a pair of ramps that are pretty close to being of equal steepness.”

“Write an equation of a quadratic, describe what it would look like.”

“What happens when you use the tan button on the calculator? Give some examples.”

“Write several pairs of decimals, and write the number that is between them.”

The truest ‘retrieval practice’ of these is the one about the tan button. Next in line is the one about the equation of the quadratic, since I’m prompting kids to remember what the features of the graph are (though it’s also skills practice). What made me think about these as retrieval practice is that they were all calling back on the previous day’s class.

Here are some purer examples of retrieval practice prompts in math:

“What’s the Pythagorean Theorem?”

(If a specific procedure is supposed to be known for converting a decimal into a fraction:) “How do you convert a decimal into a fraction?”

etc.

As I’m messing around in graph theory, I’m noticing that there are a lot of things that would be useful to remember — particular proofs that could serve as paradigms, constraints (in the form of inequalities) on possible planar or non-planar graphs, theorems, specific graphs that are useful examples, etc. If I had a teacher of graph theory, I’d want that teacher to prompt me to remember these things so that I could have more of them available as resources when I’m trying to learn something new or do some creative proving or problem solving.

(I should probably bust out some flash cards at some point…)

As an aside, I think that retrieval practice is sometimes mixed up with spaced practice, but I think these are different things. Spaced practice might be a better fit for what people are describing when they talk about intentionally building time-separated practice of skills into their courses and assignments. I think this requires a different sort of finesse than retrieval practice, though, as the problem with spaced practice is making sure students have something productive to do if they’ve actually forgotten the material.

Talking Holocaust With Your Kids

IMG_0843.JPG

I was picking up the baby and Yosef, my three-year old son, at the synagogue their daycare rents space from when we wandered into the setup for an event. There were rows of chairs facing a projection screen and six enormous white candles at the front of the room — clearly a Holocaust memorial service, on the occasion of Yom HaShoah.

We walk through the room and Yosef is all intrigued by whatever it is that intrigues three-year olds about everything. I’m trying to get him to put on his coat with the baby strapped to my chest, clawing at my neck. Nearby is a friend of mine, also trying to shove her daughter’s arms into the jacket.

Yosef wants to know what all the stuff in the room is for.

“It’s for the Holocaust,” I say.

“Really it’s against the Holocaust,” says my friend.

“That’s right,” I say. “Really it’s anti-Holocaust.”

“What’s the Holocaust?” Yosef asks.

“Well, we’re out!” my friend says. “Have fun!” She strollers her daughter away, and we follow behind them. They go home, and we start walking up the big hill up to our apartment. I point out a car, a street sign, a crack in the sidewalk, a clump of dirt.

“What’s the Holocaust?” asks Yosef, a kid who apparently doesn’t know how to take a hint.

“Well,” I say, “well.”

“Well. Well, well well. Yup. Well. So,” I say, “this is a sad story. Yeah, let’s start with that.”

I’m the sort of parent that takes my kid’s questions as a challenge. “Why does it get dark during winter, Daddy?” he asks. “That’s right, do you even know, Dad? Or are you some sort of chump that can’t explain how seasons work to a kid who sometimes pees on the wall?”

So of course I can’t help myself. The Holocaust will be my biggest parenting win yet.

“It’s a sad story,” I say. “Do you know Irene from shul? Right, so she wasn’t born in New York City. She was born in a place called Germany, and she grew up there and her whole family did too. All of her friends and family. And then one day, the Germans told the Jews that they had to get out. We don’t want you any more! Go, and if you don’t go then we’re going to hurt you.”

“Did they get better?”

“What do you mean.”

“After they got hurt?”

“Ah. Umm, no. They didn’t get better.”

“Why not?”

“Because they hurt them in a way that wouldn’t get better.”

“Anyway,” I continue, “Irene ran away. She went to a different country, and then she came to New York City. But most of her friends and family stayed in Germany, and they got hurt.”

“How does it end?” he asked.

“That’s it. They got hurt, Irene had to run away. That’s why it’s a sad story.”

“But it’s happy for the people who ran away.”

“Well, yeah, except they were still sad about everyone who they loved who didn’t run away and got hurt.”

We thoughtfully pause. A leaf falls from a tree. We hear the sounds of children playing. I get ready for a poignant moment with my son.

“Tell another sad story!” he says. He’s laughing. “Tell it again! Tell another sad one.”

“Another one? Alright. OK, so here’s another sad one: this wasn’t the first time this has happened, and it’s happened other times, and it’s probably going to keep on happening. That’s sad.”

“Ha ha! Tell another sad story!”

My poignant moment is backfiring. Somehow I’ve managed to warm my son’s heart with the story of the Holocaust. I put on my serious face.

“Well, I’m too sad from telling all these sad stories. That’s it for now.”

“Tell another!”

“You know how Pharaoh had slaves? Well there were slaves in America too, and it wasn’t that long ago either.”

“OK,” he says. “Hey, there are three sidewalks here, but they turn into five! There are three here, and then they’re five. And NOW THERE ARE THREE AGAIN! DADDY LOOK. WHY? WHY IS IT THREE ACROSS?”

And it was true. The sidewalk started with three little lanes but then expanded into five, back to three again. And who knows why they made it like that, really. How are you supposed to make sense of something like that?

Now That’s What Michael Calls Music! Volume 1

I’ve been stressing out about the characters in this song. Based on the lyrics they are either (a) just barely hanging on OR (b) doing perfectly fine. “So we had a little baby boy
but we knew it wouldn’t last too long,” oh no what is happening to that baby boy? Next line: “kind of what I had in mind, but what I had mind was strong,” and I no longer have any clue as to what’s going on. Either an unmentionable tragedy has occurred or everything is going swimmingly.

This is a very good song with a good guitar solo. I have a friend who is a huge metalhead and we were talking about new music and the death of rock and roll and he said, “God, I just need something with a guitar solo.” I’ve been trying to figure out whether to send this to him or not, because it meets the letter while totally violating the spirit of his request.

Yo I’m in the eye of the storm, where the pressure’s on
And MC’s is dressed funny like a leprechuan
I chop rappers up like chicken szechuan
Sells a squads off like a slave auction
Aiyyo my zodiac sign read caution
On stage, I make your seed to an or-phan
Yo, my age an algebraic equation

The Rising is a great song! I didn’t realize this. My Bruce fandom has focused on everything up to Darkness on the Edge of Town, but I hadn’t gone much past there until recently. (Also great: Born in the USA! Specifically, No Surrender, Downbound Train, Cover Me.)

But The Rising is terrific, heartbreaking. It’s so well-structured that you know precisely what the guitar solo represents in the narrative (the blazing death of a fire fighter) and then he returns as a ghost or something. I had assumed that it was just another B-team classic rock song from a great writer’s later years, and, on closer listen, it is that, but it’s also a bit more than that too.

Excerpting Freddie de Boer’s defense of the SAT

Just read the whole thing here, but I’m disposed to agree with much of it. (Though check the bottom of the post for a research piece that makes me doubt my instincts here.)

The SAT does not enjoy a good reputation among progressives. Arguments against the use of the test, as well as its analog, the ACT, abound. Both are widely derided as tools of elitism, rejected as culturally biased, and denounced for dehumanizing test takers.

I understand the intuitive feeling that we should not reduce human potential to a test score. And the major testing companies (and nonprofit organizations like the Educational Testing Service, which basically function like companies) are not particularly sympathetic entities. But if you believe in equality and a more level playing field in college admissions, you should defend the SAT.

Coaching doesn’t work so well:

Critics of standardized tests often complain that affluent students have greater access to test prep materials and coaching. This is indeed a concern, but the research here is clear: coaching services produce far smaller gains than those advertised by the big test prep companies, which routinely claim triple-digit improvements.

2006 meta-analysis found that students retaking the SAT after coaching resulted in, on average, an increase of about 50 points on a 1600 scale. That’s not an insignificant number. However, as the researchers point out, we can expect some of that gain to occur simply through increased familiarity with the test and, for lower-scoring students — the type most likely to retake the test — regression to the mean. More recent research found that, after using statistical controls to compare similar students, the combined effect of coaching on a 1600 point scale was about 20 points.

Other metrics for judging admissions are easier for the well-off to game:

Detractors of entrance exams often argue for more “holistic” methods of evaluating students than tests, pushing for greater emphasis on student activities, college essays, and letters of recommendation. They argue that these things allow them to select students that are more than just grades and test scores and build a diverse student body. As Jennifer Finney Boylan put it in a piece decrying the SAT, the only way to fairly choose between applicants is “to look at the complex portrait of their lives.”

But this reasoning goes directly against the stated goal of equality. It should be obvious: affluent parents have far greater ability to provide opportunities for extracurricular (and frequently out-of-school) activities than less affluent parents do.

According to this Malcolm Gladwell piece (caveat lector) extra-curriculars were brought in to college precisely to exclude groups (like Jews) who were academically high-performing but not the ideal candidates for admission:

The difficult part, however, was coming up with a way of keeping Jews out, because as a group they were academically superior to everyone else. Lowell’s first idea—a quota limiting Jews to fifteen per cent of the student body—was roundly criticized. Lowell tried restricting the number of scholarships given to Jewish students, and made an effort to bring in students from public schools in the West, where there were fewer Jews. Neither strategy worked. Finally, Lowell—and his counterparts at Yale and Princeton—realized that if a definition of merit based on academic prowess was leading to the wrong kind of student, the solution was to change the definition of merit. Karabel argues that it was at this moment that the history and nature of the Ivy League took a significant turn.

The admissions office at Harvard became much more interested in the details of an applicant’s personal life. Lowell told his admissions officers to elicit information about the “character” of candidates from “persons who know the applicants well,” and so the letter of reference became mandatory. Harvard started asking applicants to provide a photograph.

And to provide evidence that grades can be gamed, Freddie cites this:

Research by Michael Hurwitz and Jason Lee found that, from 1998 to 2016, the average high school GPA rose from 3.27 to 3.38. That may not sound like much, but distributed over millions of students, it’s a large increase. What’s more, the phenomenon is concentrated at the top.

That said, maybe Freddie is wrong. I was talking to researchers on Twitter who found that grades are superior to the SAT for predicting success in college, precisely because they measure more than the SAT, like the ability to ask for help, etc.

So, I don’t know if Freddie is right on this. I need to think more and try to put the pieces together.

What can “I’m not good at this” mean?

Here’s a quick note from the field.

Class today was largely about some fraction arithmetic, and one student was having trouble with it. In class, a couple times, this student said “I’m just not good at this” or “This doesn’t make sense” and “I’m bad at calculating stuff.”

But, all through class, the student stuck with it — I mean that they tried problems on their own and asked questions. And there was definite progress. The student was becoming able to handle this type of question on their own, and starting to make sense of things.

At the end of class I told this student that I thought they were getting the hang of this. I saw a sort of relief pass over this student. Then the student told me:

  • They had a hard time with this topic
  • But this student sort of blames previous teachers
  • This student recently signed up for extra math that is more like our class’
  • The math of our class is the “only math they’re good at”

So what did this student mean when they said “I’m not good at this” etc. in class? In retrospect, it was a statement of fear and anxiety precisely because it was the exception to the rule, at least the rule in our class. This student feels generally competent in our class, so much so that they’ve signed up for similar, optional math next year, and was feeling nervous that this good thing was in danger.

This doesn’t contradict the standard story that people tell about kids saying that they’re “bad at math.” (Especially because this student’s statements weren’t that they were bad at math, in general. It was more specifically about arithmetic and algebra.) But I do think that it illustrates one way that these statements can be an attempt to express something subtler than what they’re usually credited for.

Three things seem important to me about this case:

  1. The student clearly didn’t think that “being bad at arithmetic” was a fixed quality, as this student was simultaneously asking for help. This goes against the “fixed mindset” interpretation, I think.
  2. The student clearly doesn’t, in general, think that they’re bad at all math. These expressions of frustration can be about anxiety that a student’s good thing is under threat. So while it’s never a good thing to hear a kid say that they’re bad at something, it can be a local, specific issue rather than a global one about their status in math class.
  3. The student didn’t think that it was socially OK to be bad at arithmetic or bad at math. This wasn’t a student being proud of being bad at math, and it wasn’t a sign of anything but their own frustration.

I’d be curious to hear other people’s stories about students who make “I’m bad at…” statement in class, to learn more about the different contexts in which kids say this. I’m sure, at the end, we’ll find that they always come at moments of frustration. But I suspect that if a kid is saying that they’re bad at math in class, there’s more to that story, and maybe it’s a sign that (paradoxically) some fundamental things are working for that student in class.

Growth Mindset Roundup

From Marginal Revolution, “Growth Mindset Replicates!”:

In other words, a small, positive effect. But this small effect is coming from a small intervention, two online survey/interventions of 25 minutes each that could be easily scaled to the entire country or even worldwide. We have come a long way from the “mindset revolution” but who am I to discount a marginal revolution? Moreover, the average effect hides heterogeneity, the effect was bigger on the students who needed it most.

Some past opponents of mindset see this as the death of mindset. David Didau has this sort of take in “The nail in Growth Mindset’s coffin?”  He says the true parts of mindset are obvious, the false parts the result of magical thinking:

What this might suggest is that students who have previously underachieved improve when told that if they took more responsibility and worked harder they might do better, and that good behaviour makes a positive difference to any intervention. Neither of which are all that surprising.

This seems to me somewhat unfair. It’s good to have research to know the degree and extent to which obvious things can be shown to have an effect. And, as Didau accurately reported, there had been a number of failed replications in the past. This is decidedly not a failed replication.

There are two new papers out on mindset to keep track of. The first is a huge, carefully done experiment. The other is a huge, carefully down meta-analysis of previous studies.

I haven’t read either carefully yet, but I’ve found it interesting to follow researchers discussing the papers. My impression is that methodologically they hold up to scrutiny. Here are some sample tweets:

Re the meta-analysis:

I don’t entirely stand by this tweet any longer — things don’t feel so confusing now:

What are the educational implications of all this? I think that the claims about the power of mindset interventions to really have a huge impact on learning now have clearly been contradicted by our best research.

It’s hard to know how to talk about this. Smart teachers and educators always knew that these interventions couldn’t have a huge impact on kids, especially if the rest of the classroom pieces weren’t there. That said, not everyone is smart about this, and there was a time early in my teaching life when I believed the over-simplified story about mindset that I heard.

Jo Boaler and YouCubed are pretty clearly going farther than what evidence dictates. I wish they wouldn’t, and am powerless to stop them, and it makes me sad that they don’t seem to care. Defenses of them seem to come down to “well it’s not true but it’s a net-good message so spread it far and wide!” This is something that goes against all my instincts. I don’t do well with this sort of utility calculation.

Anyway, for an picture of exactly the sort of thing that the evidence does not support now (if it ever did) you can check out this video from Boaler and YouCubed, about how believing in yourself has been scientifically proven to change how your brain works and improve your achievement. Blech:

Likewise, I don’t see support for the sort of mindset interventions that are built into the first week of the New Visions math curriculum. There’s some good math in there, and maybe it’s good to talk about growth mindset during that math, I don’t know. It depends on how time-intensive the mindset stuff is, I think.

Where are we headed? Growth mindset is just going to be another high-level name for describing good teaching. It matters, but as a goal, or a value that connects a lot of disparate elements of teaching practice.

It feels like the mindset story is coming to a conclusion with these big, careful studies.