This is a bit old, but in case you haven't seen it...
A few weeks ago, Jake wrote a post about the importance of teaching during grad school. I couldn't agree more--some of my best experiences in grad school to date have been in front of a classroom of keen undergrads, their young minds yearning to be filled with the minutiae of microeconomic theory (or so I have convinced myself). I find it absolutely true that having to teach a concept cements it in my mind, and it is my fervent hope that a few of my students will at least consider becoming economists.
There is also, of course, the question of what the students get out of classes. A while back, one of my classmates sent around an AER paper by George Borjas entitled "Foreign-Born Teaching Assistants and the Academic Performance of Undergraduates". The gist is that undergrads who have foreign TAs perform worse on their exams than their classmates with "native-born" TA's.
This raised a few eyebrows among grad students at the LSE, where just about everyone is foreign. I can think of one British grad student in the econ department. Presumably, the issue in question is one of fluency in English rather than actual "native-ness", so I should also count one Australian and a smattering of Irish and North Americans. That still leaves the vast majority of economics undergrads being taught by TA's for whom English is a second (or third, or fourth, or fifth--some of my classmates are amazing) language.
So just how bad is this for them, and why?
The difference Borjas found is small, but it is statistically significant. Students who have foreign-born TA's score roughly 0.2 points lower on the usual 4-point grading scale (A = 4, A- = 3.7, B+ = 3.3,...). And this result is robust to several specifications, including controlling for overall GPA, which serves as a proxy for general academic ability.
Borjas looked at an introductory-level course sequence in economics (micro and macro) at a large public university in the US. All students who pursue an economics major must take this sequence, which involves lectures and weekly sessions with TA's. They have different TA's for the micro and macro component. Borjas surveyed undergraduates enrolled in the micro component in three separate years, asking them whether their TA's in the component courses were foreign, their final grades, their GPAs, and other personal characteristics. He also asked them to comment on whether foreign-born TA's had better or worse communication skills than native-born TA's, and on whether foreign-born TA's were better or worse prepared for class. The students generally reported no difference in the level of preparation for class, but almost 80% of students said that foreign-born TA's have worse communication skills than native-born TA's.
Table 2 shows the results of Borjas's regressions:
This is a fixed-effect regression (columns i, ii, v, vi, vii), which means that a dummy variable (1 if something is true, 0 otherwise) for each student was included. The individual student fixed effects control for any student-specific differences (such as ability or effort) that might affect their final grade but don't vary between the two components (micro and macro). So the coefficient you see on "Foreign-born TA" represents the isolated effect of having a foreign TA. Looking across specifications, the -0.2 coefficient doesn't change much depending on what other control variables are included, which indicates a pretty solid effect.
Look now at column (vii).
Column (vii) interacts the foreign-born TA dummy with the undergraduate's perception of the class-preparedness of foreign-born TA's. The evidence indicates that foreign-born TA's do not worsen the scholastic achievement of undergraduates if they are better prepared than native-born TA's. It seems as if additional class preparation may resolve the teaching difficulties encountered by foreign-born TA's.
So spending a bit more time preparing the week's lesson ahead of time ameliorates the communication problem.
Finally, Borjas checked to see if there was a differential effect on American versus foreign-born undergraduates. Looking at columns (i) and (ii), in which Borjas ran the primary regression separately for American and foreign students, it turns out that foreign-born TA's hurt the performance of their American students, but have no adverse effect on their foreign students. Borjas reckons that this is because most of the foreign undergrads were Asian, and so were most of the foreign-born grad students.
The evidence suggests that foreign-born graduate students do not have an adverse impact on the academic achievement of undergraduate students who are "like them" (perhaps both in terms of language and culture) but do have an adverse impact on undergraduates who are sufficiently different.
I have an additional hypothesis: even if foreign-born undergrads are being taught by TAs who are "like them", they are still being taught in English. They therefore may come into the course expecting to have to work a bit harder to understand the material as it's being presented and this added effort may compensate for a possible linguistic disadvantage. I wonder if exerting a little extra effort might not help American students lessen the adverse impact on their learning.
It's important to bring up the question of external validity of this study. Borjas looked at 309 economics students in a single university in the United States, so it's certainly not clear that this is a universal effect. However, given that more and more people are coming from all over the world to do their graduate work in the US (which we absolutely want!), it's worth looking at any unexpected results of this trend. My reading of the paper suggests that, if there is an effect, a little extra effort on both sides to improve understanding and communication can solve the problem.
- Log in to post comments
i'm sure you'll get anecdotes, but
1) my friend who were international students made sure to do *all* the reading, over & over, because they weren't as quick to catch nuance in the lecture which might go a little fast for their english comprehension (fine if you are speaking sciencese, but the non-science sinews could leave them confused).
2) there were particular foreign born TAs whose english communications were bad enough that anyone who wanted to succeed in a class knew that that they had to pour over the packets and texts as if they were sacred.
At my university, in later years, we had to certify competence in English before we could hire. On the other hand, a Chinese colleague, for whom English was clearly a second language, twice won student-generated great teacher awards.
It would be interesting to find out whether the difference in effect between native-born and foreign-born students persists at places like LSE. If indeed the issue is the perceived "foreignness" of the TA, then this issue should go away at institutions where nearly everyone is from a different country.
I would also be curious to see what would happen at non-American schools. Perhaps this is a testament to American chauvinism, but it would be interesting to find out whether students from other countries learn better from people like them.
I'm just making a pure conjecture here:
There could also be the possibility that students simply give up when faced with a foreign-born TA, producing a self-fulfilling prophecy. So their lower scores may partly rest on their own expectations, and not just the performance of the TAs.
A Japanese professor, with poor English, taught one of my critical engineering courses, "Separations", back in the 60's. During my 35-year career as a Chemical Engineer, I never really understood McCabe-Thiel distillation theory, even though I worked with distillation separations from time to time.
Both my best and worst TAs were US natives (physics and computer science respectively -- the CS TA not only had poor communication skills and refused to learn the language at hand because "nobody uses it", but openly solicited dates from his female students). I'm quite certain my CS TA's section's grades skewed low compared to other sections (unfortunately it was a class without a supervising professor so I doubt anyone noticed or cared).
It was my experience that my non-native TAs had more absenteeism and more sleeping during section than my US native TAs. They were also less approachable for office hours. This probably had less to do with being foreign born and more to do with being married with small children, where most of my US-born TAs were not. On the plus side, I don't remember any of them pressuring me or my female classmates for dates.
On the plus side, I don't remember any of them pressuring me or my female classmates for dates.
well, mebee FOBs judged their chances low? ;0)
students at my institution sometimes report having difficulty understanding one of our faculty members, a yeast geneticist from china. so much so that i was paid last summer to "facilitate" during his summer class.
it was embarrassing for him and uncomfortable for me, particularly after i realized that the students who had really instigated for outside assistance were the ones who wouldn't do well under any instructor. why? because they used the professor's difficulty with english (which was real, i admit) as an excuse to avoid the work. not every student, but a few.
i'll go with gmcfly's claim that many students doom themselves by throwing up their hands when they have initial difficulty understanding the instructor.
and i'll add that american chauvinism, however unconscious, definitely plays a role. if you're disdainful of a foreign instructor from the outset, your odds of doing well in his or her class decrease automatically.
I am a math grad student in a top US school right now. I am a Chinese so my english is accented but solid and fluent enough to articulate and make jokes. I have never listened to students saying 'what ? what are u talking about?'.At any time, I am really curious whether the students really understand my language skills. So the two things I keep doing in every section are: (1) Keep asking them 'can u understand? is it understandable enough?' Most of them nod their heads , it means that they can understand my teaching. (2) I make quirky jokes at times, and everytime almost all students laugh, which means that they understand my jokes well. So I am confident that my english level is competant enough to teach. In office hours the students keep asking questions and things.
But the thing I find very irritating is: First, they are totally unprepared for the section and they come just to ask for homework solutions or hints directly. They keep asking unintelligible questions that are around mid-level math level. I am shocked that I need to cover mid-level math in a calculus course for non-science majors in a top school in US.
The second thing is: a few students never listen to me. Looking at the floor all the time no matter what I say. Occasionally, I try to approach them and talk to them friendly, they reply me without ever looking at me. It is completely rude. I have a feeling that they look down on me just because of my race but nothing to do with my teaching ability. Or maybe because of my accented english (but solid and fluent enough), they just do not listen to other accents. It also means that no matter how hard I try, these guys still don't give a damn about what I said just because of the fact that I am foreigner.
To be fair, 90-95% of Ameircans are nice and friendly, but this 5-10% makes me extremely angry.