Race, Face, and the Uncanny Valley

Dr. J has been riffing on the phenomenon of the ‘uncanny valley’ lately. ‘ For those who don’t know, the ‘uncanny valley‘  is a theory for why we find some human-like artificial things so weird. My favorite example is dolls, as this image suggests, but masks are also good examples and ultimately Masahiro Mori was concerned with robots and androids for reasons that are closely connected to the Japanese fascination with robotics. The question is: what is it about near-human faces and movements that feels so wrong and abject to us? Why isn’t our comfort level linear?

Dr. J writes that:

The non-human/human divide must intersect at the point of the human corpse, I think, which is the point at which whatever revulsion we feel at the “simulation” of the human– my hypothesis is that this revulsion is motivated by our aversion to “deception”– begins to be replaced by an affectively similar, but categorically different, kind of revulsion, i.e., the kind of revulsion that is motivated by our aversion to morbidity and mortality.

So if I’m reading her correctly, just as we begin to worry that we are being deceived, we transition to a set of concerns around our own mortality that are inspired by viewing a human corpse. But that doesn’t seem born out by the principle distinction between animated and unmoving uncanniness, since there’s much more revulsion at seeing an animated near-human robot than in seeing a still one. (Unless we truly do have an abiding fear of zombies….) That said, Dr. J is much more interested in the way that the ‘uncanny valley’ can help us to think about race and racism, so I think there’s room to tinker with the explanation for why near-human simulations so trouble us.

Here’s my take on the ‘uncanny valley:’ human brains are extremely good at faces. We’re so good at faces, we even see them when they’re not really there. Take the ‘hollow mask’ illusion:

This isn’t a trick video, there’s no special effects here. That’s your brain’s highly tuned facial recognition doing its work. Unless you’re drunk, high, or schizophrenic, you’ll be unable to persuade your eyes that they are seeing a concave face moving from right to left… as the exterior of the mask leaves your view, it will look as if you are seeing a concave face is moving from left to right, instead of the convex side of the mask continuing from right to left. Apparently, the reason schizophrenics and some drunks don’t see the illusion is that the part of their brain that specializes in faces is either permanently damaged or temporarily impaired.

A piece of cheese on toast purportedly showing the Virgin MaryThe way I interpret the ‘uncanny valley’ is as a challenge to our facial recognition faculties. Your brain is working overtime to resolve the image as a human face, but in so doing it’s coming up against an obstacle that it cannot surmount. The brain is so highly attuned to human faces that it will sometimes create false positives, such as the Man in the Moon or the the Virgin Mary in a grilled cheese! In the process of cognitive dissonance that emerges when we can’t easily distinguish a real face from an image, we experience a sense of vertigo.You can provoke a very similar feeling by looking at a loved-one’s face upside-down: at first, their hair line resolves as a smile, but then you start to look at this familiar face in terms of its parts and, well, it’s weird and uncomfortable. The materiality of the face confronts you with your own materiality, and with the artifice that animates even our quotidian interactions. I don’t think this is directly related to the fear of death, but rather to the nausea of ambiguity, in which death is less threatening than meaninglessness.

Fanon described the Syisyphan existence of non-whites in a white-supremacist society as a project of “black skins donning white masks.” Similarly, Bhabha explains the strategy of racial (and racist) discourse as one of ironic farce– in which whites demand of non-whites the impossible task: “Be like me, but don’t be just like me”– such that the life of non-whites becomes defined by and obsessed with an always-imperfect mimicry. The point here is that “whiteness” is set as a universal norm to which everyone is accountable and expected to aspire, only the very idea of “whiteness” requires that not everyone be able to achieve it. Like the uncanny valley, whites accept non-whites the closer and closer they approximate whiteness– up to a point— but when non-whites get close enough in their mimicry to “pass” as “really” white, the integrity and truth of “whiteness” becomes threatened and the mimicry is violently rejected.

As a metaphor, I think this is a spot-on use of the ‘uncanny valley.’ The uncanniness of ambiguous race (or gender or sexuality, for that matter) strikes me to be very similar to the uncanny failure to fully visualize a face when confronted with a robot or mask. But it’s not the same, for the obvious reason that those of ambiguous race or gender are just as human as anyone else. But if it doesn’t feel that way to the majority of viewers, then it will be tempting to ignore the fact of humanity in favor of the feeling of alienation. So much of our discourse on human rights is rooted in a kind of pre-rational indignation at the mistreatment of fellow human beings: when we fail to see the sufferer as a fellow human, the indignity is lost. We might still recognize that the sufferer has rights, but only in a reflective or calculative way. The affective dimension of the rights are lost. That’s why the hooding of the Guantanamo prisoners was so troubling: they weren’t just abused, but every available image of them was designed to foreclose empathy. This might also help to explain why a drunk or high person, having impaired the part of their brain that engages in facial recognition, might also lose track of the empathy for a fellow human’s suffering and so act cruelly or violently.

One other implication of this might be tied to the various attempts to make sense of the “Cross-Race Effect” or “Other-Race Effect.” People of all races tend to be better at recognizing individual faces from members of their own race, while they are better at picking out members of others races when asked to seek the other-race face among a group of own-race photographs. This explains the somewhat prevalent attitude that members of other races ‘all look alike’: we lack practice in easily distinguishing faces outside of our own ethnic phenotype, and when exposed to other-race faces we concentrate on broad ethnic differences rather than the minor variations that allow us to identify individuals.

We know this is a learned behavior because the ‘own-race bias’ has been shown to transfer to the race of adopted parents in interracial adoptions: African-American children adopted by Caucasians share their parents ‘own-race bias’ and more easily identify individuals whites. So if facial recognition is the key to empathy, and most people are better at identifying members of their own race, we have strong evidence of a kind of subconscious racism that doesn’t have an ‘intentional’ angle. We now know that certain kinds of perceptual training can be used to eliminate the facial recognition bias, which is especially important for police since without such training there’s increased risk in using other-race eye-witness testimony in criminal courts. Interestingly, this training in other-race individuation cues has the side-effect of reducing implicit racial bias, specifically the time it takes for whites to associate positive words with black faces. It’s easier to think of Martin Luther King, Jr. or Nelson Mandela as a “leader” after training to recognize individual faces among African-Americans. Implicit Association Tests show that a white person would still come to those conclusions, but it would take longer. Something about learning the specific cues needed to tell members of another race apart also enhances our capacity to think highly of them!

This takes us back to the ‘uncanny valley.’ It seems to me that the biggest problem with masks and dolls is that they are mass-produced. They all look the same, and individuality doesn’t matter much. As they grow closer to human-simulations, however, they transfer that mass-produced anonymity into a space where identity and individuality are of paramount importance to the facial recognition part of our brains. The uncanniness of this human-like simulacrum is its resistance to individuation, even as it presents itself to me as a potentially individual being who will deserve my sympathy and concern.

Is there an analogy in race, here? Dr. J proposes Michael Jackson as an example, but though the rhetoric around his skin color and nose job was racialized, I think he is actually an example of our general distaste for bad plastic surgery. That said, within the framework of own-race individuation bias, one reason that bad plastic surgery might be difficult for us to stomach is the way that it mixes our facial (and racial) taxonomies. If I can’t find the individual markers in a face because I’m forced to bridge my taxonomy for dealing with black and white faces, for instance, I may experience that uncanny ambiguity in the face of the struggle. This interpretation is either challenged or bolstered by several studies that show that mixed race faces tend to be more attractive to members of either race, even when they tend to rate members of their own race more attractive beforehand. (This finding suffers a little bit from a false assumption, as it pretends that races can be unadulterated or pure before they are ‘mixed.’ Still, insofar as it works with viewer-generated racial attributions, it may be salvageable.)

This also raises questions about mimicry and symmetry, since one of the major components of facial beauty is apparently left-right symmetry which is also alleged to identify genetic ‘health,’ and seems to be one of the major components of mixed race beauty. The very mirroring or twinning that troubles us in masks and robots is the wellspring of facial beauty, as well! If you’re thinking of the original uncanny story of the doppelgänger that Freud interpreted to generate his own theories of unheimlichkeit (not-at-home-ness) then I’m right there with you.

In general, I want to maintain that when we think about faces we’re thinking about individuation, and that this individuation is more important that species membership (humanness) or race/gender/sexuality membership, but that those groupings form phenomenological filters that mediate our attempts to individuate others and become individuated ourselves. Ambiguities, whether they be in sexuality, gender, race, or species, threaten us with the artificial and ephemeral grounds for individuation. Each of us can only become an ‘I’ in contrast with some ‘We,’ which is the group from which I prise my individuality, and in whose idiom I express it. For evolutionary biological reasons it makes sense to assume that the human brain is built so as to work best among a small troupe of individuals, between 100-200 people, with whom we share many facial traits. But these groups in which we claim membership are all of them artificial, and the most uncanny valley is the one that separates each ‘We’ from some ‘Them.’ If so, then Dr. J is right: anti-racist causes can be assisted by bridging that valley, but we can’t simply declare ourselves race-blind in order to do it. To make progress in this arena, we’ll first have to work quite hard at seeing and understanding race, first in faces, but eventually in discourses, institutions, and experiences, too.

I leave you with the first in a series of short lectures on the ‘uncanny valley’ by Karl MacDorman:

Advice for Romantics: Stay in School, Get a Job

The Boston Globe has a long story about the shift in marriage rates for educated women.

It looks like:

1. “The median age for a first marriage nationally is now 25.5 for women and 27 for men. It is even higher for those with graduate degrees. In Massachusetts, the median age at first marriage is 27.2 for women and 29.2 for men.”
2. “In a historic reversal of past trends – one that is good news for young girls who like to use big words – college graduates and high-earning women are now more likely to marry than women with less education and lower earnings, although they are older when they do so. Even women with PhDs no longer face a “success penalty” in their nuptial prospects.”
3. “[T]here is now a “success premium” for highly educated black women, who are more likely to get married and also more likely to stay married than other black women. Fewer than 50 percent of African-American women with a high school education are married, compared with more than 55 percent of African-American women with 19 years of school.”
4. “The 2001 Journal of Marriage and Family paper found that in mate-preference surveys taken in 1985 and 1996, intelligence and education had moved up to number 5 on men’s list of desirable qualities in a mate in both surveys, ahead of good looks. Meanwhile, the desire for a good cook and housekeeper had dropped to 14th place in both surveys, near the bottom of the 18-point scale. And in choosing a spouse, males with a college degree rate good looks much lower in importance than do high school graduates.”
5. “[C]ollege-educated couples have lower divorce rates than any other educational group. And in the last 30 years, while the marriages of less-educated women became less stable, the marriages of college-educated women became more stable. College graduates are more likely to have egalitarian ideas about sharing housework and breadwinning, and recent research shows that egalitarian ideas and behaviors improve marital satisfaction for both men and women.”
6. “They have better sex lives, too. According to sociologist Virginia Rutter of Framingham State College, surveys show that educated couples engage in more variety in their sex lives…. Educated husbands are also more likely to help with housework, which turns out to be a potent aphrodisiac.”
7. “In fact, Barnett’s new study of dual-earner couples, based on data from the 1990s, found that as the wife worked more, the husband’s view of the quality of his marriage actually improved. Surveys also show that the longer a woman holds a job, the more child care and housework her husband is likely to do, and that well-educated men have increased their housework more than less-educated ones.”
8. “[O]ne of the biggest predictors that a marriage will be stable and happy, according to Gottman, the psychologist, is if a husband responds positively when his wife expresses a desire for change. It helps if she asks nicely. But it doesn’t help if she avoids the issue and lets her discontent simmer.”