Facial expression

Photographs from the 1862 book Mécanisme de la Physionomie Humaine by Guillaume Duchenne. Through electric stimulation, determined which muscles were responsible for different facial expressions. Charles Darwin would later republish some of these photographs in his own work on the subject, which compared facial expressions in humans to those in animals.

A facial expression is one or more motions or positions of the muscles beneath the skin of the face. According to one set of controversial theories, these movements convey the emotional state of an individual to observers. Facial expressions are a form of nonverbal communication. They are a primary means of conveying social information between humans, but they also occur in most other mammals and some other animal species. (For a discussion of the controversies on these seemingly obvious claims, see Fridlund and Russell & Fernandez Dols.)

Humans can adopt a facial expression voluntarily or involuntarily, and the neural mechanisms responsible for controlling the expression differ in each case. Voluntary facial expressions are often socially conditioned and follow a cortical route in the brain. Conversely, involuntary facial expressions are believed to be innate and follow a subcortical route in the brain.

Facial recognition is often an emotional experience for the brain and the amygdala is highly involved in the recognition process.

The eyes are often viewed as important features of facial expressions. Aspects such as blinking rate can be used to indicate whether or not a person is nervous or whether or not he or she is lying. Also, eye contact is considered an important aspect of interpersonal communication. However, there are cultural differences regarding the social propriety of maintaining eye contact or not.

Beyond the accessory nature of facial expressions in spoken communication between people, they play a significant role in communication with sign language. Many phrases in sign language include facial expressions in the display.

There is controversy surrounding the question of whether or not facial expressions are worldwide and universal displays among humans. Supporters of the Universality Hypothesis claim that many facial expressions are innate and have roots in evolutionary ancestors. Opponents of this view question the accuracy of the studies used to test this claim and instead believe that facial expressions are conditioned and that people view and understand facial expressions in large part from the social situations around them.

Creation

Facial muscles

Lars Jacob acting out Drama Masks (Thalia and Melpomene) in 1972.

Facial expressions are vital to social communication between humans. They are caused by the movement of muscles that connect to the skin and fascia in the face. These muscles move the skin, creating lines and folds and causing the movement of facial features, such as the mouth and eyebrows. These muscles develop from the second pharyngeal arch in the embryo. The temporalis, masseter, and internal and external pterygoid muscles, which are mainly used for chewing, have a minor effect on expression as well. These muscles develop from the first pharyngeal arch.

Neuronal pathways

There are two brain pathways associated with facial expression; the first is voluntary expression. Voluntary expression travels from the primary motor cortex through the pyramidal tract, specifically the corticobulbar projections. The cortex is associated with display rules in emotion, which are social precepts that influence and modify expressions. Cortically related expressions are made consciously.

The second type of expression is emotional. These expressions originate from the extrapyramidal motor system, which involves subcortical nuclei. For this reason, genuine emotions are not associated with the cortex and are often displayed unconsciously. This is demonstrated in infants before the age of two; they display distress, disgust, interest, anger, contempt, surprise, and fear. Infants’ displays of these emotions indicate that they are not cortically related. Similarly, blind children also display emotions, proving that they are subconscious rather than learned. Other subcortical facial expressions include the “knit brow” during concentration, raised eyebrows when listening attentively, and short “punctuation” expressions to add emphasis during speech. People do not consciously realize that they are producing these expressions.

Neural mechanisms in face perception

See also: Face perception

The amygdala plays an important role in facial recognition. Functional imaging studies have found that when shown pictures of faces, there is a large increase in the activity of the amygdala. The amygdala receives visual information from the thalamus via the subcortical pathways. The amygdala may also have a significant role in the recognition of fear and negative emotions. It is believed that the emotion disgust is recognized through activation of the insula and basal ganglia. The recognition of emotion may also utilize the occipitotemporal neocortex, orbitofrontal cortex and right frontoparietal cortices.

Gender and facial cues

More than anything though, what shapes a child’s cognitive ability to detect facial expression is being exposed to it from the time of birth. The more an infant is exposed to different faces and expressions, the more able they are to recognize these emotions and then mimic them for themselves. Infants are exposed to an array of emotional expressions from birth, and evidence indicates that they imitate some facial expressions and gestures (e.g., tongue protrusion) as early as the first few days of life.

Communication

Eye contact

See also: Eye contact

A person's face, especially their eyes, creates the most obvious and immediate cues that lead to the formation of impressions. This article discusses eyes and facial expressions and the effect they have on interpersonal communication.

A person's eyes reveal much about how they are feeling, or what they are thinking. Blink rate can reveal how nervous or at ease a person may be. Research by Boston College professor Joe Tecce suggests that stress levels are revealed by blink rates. He supports his data with statistics on the relation between the blink rates of presidential candidates and their success in their races. Tecce claims that the faster blinker in the presidential debates has lost every election since 1980. Though Tecce's data is interesting, it is important to recognize that non-verbal communication is multi-channeled, and focusing on only one aspect is reckless. Nervousness can also be measured by examining each candidates' perspiration, eye contact and stiffness.

Within their first year, Infants learn rapidly that the looking behaviors of others conveys significant information. Infants prefer to look at faces that engage them in mutual gaze and that, from an early age, healthy babies show enhanced neural processing of direct gaze.

Eye contact is another major aspect of facial communication. Some have hypothesized that this is due to infancy, as humans are one of the few mammals who maintain regular eye contact with their mother while nursing. Eye contact serves a variety of purposes. It regulates conversations, shows interest or involvement, and establishes a connection with others.

Eye contact regulates conversational turn taking, communicates involvement and interest, manifests warmth, and establishes connections with others…[and] it can command attention, be flirtatious, or seem cold and intimidating… [it] invites conversation. Lack of eye contact is usually perceived to be rude or inattentive.

But different cultures have different rules for eye contact. Certain Asian cultures can perceive direct eye contact as a way to signal competitiveness, which in many situations may prove to be inappropriate. Others lower their eyes to signal respect, and similarly eye contact is avoided in Nigeria, and between men and women in Islam; however, in western cultures this could be misinterpreted as lacking self-confidence.

Even beyond the idea of eye contact, eyes communicate more data than a person even consciously expresses. Pupil dilation is a significant cue to a level of excitement, pleasure, or attraction. Dilated pupils indicate greater affection or attraction, while constricted pupils send a colder signal.

Micro expressions

Micro expressions are the facial expressions that last less than a second that can help to determine the true feelings or emotions of the sender in communication. The fundamental characteristics of a micro-expression, according to Ekman’s original definition, are involuntary leakage and fast speed. These expressions have been gaining more attention over the years for many reasons. The show Lie To Me exhibits the art of watching the micro expressions of people and determining whether they are being truthful or not. Law enforcement can benefit from this practice to catch criminals. This is not something that is easy to do, as a University of San Francisco study shows that less than 1% of people are natural lie detectors who can detect micro expressions and lies without first being trained.

It is unknown how this tiny demographic has learned such a useful skill, and researchers are still trying to determine what qualities people may possess to make them successful. So far, researchers have not been able to find a technology that can accomplish the same lie-detecting skills as people who are natural lie detectors. However, it is possible for anyone with a computer to be formally trained in the art of detecting micro expressions.

Cues that tip off lie-detectors can be through the mouth, eye movements, or even our eyebrows. Micro expressions have become increasingly studied over the years due to the possible help in detecting danger or someone's true, underlying emotions.

Sign languages

Facial expression is used in sign languages to convey specific meanings. In American Sign Language (ASL), for instance, raised eyebrows combined with a slightly forward head tilt indicate that what is being signed is a yes/no question. Lowered eyebrows are used for wh-word questions. Facial expression is also used in sign languages to show adverbs and adjectives such as distance or size: an open mouth, squinted eyes, and tilted back head indicate something far while the mouth pulled to one side and the cheek held toward the shoulder indicate something close, and puffed cheeks mean very large. It can also show the manner in which something is done, such as carelessly or routinely. Some of these expressions, also called non-manual signs, are used similarly in different sign languages while others are different from one language to another. For example, the expression used for 'carelessly' in ASL means 'boring or unpleasant' in British Sign Language.

Universality hypothesis

File:Pouting.jpeg

A man pouting.

The universality hypothesis is the assumption that certain facial expressions are signals of specific emotions (happiness, sadness, anger, fear, surprise, and disgust) that are recognized by people everywhere, regardless of culture or language. The evolutionary basis of these kinds of facial expressions can be traced back to Darwin’s The Expression of the Emotions in Man and Animals. Reviews of the universality hypothesis have been both supportive and critical. More recent work by Nelson and Russell and Jack et al. has been especially critical.

Support

Ekman's work on facial expressions had its starting point in the work of psychologist Silvan Tomkins. Ekman showed that facial expressions of emotion are not culturally determined, but universal across human cultures.

To demonstrate the universality hypothesis, Ekman tested the South Fore people of New Guinea, a pre-industrial culture that was isolated from the west. The Fore were told brief stories about emotional events (happiness, sadness, anger, fear, surprise, and disgust). After each story, they were asked to select the matching facial expression from an array of three faces. The Fore selected the correct face on 64%-90% of trials but had difficulty distinguishing the fear face from the surprise face. Children selected from an array of only two faces, and their results were similar to the adults’. Subsequent cross-cultural studies found similar results.

Criticism

Both sides of this debate agree that the face expresses emotion. The controversy surrounds the uncertainty about what specific emotional information is read from a facial expression. Opponents of the universality hypothesis believe that more general information is pieced together with other contextual information in order to determine how a person feels.

One argument against the evidence presented in support of the universality hypothesis is that the method typically used to demonstrate universality inflates recognition scores. Although each factor may contribute only a small amount to the inflation, combined, they can produce exaggerated scores. The three main factors are the following:

• The universality hypothesis focuses on people's abilities to recognize spontaneous facial expressions as they occur naturally. However, the facial expressions used to test this hypothesis are posed. Studies of spontaneous facial expressions are rare and find that participants’ recognition of the expressions is lower than that of the corresponding posed expressions.
• In most studies, participants are shown more than one facial expression (Ekman recommends six of each expression). However, people judge facial expressions relative to others that they have seen, and participants who judge more than one facial expression have higher recognition rates than those who judge only one.
• The response format that is most commonly used in emotion recognition studies is forced choice. In forced choice, for each facial expression, participants are asked to select their response from a short list of emotion labels. The forced choice method determines the emotion attributed to the facial expressions via the labels that are presented. That is, participants will select the best match to the facial expression even if it is not the emotion label they would have provided spontaneously and even if they would not have labeled the expression as an emotion at all.

Evolutionary significance of universality

Darwin argued that the expression of emotions has evolved in humans from animals, who would have used similar methods of expression. Darwin believed that expressions were unlearned and innate in human nature and were therefore evolutionarily significant for survival. Darwin obtained evidence of this through his research on different cultures and species and on infants. Ekman found that people shared many similar facial expressions despite never having met previously before. He was successfully able to confirm Darwin’s initial hypothesis that expressions were indeed unlearned behaviors that develop independently from cultured expressions.

Cross-cultural studies had shown that there are similarities in the way emotions are expressed across diverse cultures, but studies have even shown that there are similarities between species in how emotions are expressed. Research has shown that chimpanzees are able to communicate many of the same facial expressions as humans through the complex movements of the facial muscles. In fact, the facial cues were so similar that Ekman’s Facial Action Coding System could be applied to the chimps in evaluating their expressions. Of course, differences between the species' physical facial properties, such as white sclera and everted lips in chimps, would mean that some expressions could not be compared. Similarly, Darwin observed that infants’ method of expression not only was similar to those of adults, but seemed to be instinctive, as they were able to display emotional expressions they had not themselves yet witnessed. It is clear that facial morphology impacts expression recognition in important ways. Therefore, infant facial morphology may also serve some specific communicative function. These similarities in morphology and movement in emotional expression are important for the interpretation of emotions. Darwin was particularly interested in the functions facial expression as evolutionarily important for survival. He looked at the functions of facial expression in terms of the utility of expression in the life on the animal and in terms of specific expressions in species. Darwin deduced that animals were communicating feelings of different emotional states with specific facial expressions. He further concluded that this communication was important for the survival of animals in group-dwelling species; the skill to effectively communicate or interpret another animal’s feelings and behaviors would be a principal trait in naturally fit species.

See also

File:USMC-050124-N-1810F-562.jpg

Upset over a candy dispute with another child, a boy displays an angry pout

• Affect display
• Bell's Palsy
• Computer processing of body language
• Emotion
• Emotion classification
• Facial Action Coding System, Paul Ekman
• Facial recognition system
• Laughter, Gelotology, Freitas-Magalhães
• Metacommunicative competence
• Thought Moments

External links

• The Naked Face, August 5, 2002. Annals of Psychology
• Facial Expressions Resources Page contains links to research concerning facial expressions
• Bell's Palsy information site Information for sufferer's of facial palsy/facial paralysis
• The Umeå University Database of Facial Expressions, October 12, 2012. Journal of Medical Internet Research
• The JAFFE Database of Facial Expressions
• Facial expression analysis David Matsumoto and Paul Ekman Scholarpedia, 3(5):4237. doi:10.4249/scholarpedia.4237