Neural Network Model Shows Why People with Autism Read Facial Expressions Differently

People with autism spectrum disorder have difficulty interpreting facial expressions.

Using a neural network model that reproduces the brain on a computer, a group of researchers based at Tohoku University have unraveled how this comes to be.

The journal Scientific Reports published the results.

“Humans recognize different emotions, such as sadness and anger by looking at facial expressions. Yet little is known about how we come to recognize different emotions based on the visual information of facial expressions,” said paper coauthor, Yuta Takahashi.

“It is also not clear what changes occur in this process that leads to people with autism spectrum disorder struggling to read facial expressions.”

The research group employed predictive processing theory to help understand more. According to this theory, the brain constantly predicts the next sensory stimulus and adapts when its prediction is wrong. Sensory information, such as facial expressions, helps reduce prediction error.

The artificial neural network model incorporated the predictive processing theory and reproduced the developmental process by learning to predict how parts of the face would move in videos of facial expression. After this, the clusters of emotions were self-organized into the neural network model’s higher level neuron space - without the model knowing which emotion the facial expression in the video corresponds to.

The model could generalize unknown facial expressions not given in the training, reproducing facial part movements and minimizing prediction errors.

Following this, the researchers conducted experiments and induced abnormalities in the neurons’ activities to investigate the effects on learning development and cognitive characteristics. In the model where heterogeneity of activity in neural population was reduced, the generalization ability also decreased; thus, the formation of emotional clusters in higher-level neurons was inhibited. This led to a tendency to fail in identifying the emotion of unknown facial expressions, a similar symptom of autism spectrum disorder.

According to Takahashi, the study clarified that predictive processing theory can explain emotion recognition from facial expressions using a neural network model.

“We hope to further our understanding of the process by which humans learn to recognize emotions and the cognitive characteristics of people with autism spectrum disorder,” added Takahashi. “The study will help advance developing appropriate intervention methods for people who find it difficult to identify emotions.”

Just a facial expression study I did of my OC Bramble, Luthien’s youngest bro and politically married to Celegorm (in one AU anyway), I wanted to get in on the eldritch Maia train with my plant boi cuz he was perfect for it and so here he is with his mood roses (and yes, he’s often pricked himself with his own thorns when pissed off)

Some expression practice from artfight.

His name is Hélio!

Twig facial expressions~

A bonus Ruse @morbid-mordecai

And the hand of Twig’s mother, Mary Warden/The Mole

verge-angst:

sclacen:

EYES/BROWS

• his eyes widened
  
• her eyes went round
  
• her eyelids drooped
  
• his eyes narrowed
  
• his eyes lit up
  
• his eyes darted
  
• he squinted
  
• she blinked
  
• her eyes twinkled
  
• his eyes gleamed
  
• her eyes sparkled
  
• his eyes flashed
  
• his eyes glinted
  
• his eyes burned with…
  
• her eyes blazed with…
  
• her eyes sparked with…
  
• her eyes flickered with…
  
• _____ glowed in his eyes
  
• the corners of his eyes crinkled
  
• she rolled her eyes
  
• he looked heavenward
  
• she glanced up to the ceiling
  
• she winked
  
• tears filled her eyes
  
• his eyes welled up
  
• her eyes swam with tears
  
• his eyes flooded with tears
  
• her eyes were wet
  
• his eyes glistened
  
• tears shimmered in her eyes
  
• tears shone in his eyes
  
• her eyes were glossy
  
• he was fighting back tears
  
• tears ran down her cheeks
  
• his eyes closed
  
• she squeezed her eyes shut
  
• he shut his eyes
  
• his lashes fluttered
  
• she batted her lashes
  
• his brows knitted
  
• her forehead creased
  
• his forehead furrowed
  
• her forehead puckered
  
• a line appeared between her brows
  
• his brows drew together
  
• her brows snapped together
  
• his eyebrows rose
  
• she raised a brow
  
• he lifted an eyebrow
  
• his eyebrows waggled
  
• she gave him a once-over
  
• he sized her up
  
• her eyes bored into him
  
• she took in the sight of…
  
• he glared
  
• she peered
  
• he gazed
  
• she glanced
  
• he stared
  
• she scrutinized
  
• he studied
  
• she gaped
  
• he observed
  
• she surveyed
  
• he gawked
  
• he leered
  
• his pupils (were) dilated
  
• her pupils were huge
  
• his pupils flared
  

NOSE

• her nose crinkled
  
• his nose wrinkled
  
• she sneered
  
• his nostrils flared
  
• she stuck her nose in the air
  
• he sniffed
  
• she sniffled
  

MOUTH

• she smiled
  
• he smirked
  
• she grinned
  
• he simpered
  
• she beamed
  
• her mouth curved into a smile
  
• the corners of his mouth turned up
  
• the corner of her mouth quirked up
  
• a corner of his mouth lifted
  
• his mouth twitched
  
• he gave a half-smile
  
• she gave a lopsided grin
  
• his mouth twisted
  
• he plastered a smile on his face
  
• she forced a smile
  
• he faked a smile
  
• her smile faded
  
• his smile slipped
  
• he pursed his lips
  
• she pouted
  
• his mouth snapped shut
  
• her mouth set in a hard line
  
• he pressed his lips together
  
• she bit her lip
  
• he drew his lower lip between his teeth
  
• she nibbled on her bottom lip
  
• he chewed on his bottom lip
  
• his jaw set
  
• her jaw clenched
  
• his jaw tightened
  
• a muscle in her jaw twitched
  
• he ground his jaw
  
• he snarled/his lips drew back in a snarl
  
• her mouth fell open
  
• his jaw dropped
  
• her jaw went slack
  
• he gritted his teeth
  
• she gnashed her teeth
  
• her lower lip trembled
  
• his lower lip quivered
  

SKIN

• she paled
  
• he blanched
  
• she went white
  
• the color drained out of his face
  
• his face reddened
  
• her cheeks turned pink
  
• his face flushed
  
• she blushed
  
• he turned red
  
• she turned scarlet
  
• he turned crimson
  
• a flush crept up her face
  

WHOLE FACE, ETC.

• he screwed up his face
  
• she scrunched up her face
  
• he grimaced
  
• she winced
  
• she gave him a dirty look
  
• he frowned
  
• she scowled
  
• he glowered
  
• her whole face lit up
  
• she brightened
  
• his face went blank
  
• her face contorted
  
• his face twisted
  
• her expression closed up
  
• his expression dulled
  
• her expression hardened
  
• she went poker-faced
  
• a vein popped out in his neck
  
• awe transformed his face
  
• fear crossed her face
  
• sadness clouded his features
  
• terror overtook his face
  
• recognition dawned on her face
  

SOURCE

T h i s h e l p s s o m u c h t h a n k y o u