Birds of a Feather: Natural Language Processing

What makes language such a difficult problem to solve

• Languages are constantly evolving�The English Language In 24 Accents

​

What makes language such a difficult problem to solve

• Languages are constantly evolving�The English Language In 24 Accents
• Figurative speech and sarcasm:�-Xavi really shouldn’t play the piano- he has Van Gogh’s ear for music.�-There are no sacred cows in this organization. We will audit everyone from top to bottom.�-Come on Parker, use your loaf! I know you can solve this problem!

​

What makes language such a difficult problem to solve

• Languages are constantly evolving�The English Language In 24 Accents
• Figurative speech and sarcasm:�-Xavi really shouldn’t play the piano- he has Van Gogh’s ear for music.�-There are no sacred cows in this organization. We will audit everyone from top to bottom.�-Come on Parker, use your loaf! I know you can solve this problem!
• Not good at deducing the meaning of words it hasn’t seen before

What makes language such a difficult problem to solve

• Synonymous words or phrases (also known as word sense disambiguation)

​

What makes language such a difficult problem to solve

• Synonymous words or phrases (also known as word sense disambiguation)
• Machine translation�French word: Entarter

​

What makes language such a difficult problem to solve

• Synonymous words or phrases (also known as word sense disambiguation)
• Machine translation�French word: Entarter�Means to throw a pie at someone’s face

What makes language such a difficult problem to solve

• Synonymous words or phrases (also known as word sense disambiguation)
• Machine translation�French word: Entarter�Means to throw a pie at someone’s face
• Computers just don’t perceive words in the same sense that we do

​

​

Classical NLP

One hot encoded vectors

Problems with one hot-encoded vectors

• Sparsity of representations
• No meaningful representation

Word Vector

Cool papers!

• How Fiction is Predictable- By Ted Underwood�https://slideslive.com/38929738/how-is-fiction-predictable
• Decay RNNs
• Words Aren’t Enough, Their Order Matters: [2005.01655] Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions
• Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data

​