NLP

Sentiment Analysis

Introduction Definition Sentiment analysis / opinion mining Determine opinion, sentiment and subjectivity in text What is the authors opinion about something? What are the pros and cons? Important task in natural language processing Application Automatically maintain review and opinion-aggregation websites Web search target towards reviews generate results with variety of opinions Improve customer relationship management Automatically analyze customer feedback Predict public attitudes towards brand/politics Ad placement Advertise products near positive text Summarization Question-answering Challenges Deep undetstanding Co-reference resolution Negation handling Different hints in the text Tasks of SA Polarity classification binary classifier if text, sentence, document is positive or negative Agreement detection Do two text agree on their opinion?

2020-09-15

Named-Entity Recognition

What is NER? Named entity anything that can be referred to with a proper name: a person, a location, an organization. commonly extended to include things that aren’t entities per se, including dates, times, and other kinds of temporal expressions, and even numerical expressions like prices.

2020-09-15

Information Extraction

2020-09-15

Word Sense Disambiguation

Introduction Definition Word Sense Disambiguation Determine which sense/meaning of a word is used in a particular context Classification problem Sense inventory considered senses of the words Word Sense Discrimination Divide usages of a word into different meanings Unsupervised Algorithms Task Determine which sense of a word is activated in a context

2020-09-14

Introduction

What is NLP? Wikipedia: Natural language processing (NLP) is a field of computer science, artificial intelligence, and linguistics concerned with the interactions between computers and human (natural) languages. As such, NLP is related to the area of human–computer interaction.

2020-09-13

Backpropagation Through Time (BPTT)

Recurrent neural networks (RNNs) have attracted great attention on sequential tasks. However, compared to general feedforward neural networks, it is a little bit harder to train RNNs since RNNs have feedback loops.

2020-08-13

Lecture Notes

2020-08-03

Resource

RNN Tutorials Illustrated Guide to Recurrent Neural Networks 🔥👍 Video Tutorial: Implementation min-char-rnn Application of RNN: The Unreasonable Effectiveness of Recurrent Neural Networks LSTM Tutorials Understanding LSTM Networks 🔥👍 Illustrated Guide to LSTM’s and GRU’s: A step by step explanation 🔥👍 Video Tutorial: 如何从RNN起步,一步一步通俗理解LSTM 通俗有趣地解释RNN和LSTM 🔥👍 Implementation

2020-08-03

LSTM Summary

Problem of Vanilla RNN Short-term memory If a sequence is long enough, they’ll have a hard time carrying information from earlier time steps to later ones. So if you are trying to process a paragraph of text to do predictions, RNN’s may leave out important information from the beginning.

2020-08-03

RNN Summary

Intuition Humans don’t start their thinking from scratch every second. As you read this article, you understand each word based on your understanding of previous words. You don’t throw everything away and start thinking from scratch again.

2020-08-03