【Data Science Project】 Discover How Scientific Data is Used for the Public Good with Natural Language Processing

n-gram Vector, Sequence Vector with RNN and CNN, and spaCy NER

Canva

INTRODUCTION

Natural Language Processing (NLP) is one of the branches of AI that gives the machines the ability to read, understand, and deliver meaning. NLP system needs to understand text, sign, and semantic properly. There are many methods that help the NLP system to understand text and symbols (Meparlad, 2020):

• Text classification: the process of categorizing the text into a group of words and assigning a set of predefined tags or categories based on its context.
• Vector semantic: defines semantic and interprets words meaning to explain features such as similar words and opposite words. The main idea behind vector semantic is two words are alike if they have used in a similar context. Vector semantic is useful in sentiment analysis.
• Word embedding: translates spares vectors into a…