Skip to content

CS224n: Natural Language Processing with Deep Learning: Assignments, Notes Winter, 2017

Notifications You must be signed in to change notification settings

SerayBeser/CS224n-Natural-Language-Processing-with-Deep-Learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Assignment 1:

In this assignment we will familiarize you with basic concepts of neural networks, word vectors, and their application to sentiment analysis.

##Setup

Note: Please be sure you have Python 2.7.x installed on your system. The following instructions should work on Mac or Linux.

Get the code: Download the starter code here and the complementary written problems here.

[Optional] virtual environment: Once you have unzipped the starter code, you might want to create a virtual environment for the project. If you choose not to use a virtual environment, it is up to you to make sure that all dependencies for the code are installed on your machine. To set up a virtual environment, run the following:

cd assignment1 sudo pip install virtualenv # This may already be installed virtualenv .env # Create a virtual environment source .env/bin/activate # Activate the virtual environment pip install -r requirements.txt # Install dependencies

Work on the assignment for a while ...

deactivate # Exit the virtual environment

Install requirements (without a virtual environment): To install the required packages locally without setting up a virtual environment, run the following:

cd assignment1 pip install -r requirements.txt # Install dependencies

Download data: Once you have the starter code, you will need to download the Stanford Sentiment Treebank dataset and pretrained GloVe vectors. Run the following from the assignment1 directory:

sh get_datasets.sh

Tasks

There will be four parts to this assignment.

Q1: Softmax

Q2: Neural Network Basics

Q3: word2vec

Q4: Sentiment Analysis

Assignment 2: TensorFlow, Neural Dependency Parsing, and RNN Language Modeling

In this assignment you will learn the fundamentals of TensorFlow, use TensorFlow to implemented a feed-forward neural network for transition-based dependency parsing, and delve into backpropagation through time by computing the gradients for a recurrent neural network language model.

##Setup

Note: Please be sure you have Python 2.7.x installed on your system. The following instructions should work on Mac or Linux.

Get the code: Download the starter code here and the assignment handout here.

Python package requirements: The core requirements for this assignment are

tensorflow numpy

If you have a recent linux (Ubuntu 14.04 and later) install or Mac OS X, the default TensorFlow installation directions will work well for you. If not, we recommed that you work on the corn clusters. TensorFlow is already installed for the system default python on corn.

Assignment Overview (Tasks)

There will be three parts to this assignment.

Q1: Tensorflow Softmax

Q2: Neural Transition-Based Dependency Parsing

Q3: Recurrent Neural Networks: Language Modeling

Assignment 3: Named Entity Recognition and Recurrent Neural Networks

In this assignment you will learn about named entity recognition and implement a baseline window-based model, as well as a recurrent neural network model. The assignment also covers gated recurrent units, applying them to simple 1D sequences and the named entity recognition.

##Setup

Note: Please be sure you have Python 2.7.x installed on your system. The following instructions should work on Mac or Linux.

Get the code: Download the starter code here and the assignment handout here.

Python package requirements: The core requirements for this assignment are

tensorflow numpy matplotlib

If you have a recent linux (Ubuntu 14.04 and later) install or Mac OS X, the default TensorFlow installation directions will work well for you. If not, we recommed that you work on the corn clusters. TensorFlow is already installed for the system default python on corn.

We will also be providing access to GPU computing facilities on Microsoft Azure. Details on how to access these facilities will be uploaded soon.

Assignment Overview (Tasks)

There will be three parts to this assignment.

Q1: A window into NER

Q2: Recurrent neural nets for NER

Q3: Grooving with GRUs

Assignment 4: Reading Comprehension

Check out the Assignment 4 SQuAD leaderboard: http://cs224n-leaderboard.southcentralus.cloudapp.azure.com/

You are becoming a researcher in NLP with Deep Learning with this programming assignment! You will implement a neural network architecture for Reading Comprehension using the recently published Stanford Question Answering Dataset (SQuAD).

##Setup

Note: Please be sure you have Python 2.7.x installed on your system. The following instructions should work on Mac or Linux.

Get the code: Download the starter code here and the assignment handout here.

Python package requirements: The core requirements for this assignment are

tensorflow nltk tqdm joblib

If you have a recent linux (Ubuntu 14.04 and later) install or Mac OS X, the default TensorFlow installation directions will work well for you. If not, we recommed that you work on the corn clusters. TensorFlow is already installed for the system default python on corn.

We will also be providing access to GPU computing facilities on Microsoft Azure. Details on how to access these facilities will be uploaded soon.

Assignment Overview

Everything you need to start doing the assignment is detailed in the assignment handout. We are not setting explicit tasks for this assignment. We only provide starter code for general APIs, data preprocessing, and evaluation.

About

CS224n: Natural Language Processing with Deep Learning: Assignments, Notes Winter, 2017

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages