Text Mining & Translation
Faculty
Sergey Nikolenko
Chief Research Officer, Neuromation Head of AI Lab, PDMI RAS
Course length
Duration
Total hours
Credits
Language
Course type
Fee for single course
Fee for degree students
Skills you’ll learn
Overview
Natural language processing is one of the most challenging parts of artificial intelligence. It encompasses many different problems, from well-defined classification problems to rather vague tasks that involve text generation. In the course, we will go over some of the most common NLP problems, including text classification, topic modeling, and sentiment analysis. But we will pay the most attention to modern deep learning approaches that use word embeddings and/or character-based models. We will consider encoder-decoder architectures and architectures with attention, specifically in application to machine translation and similar problems.
Learning highlights
- Understand the main problems of natural language processing
- Be able to construct topic models by using standard libraries
- Understand and be able to use different forms of word embeddings
- Learn the structure and composition of encoder-decoder architectures and be able to construct such models in practice
Course outline
4 classes
NLP problems and naive Bayes
Natural language processing: defining the problems. From syntactic to semantic problems. The text classification problem and the naive Bayesian classifier. Tf-idf weights.
Extending naive Bayes
Can we remove the naive Bayes assumptions? From classification to clustering. From clustering to topic modeling: probabilistic latent semantic analysis.
Topic modeling
Regularised pLSA: additive regularisation of topic models (ARTM). Bayesian pLSA: latent Dirichlet allocation (LDA). LDA extensions: additional dependencies and/or additional information
Practical session
Construct different topic models.
Course materials
Books
Prerequisites
This course is one of three in a wholistic series.
Students that have already taken MSL-111 and those with prior experience with HTML, CSS, and Javascript building simple web pages will be good candidates for this module.
Sergey Nikolenko is a computer scientist with vast experience in machine learning and data analysis, algorithms design and analysis, theoretical computer science, and algebra. He graduated from St. Petersburg State University in 2005, majoring in algebra (Chevalley groups), and earned his Ph.D at the Steklov Mathematical Institute at St. Petersburg in 2009 in theoretical computer science (circuit complexity and theoretical cryptography). Since then, Sergey has been interested in machine learning and probabilistic modeling, producing theoretical results and working on practical projects for the industry.
Sergey Nikolenko is currently serving as the Chief Research Officer at Neuromation, leading the Artificial Intelligence Lab at the Steklov Mathematical Institute at St. Petersburg, and teaching at the St. Petersburg State University and Higher School of Economics. Dr. Nikolenko has published more than 170 research papers on machine learning (ICML, CVPR, ACL, SIGIR, WSDM...), analysis of algorithms (SIGCOMM, INFOCOM, ICNP…), and other fields, several books, including a bestselling “Deep Learning” book (in Russian), lecture courses in ML, DL, other fields of computer science (St. Petersburg State University, NRU Higher School of Economics...) and much more. He has extensive experience in managing research and industrial AI/ML projects.
See full profileApply for this course
Text Mining & Translation
by Sergey Nikolenko
Total hours
45 Hours
Dates
Jan 08 - Jan 26, 2018
Fee for single course
€1500
Fee for degree students
€750
How to secure your spot
Complete the form below to kickstart your application
Schedule your Harbour.Space interview
If successful, get ready to join us on campus
FAQ
Will I receive a certificate after completion?
Yes. Upon completion of the course, you will receive a certificate signed by the director of the program your course belonged to.
Do I need a visa?
This depends on your case. Please check with the Spanish or Thai consulate in your country of residence about visa requirements. We will do our part to provide you with the necessary documents, such as the Certificate of Enrollment.
Can I get a discount?
Yes. The easiest way to enroll in a course at a discounted price is to register for multiple courses. Registering for multiple courses will reduce the cost per individual course. Please ask the Admissions Office for more information about the other kinds of discounts we offer and what you can do to receive one.