AI Essentials

General News

AI Essentials publishes only the most insightful links selected by the most trusted experts in the AI & Machine Learning industry.


Word, Language model, Information retrieval, Natural language processing, Text mining, Sentence

@weballergy shared
On Apr 10, 2021
RT @seb_ruder: 10 Things You Need to Know About BERT and the Transformer Architecture That Are Reshaping the AI Landscape This super comprehensive post covers most things that are important in current NLP including BERT, transfer and avocado chairs 🥑 by @cathalhoran https://t.co/Hn458pkrk8 https://t.co/srs4bIFrFw
Open

10 Things You Need to Know About BERT and the Transformer Architecture That Are Reshaping the AI Landscape

Few areas of AI are more exciting than NLP right now. In recent years language models (LM), which can perform human-like linguistic tasks, have evolved to perform better than anyone could have expected.  ...

@weballergy shared
On Apr 10, 2021
RT @seb_ruder: 10 Things You Need to Know About BERT and the Transformer Architecture That Are Reshaping the AI Landscape This super comprehensive post covers most things that are important in current NLP including BERT, transfer and avocado chairs 🥑 by @cathalhoran https://t.co/Hn458pkrk8 https://t.co/srs4bIFrFw
Open
10 Things You Need to Know About BERT and the Transformer Architecture That Are Reshaping the AI Landscape

10 Things You Need to Know About BERT and the Transformer Architecture That Are Reshaping the AI Landscape

Few areas of AI are more exciting than NLP right now. In recent years language models (LM), which can perform human-like linguistic tasks, have evolved to perform better than anyone could ...

The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)

The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)

The year 2018 has been an inflection point for machine learning models handling text (or more accurately, Natural Language Processing or NLP for short). Our conceptual understanding of how ...

Unsupervised Cross-lingual Representation Learning

Unsupervised Cross-lingual Representation Learning

This post expands on the ACL 2019 tutorial on Unsupervised Cross-lingual Representation Learning. It highlights key insights and takeaways and provides updates based on recent work, ...

Dissecting The Transformer

Dissecting The Transformer

We saw how attention works and how it improved neural machine translation systems (see the previous blogpost), we are going to unveil the secrets behind the power of the most famous NLP ...

A Quick Introduction to NLP

A Quick Introduction to NLP

Natural Language Processing or NLP is an area of Data Science, Machine Learning and Linguistics which focuses on processing the language…

BERT: State of the Art NLP Model, Explained

BERT: State of the Art NLP Model, Explained

It has caused a stir in the Machine Learning community by presenting state-of-the-art results in a wide variety of NLP tasks, including Question Answering (SQuAD v1.1), Natural Language ...

Controlling Text Generation with Plug and Play Language Models

Controlling Text Generation with Plug and Play Language Models

Plug and Play Language Model, introduced by Uber AI Labs, gives NLP practitioners the flexibility to plug in one or more simple attribute models into a large, unconditional language model.

A Billion Words and The Limits of Language Modeling

A Billion Words and The Limits of Language Modeling

In this post, I will talk about Language Models, when (and when not) to use LSTMs for language modeling, and some state of the art results. While I mostly discuss the "Exploring Limits" ...

NeurIPS 2020 | Teaching Transformers New Tricks

NeurIPS 2020 | Teaching Transformers New Tricks

This year, 22 Transformer-related research papers were accepted by NeurIPS, the world’s most prestigious machine learning conference. Synced has selected ten of these works to showcase the ...

Introduction to NLP

Introduction to NLP

The ultimate goal of NLP is to help computers understand language as well as we do.

A Step-by-Step Must-Read NLP Guide to Learn ELMo for Extracting Features from Text

A Step-by-Step Must-Read NLP Guide to Learn ELMo for Extracting Features from Text

ELMo is one of the best state-of-the-art frameworks to extract features from a given text dataset. Learn how to use it in Python in this article.

A Multimodal Analytics Platform for Journalists Analyzing Large-Scale, Heterogeneous Multilingual, and Multimedia Content

A Multimodal Analytics Platform for Journalists Analyzing Large-Scale, Heterogeneous Multilingual, and Multimedia Content

Analysts and journalists face the problem of having to deal with very large, heterogeneous and multilingual data volumes that need to be analyzed, understood and aggregated. Huge savings ...