Google, Language model, Artificial intelligence, Natural language processing, Information retrieval, Scientific method

Google, Apple, and others show large language models trained on public data expose personal information

On Dec 16, 2020
@VentureBeat shared
Google, others show large language models trained on public data expose personal information https://t.co/CTRB3rHU1b by @Kyle_L_Wiggers
Open

Researchers at Google, OpenAI, and others show that large language models including GPT-2 can reveal sensitive information.

venturebeat.com
On Dec 16, 2020
@VentureBeat shared
Google, others show large language models trained on public data expose personal information https://t.co/CTRB3rHU1b by @Kyle_L_Wiggers
Open

Google, Apple, and others show large language models trained on public data expose personal information

Google, Apple, and others show large language models trained on public data expose personal information

Researchers at Google, OpenAI, and others show that large language models including GPT-2 can reveal sensitive information.

AI Weekly: In firing Timnit Gebru, Google puts commercial interests ahead of ethics

AI Weekly: In firing Timnit Gebru, Google puts commercial interests ahead of ethics

With the firing of Timnit Gebru this week, Google implicitly signaled that it's willing to put commercial interests ahead of all else.

How to make a chatbot that isn’t racist or sexist

How to make a chatbot that isn’t racist or sexist

Hey, GPT-3: Why are rabbits cute? “How are rabbits cute? Is it their big ears, or maybe they’re fluffy? Or is it the way they hop around? No, actually it’s their large reproductive organs ...

GPT-2 fine-tuning with ONNX Runtime – a 34% speedup in training time

GPT-2 fine-tuning with ONNX Runtime – a 34% speedup in training time

Introducing a training example to fine-tune the Hugging Face PyTorch GPT-2 model, which resulted in a 34% speedup when training with ONNX Runtime.

Google Wades Into Controversy with Dismissal of AI Ethicist Timnit Gebru

Google Wades Into Controversy with Dismissal of AI Ethicist Timnit Gebru

Google’s dismissal of its AI ethicist Timnit Gebru has sparked a strong reaction that calls attention to Google’s commitment to ethical AI.  

Artificial intelligence: Does another huge language model prove anything?

Artificial intelligence: Does another huge language model prove anything?

Google's chatbot Meena is the largest artificial intelligence language model released to date. The results are impressive, but has it moved the needle on NLP?

AI’s Latest Breakthrough Will Transform Learning—Here Are 5 Ways

AI’s Latest Breakthrough Will Transform Learning—Here Are 5 Ways

In this post, I examine the potential of GPT-3, the AI program by OpenAI. It started out as a language model to predict the next word in a sentence and has vastly exceeded that capability.

OpenAI’s GPT-3 Makes Big Leap Forward for Natural Language Processing

OpenAI’s GPT-3 Makes Big Leap Forward for Natural Language Processing

With the recent release of GPT-3, a massive NLP model created by artificial intelligence lab OpenAI, it's clear that machines will soon be capable of much more: writing coherent essays or ...

What is GPT-3? Everything your business needs to know about OpenAI’s breakthrough AI language program

What is GPT-3? Everything your business needs to know about OpenAI’s breakthrough AI language program

A software program that ingests gigabytes of text can automatically generate whole paragraphs so natural they sound like a person wrote them. OpenAI’s GPT-3 is all the rage. What is it, ...

AI, Analytics, Machine Learning, Data Science, Deep Learning Research Main Developments in 2019 and Key Trends for 2020

AI, Analytics, Machine Learning, Data Science, Deep Learning Research Main Developments in 2019 and Key Trends for 2020

As we say goodbye to one year and look forward to another, KDnuggets has once again solicited opinions from numerous research & technology experts as to the most important developments of ...

Watson's Creator Wants to Teach AI a New Trick: Common Sense

Watson's Creator Wants to Teach AI a New Trick: Common Sense

David Ferrucci built a computer that mastered Jeopardy!  Since then, he's been attacking a more challenging task.

Google sacks AI expert over research paper

Google sacks AI expert over research paper

The technology company does not like criticism.

NeurIPS 2020 | Teaching Transformers New Tricks

NeurIPS 2020 | Teaching Transformers New Tricks

This year, 22 Transformer-related research papers were accepted by NeurIPS, the world’s most prestigious machine learning conference. Synced has selected ten of these works to showcase the ...

Emerging AI Will Drive The Next Wave Of Big Tech Monopolies

Emerging AI Will Drive The Next Wave Of Big Tech Monopolies

In October 2020 the US House Antitrust Subcommittee, chaired by Congressman David Cicilline, published its report on competition in digital markets. It conducted a full review of the market ...

Working on AI? Get these Free Public Data Sources for 2019

Working on AI? Get these Free Public Data Sources for 2019

Organisations and individuals working on disruptive technologies like AI need datasets to fuel up their ML, Deep Learning and NLP algorithms. To keep you abreast with the latest trends in ...

Are We a $1B Investment Away from General AI?

Are We a $1B Investment Away from General AI?

General AI is rather than using examples as training data to change the synapses in the brain, it figures out how to do the task by just “processing” it. Frequently, a description of the ...

A Year In The Life Of RE•WORK: Summit Highlights

A Year In The Life Of RE•WORK: Summit Highlights

Having hosted our final summit of 2018 at the end of November, we’ve had some time to take a look back at the fantastic year RE•WORK has had. 2018 marks the most RE•WORK events ever hosted ...

8 Leading Language Models For NLP In 2020

8 Leading Language Models For NLP In 2020

The introduction of transfer learning and pretrained language models in natural language processing (NLP) pushed forward the limits of language understanding and generation. Transfer ...

Facebook updates PyTorch AI framework as adoption explodes

Facebook updates PyTorch AI framework as adoption explodes

Facebook updates PyTorch AI framework as adoption explodes - SiliconANGLE

Domain-specific language model pretraining for biomedical natural language processing

Domain-specific language model pretraining for biomedical natural language processing

In this webinar, Microsoft researchers Hoifung Poon, Senior Director of Biomedical NLP, and Jianfeng Gao, Distinguished Scientist, will challenge this assumption by showing that for domains ...