文件名称:
Transformer & Question Answering- Thang Luong.pdf
开发工具:
文件大小: 9mb
下载次数: 0
上传时间: 2019-07-06
详细说明：The Transformer network consists of multiple layers, each with several Attention Heads (and additional layers), used to learn different relationships between tokens. As in many NLP models, the input tokens are first embedded into vectors
This slide Thang Luong from google brain to talk about detail transfomer networkA ST KNG H
Why Transformer?
VitaL
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
A ST KNG H
Why Transformer?
Vital
Best nLP Model Ever? Google bert
Sets New Standards in 11 Language
asKs
1 Synced in SyncedReview[ Follow
GoogleS BERT
:: Google Al
Transformer
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
A ST KNG H
Why Transformer?
Vital
Best nLP Model Ever? Google bert
Sets New Standards in 11 Language
asKs
1 Synced in SyncedReview[ Follow
GoogleS BERT
Google Al
Transformer
ABOUT PROGRESS RESOURCES BLOG
Better Language Models
OpenAl's GPt2
and Their Implications
We've trained a large-scale unsupervised language model which
generates coherent paragraphs of text, achieves state-of-the
art performance on many language modeling benchmarks, and
performs rudimentary reading comprehension, machine
translation, question answering, and summarization-all without
task-specific training
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
Outline
Vital
Transformer
Self-attention
o Architecture
Question Answering (BiDAF, QANet
Beyond
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
Let's translate"Apple" into your language
Vital
Apple is loved by many people; it is good for your health
Apple is loved by many people; it is good in its design
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
Needs to capture long-range dependency
Vital
Apple is loved by many people; it is good for your health
Apple is loved by many people; it is good in its design
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
RNNS/LSTMS
Vital
Sequential: slow difficult to capture
long-range dependency
1.0
0.6
0.9
0.5
0.7
0.4
0.5
0.5
0.6
3
0.6
0.9
0.2
0.3
0.1
0.1
0.1
0.3
0.8
0
Apple
for your health
A
pple is not aware of health
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
Self-attention
Vital
All words connect to one another
1.0
0.6
0.9
0.5
0.7
0.4
0.5
0.5
0.6
3
0.6
0.9
0.3
0.4
0.5
0.2
0.3
0.1
0.1
0.1
0.3
0.8
0
Apple
for your health
Apple is aware of health
VietAI Foundation Class 4-Thang Luong-QA, Transformer, BERT, XLNet
(系统自动生成,下载前可以参看下载内容)
下载文件列表
相关说明
- 本站资源为会员上传分享交流与学习,如有侵犯您的权益,请联系我们删除.
- 本站是交换下载平台，提供交流渠道，下载内容来自于网络，除下载问题外，其它问题请自行百度。
- 本站已设置防盗链，请勿用迅雷、QQ旋风等多线程下载软件下载资源，下载后用WinRAR最新版进行解压.
- 如果您发现内容无法下载，请稍后再次尝试；或者到消费记录里找到下载记录反馈给我们.
- 下载后发现下载的内容跟说明不相乎，请到消费记录里找到下载记录反馈给我们，经确认后退回积分.
- 如下载前有疑问，可以通过点击"提供者"的名字，查看对方的联系方式，联系对方咨询.
