NLP

[BERT 논문 리뷰] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

코딩무민 2022. 3. 25. 14:33
반응형

1. Introduction

  • 2018년 10월 논문 공개
  • 당시, NLP 11개 task에 SOTA 달성
  • SQuAD v1.1에서 인간보다 더 높은 정확도를 보여 주목을 받음
  • 논문 제목 
    •  BERT: Pre-trainig of Deep Bidirectional Transformers for Language Understanding

논문 링크 

 

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations from unla

arxiv.org

설명 링크

https://coding-moomin.notion.site/BERT-f351597381d84e369bb429340593504b

 

BERT

content

coding-moomin.notion.site

 

반응형

'NLP' 카테고리의 다른 글

[SpanBERT 논문 리뷰] SpanBERT : Improving Pretraining by Representing and Predicting Spans  (0) 2022.03.25
[RoBERTa 논문 리뷰] RoBERTa: A Robustly Optimized BERT Pretraining Approach  (0) 2022.03.25
[ALBERT 논문 리뷰] ALBERT: A Lite BERT for Self-supervised Learning of Language Representations  (0) 2022.03.25
[XLNet 논문 리뷰] XLNet: Generalized Autoregressive Pretraining for Language Understanding  (0) 2022.03.25
텍스트 전처리(Text preprocessing) & 어휘분석 (Lexical Analysis)  (0) 2022.03.24

'NLP'의 다른글

  • 현재글[BERT 논문 리뷰] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

관련글

댓글

티스토리툴바