NLP

[Numerical Reasoning] Have You Seen That Number? Investigating Extrapolation in Question Answering Models

코딩무민 2022. 5. 24. 16:28
반응형

1. 핵심 요약 

  • 기존 NR 모델
    • learned numerical reasoning capabilities를 interpolate
    • BUT training set에 unseen numbers에까지 좋은 성능 X
  • 이번 모델
    • key findings : 모델이 unseen numbers를 extrapolate X
    • 해결
      • model input : digit-by-digit numbers 추가
        • extrapolation 부족 완화
        • text에서 number를 다르게 취급해야 한다는 사실을 알아냄
      • : E-digit number form

2. 논문 링크

https://aclanthology.org/2021.emnlp-main.563/

 

Have You Seen That Number? Investigating Extrapolation in Question Answering Models

Jeonghwan Kim, Giwon Hong, Kyung-min Kim, Junmo Kang, Sung-Hyon Myaeng. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.

aclanthology.org

3. 논문 설명 링크 

https://coding-moomin.notion.site/Have-You-Seen-That-Number-Investigating-Extrapolation-in-Question-Answering-Models-794acc2211fa47fc81034456952a3046

 

Have You Seen That Number? Investigating Extrapolation in Question Answering Models

content

coding-moomin.notion.site

 

반응형