title

RoBERTa: An optimized method for pretraining self-supervised NLP systems

charset

utf-8

referrer

default

description

Facebook AI’s RoBERTa is a new training recipe that improves on BERT, Google’s self-supervised method for pretraining natural language processing...

viewport

width=device-width, initial-scale=1

og:image

https://web.archive.org/web/20230405195313im_/https://scontent-sjc3-1.xx.fbcdn.net/v/t39.2365-6/55283513_2136407213108244_2180786725628936192_n.jpg?_nc_cat=108&ccb=1-7&_nc_sid=ad8a9d&_nc_ohc=n-r-RfsRbIcAX8_ju_W&_nc_ht=scontent-sjc3-1.xx&oh=00_AfCRPmr5KDSBLYPjFkAR7_67bY5oDyQZaJ_20LzLQQtEHg&oe=64336AF2

twitter:card

summary

canonical

https://web.archive.org/web/20230405195313/https://ai.facebook.com/blog/roberta-an-optimized-method-for-pretraining-self-supervised-nlp-systems/

preload

https://web.archive.org/web/20230405195313/https://static.xx.fbcdn.net/rsrc.php/v3/yE/l/0,cross/nQ6enzPVKM2.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230405195313/https://static.xx.fbcdn.net/rsrc.php/v3/yV/l/0,cross/ij_tB9yEngm.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230405195313/https://static.xx.fbcdn.net/rsrc.php/v3/yB/l/0,cross/3V3ob5Lq6hU.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230405195313/https://static.xx.fbcdn.net/rsrc.php/v3/yV/l/0,cross/KxGJ10xTR_J.css?_nc_x=Ij3Wp8lg5Kz