Deep learning has revolutionized natural text modeling since Google Research in 2018 introduced BERT.