Scalable Visual Pretraining for Language Intelligence
By Yiming Zhang · Paper · cs.CV
The rapid progress of large foundation models has been driven predominantly by pretraining on large-scale text corpora. However, many forms of knowledge are conveyed through visual representations, where figures, typeset equations, and page layouts carry rich information that can