RAG

PaLM-E-562B, with 562B parameters, is the largest vision-language model reported and achieves state-of-the-art performance on OK-VQA without task-specific finetuning.

Retro enhances auto-regressive language models by conditioning on document chunks retrieved from a large corpus.