AI2’s open-source OLMo model gets a more diversified dataset, two-stage curriculum

7 months ago 64

AI2 has released an update for its open source language model OLMo 1.7-7B with a new Dolma 1.7 dataset and two-stage training curriculum.