EPFL, ETH Zurich and the Swiss National Supercomputing Centre (CSCS) released Apertus today, Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.
EPFL, ETH Zurich and the Swiss National Supercomputing Centre (CSCS) released Apertus today, Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.
Nice. This is the one that supposedly comes with open data sets, training data and everything, and it’s a true “open-source” model. Seems it’s avalable in 7B and 70B.
Yup, I see pretrain data on their GitHub, cool to see it released
https://github.com/swiss-ai/pretrain-data