Sweden's National Library begins a new chapter

The library is training state-of-the-art AI models on a half-millennium of Swedish text to support humanities research in history, linguistics, media studies and more.

  • Wednesday, 25th January 2023 Posted 3 years ago in by Phil Alsop

Thanks to a centuries-old law that requires a copy of everything published in Swedish to be submitted to the library — also known as Kungliga biblioteket, or KB — its collections span from the obvious to the obscure: books, newspapers, radio and TV broadcasts, internet content, Ph.D. dissertations, postcards, menus and video games. It’s a wildly diverse collection of nearly 26 petabytes of data, ideal for training state-of-the-art AI.

 

“We can build state-of-the-art AI models for the Swedish language since we have the best data,” said Love Börjeson, director of KBLab, the library’s data lab.

Using NVIDIA DGX systems, the group has developed more than two dozen open-source transformer models, available on Hugging Face. The models, downloaded by up to 200,000 developers per month, enable research at the library and other academic institutions.

“Before our lab was created, researchers couldn’t access a dataset at the library — they’d have to look at a single object at a time,” Börjeson said. “There was a need for the library to create datasets that enabled researchers to conduct quantity-oriented research.”

With this, researchers will soon be able to create hyper-specialized datasets — for example, pulling up every Swedish postcard that depicts a church, every text written in a particular style or every mention of a historical figure across books, newspaper articles and TV broadcasts.


Atlassian Corporation has introduced new AI features in Confluence that enable content to be...
Cloudera has announced updates to its hybrid data and AI platform aimed at supporting enterprise...
Elida Beauty partners with SnapLogic to establish a modern IT environment post-spin-off, aiming to...
NVIDIA and Marvell Technology have announced a partnership to connect Marvell to NVIDIA’s AI...
CoreView has launched Corey, an AI agent designed to support IT teams in managing Microsoft 365...
Sytronix has entered a partnership to provide high-performance computing infrastructure for AI...
Skillsoft reports growth in AI-native learning adoption as organisations increasingly use...
UST has acquired Workday partner Intecrowd LLC to expand its enterprise application offerings and...