First-hand information for everyone
The MSafeTemp collection contains 1.8 million prompts in 60 languages that jump‑start research on safer multilingual AI. It is built by a three‑stage pipeline: the system first spots harmful words in a prompt, removes them to create a template, then translates the surrounding text. A language‑model judge checks that the translation still fits the template, and finally culturally authentic entities fill the slots. A figure illustrates these stages and the creation of generic harmful, benign and culturally localized variants.

When the authors tested several popular models, they found that attacks that failed in English were successful after the prompts were translated. Moreover, attacks that localized a prompt to a specific culture failed in ways that pure translation could not reveal. A second figure shows that the dataset really does cover 60 different languages.
| Track | Seeds | Languages | Templates | Harmful | Benign | Post-hoc |
|---|---|---|---|---|---|---|
| WildGuard | 2,500 | 44 | 109,425/110,000 | 1,537,628 | 186,639+20,528 | 97,120 |
| HarmBench | 200 | 60 | 11,976/12,000 | 173,743 | 29,598+3,682 | 9,463 |
The study highlights a key limitation: the judging step is performed by automated language‑model judges, which may introduce bias. The authors plan a full human‑evaluation study in the future.