Aya Evaluation Suite
Cohere's multilingual eval bundle covering 101 languages - open-ended generations, discriminative tasks, and human-rated preference data.
- Publisher
- Cohere
- Capabilities
- MultilingualInstruction FollowingTranslation
- Domain
- multilingual
- Format
- HF Dataset
- Size
- 26750 tasks
- License
- Apache-2.0
- Published
- Feb 2024
- Notable for
- Benchmark for evaluating multilingual, instruction following and translation in the multilingual domain.
Cite
Notes
Only stored in your browser.
Sample tasks
5from the eval dataset
أجب على السؤال التالي "ما إسم الصحابي الذي استضاف الرسول صلى الله عليه وسلم بعد الهجرة إلى يثرب ؟".
الإجابة الصحيحة هي "سيدنا أبو أيوب الأنصاري".
Show 4 more examples
قم بإنشاء قصيدة عتاب من بحر الطويل.
وَلَمّا بَدا لي أَنَّ ما كُنتُ أَرتَجي مِنَ الأَمرِ وَلّى بَعدَما قُلتُ أَقبَلا تَلَوَّمتُ بَينَ اللَومِ وَالعُذرِ ساعَةً كَذي الوِردِ يُرمى قَبلَ أَن يَتَبَدَّلا فَلَمّا رَأَيتُ الحِلمَ قَد طارَ طَيرَةً وَلَم أَرَ إِلّا أَن أَلومَ وَأَعذُلا رَجَعتُ أُوَلّي عاثِرَ الجَدِّ لَومَها فَلا قامَ بَينَ العاثِرينَ وَلا عَلا أُلَعِّنُهُ مُستَثنِياً مِن عِنانِهِ كَرَدِّكَ في الغِمدِ الكَهامَ المُفَلَّلا وَأَعفَيتُ مِن لَومي اِمرَأً ما وَجَدتُهُ مُليماً وَلا باباً عَنِ الجودِ مُقفَلا لِجَدّي إِذاً بِاللَومِ أَولى مِنَ الحَيا وَمَن ذا يَلومُ العارِضَ المُتَهَلِّلا
Awọn gomina Guusu tun ṣepade: Ijọba ipinlẹ ni yoo maa gbowo-ori VAT
Awọn gomina mẹtadinlogun ti ipinlẹ Guusu orileede wa ti kede pe gbọin-gbọin lawọn wa lẹyin ki ijọba ipinlẹ maa gba owo-ori ọja ti wọn n pe ni VAT, wọn ni kawọn ipinlẹ gba eto naa kuro lọwọ ijọba apapọ ati ileeṣẹ agbowoori wọn, FIRS. Ọrọ yii jade ninu atẹjade ti Alaga awọn gomina ipinlẹ Guusu, to tun jẹ Gomina ipinlẹ Ondo, Arakunrin Oluwarotimi Akeredolu, ka jade lẹyin ipade wọn to waye l’Ọjọbọ, Tọsidee, ọsẹ yii, nileejọba ipinlẹ Enugu, niluu Enugu. Awọn gomina naa lawọn ti panu-pọ pe abẹ aṣẹ ijọba ipinlẹ ni gbigba owo-ori VAT wa, wọn ni bo ṣe wa ninu iwe ofin ilẹ wa tọdun 1999 ti a n lo niyẹn, tori naa, awọn fara mọ bawọn ipinlẹ ṣe bẹrẹ si i ṣofin lati maa gba owo-ori naa labẹle wọn. Yatọ si ọrọ owo-ori VAT, awọn gomina naa tun sọ pe ipinnu tawọn ti ṣe tẹlẹ pe ki ipo aarẹ ninu eto idibo to n bọ wa si iha Guusu ilẹ wa ko yipada, wọn ni Guusu ni aarẹ ti gbọdọ yọju. Bakan naa lawọn gomina ọhun gboṣuba fun bawọn ipinlẹ Guusu ṣe fọwọsowọpọ lori ofin ta ko fifẹranjẹko ni gbangba kaakiri awọn ipinlẹ wọn, wọn ni inu awọn dun si iṣẹ tawọn aṣofin ipinlẹ kọọkan ṣe, wọn si parọwa sawọn ipinlẹ to ku lati ṣiṣẹ lori ofin naa, tori ki alaafia ati aabo le rẹsẹ walẹ ni Guusu orileede wa.
Üniversite internetten kayıt yaptıktan sonra okula gitmeye gerek var mı?
Elektronik kayıt işlemini tamamlayan adayların ayrıca üniversitelerine giderek kayıt yaptırmalarına gerek yoktur. dosyalarını görüntüleme özelliği olan başka bir uygulama kurulu olmalıdır. Bu işlem için herhangi bir ek ücret, vergi vb. alınmamaktadır. e-Devlet Kapısı'nın adresi www.turkiye.gov.tr'dir.
What is the name of the South Korean defense missile system?
South Korea has developed several missile defense systems, with the primary systems being the KM-SAM and the L-SAM. The KM-SAM, also known as Cheongung or Cheolmae-2, is a medium-range surface-to-air missile system that was completed and delivered to the Republic of Korea Air Force. This system, which was first deployed in 2015, can cover a range of up to 40 kilometers and reach altitudes between 15 and 20 kilometer. Additionally, South Korea is developing the L-SAM, a long-range surface-to-air missile system designed to counter ballistic missiles in their terminal phase as part of the Korean Air and Missile Defense (KAMD) project
Related tools
1Implementations, trainers, datasets and scaffolds linked to this eval.
Papers
2Contributors
1FAQ
- What is Aya Evaluation Suite?
- Cohere's multilingual eval bundle covering 101 languages - open-ended generations, discriminative tasks, and human-rated preference data.
- What capabilities does Aya Evaluation Suite test?
- Aya Evaluation Suite evaluates multilingual, instruction following, translation.
- How can a model improve its Aya Evaluation Suite score?
- Tools linked to Aya Evaluation Suite on Sophon include Aya Dataset - RL environments, datasets, and scaffolds that target this eval.
- What license is Aya Evaluation Suite under?
- Aya Evaluation Suite is available under Apache-2.0.