Yi Tay
Co-founder and Chief Scientist of Reka AI; former Google Brain senior research scientist behind PaLM, UL2, and the Long Range Arena.
- Role
- founder
- Currently at
- Independent
- twitter.com/YiTayML
- GitHub
- github.com/vanzytay
- Scholar
- scholar.google.com/citations
- Papers
- 12
Cite
Notes
Only stored in your browser.
Authored papers
12BIG-Bench Extra Hard
arXiv 2025
Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models
arXiv 2024
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
arXiv 2023
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining
arXiv 2023
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
ACL
Recitation-Augmented Language Models
arXiv 2022
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
arXiv 2021
Do Transformer Modifications Transfer Across Implementations and Applications?
EMNLP 2021 11
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
ext5-towards-extreme-multi-task-scaling-for
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters
arXiv 2021
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling
structformer-joint-unsupervised-induction-of
Long Range Arena: A Benchmark for Efficient Transformers
arXiv 2020
Affiliations
Previously
Frequent co-authors
10from 12 papers