The Curious Engineer

All blogs / AI / ML

Yi Tay

yitay.net/blog

AI / MLEssays / personal

’22’23’24’25’26
Posts
8 from 16 Nov 2022 to 31 Dec 2025
Posting
now and then (1 in the last year)
Kind
personal blog
Feed
https://www.yitay.net/blog?format=rss

2025 1

  1. 2025 introspections: my year back at Google

2024 3

  1. Returning to Google DeepMind
  2. What happened to BERT & T5? On Transformer Encoders, PrefixLM and Denoising Objectives
  3. Training great LLMs entirely from ground up in the wilderness as a startup

2023 3

  1. Leaving Google Brain
  2. A New Open Source Flan 20B with UL2
  3. 2022 in Review: Top language AI research papers + interesting papers to read

2022 1

  1. On Emergence, Scaling and Inductive Bias