OpenAI is accelerating its talent acquisition strategy in the run-up to its IPO, securing two marquee names in a single week. Noam Shazeer, a co-inventor of the Transformer architecture that underlies virtually all modern AI, joins from Google DeepMind. Dean Ball, a former AI policy official from the Trump administration, also joins, signaling OpenAI's intent to strengthen its policy and regulatory positioning alongside its technical bench.
Noam Shazeer, one of the most influential figures in modern AI and a co-author of the landmark 'Attention Is All You Need' paper, has announced he is joining OpenAI. The move represents a major talent acquisition for OpenAI. No further details about his role or terms were provided in the source announcement.
A student from India shared their first paper on r/LocalLLaMA, proposing Silia, a Transformer architecture for extremely small models. The idea is to merge attention-style dynamic mixing with SwiGLU-like nonlinear transformation, aiming to save parameters in models under roughly 10M parameters. The author frames the work as an early, small-scale exploration, limited by old hardware and restricted access to larger compute.