Llion Jones, who was one of the co-authors of Google’s Transformer paper called “Attention Is All You Need,” has now left Google, Bloomberg reported.
Jones’ departure means all eight authors of the pioneering paper have left Google.
Published in 2017, the paper has proved to be groundbreaking and has had a significant impact on various fields of natural language processing (NLP) and machine learning.
The paper introduced a novel neural network architecture based solely on the idea of attention mechanisms, which enables the model to learn dependencies between input and output words without relying on sequence aligning and processing as the existing models did.
ChatGPT, the popular chatbot developed by OpenAI too, is based on the Transformer architecture.
Interestingly, all the co-authors have left Google in the subsequent years to start their own ventures. Jones, too, has hinted that will be starting his own company.
(Source: Twitter)
The post Last Co-Author of Transformer Paper Departs Google appeared first on Analytics India Magazine.
