Two distinguished former researchers from Google, known for their pivotal contributions to the field of artificial intelligence, have unveiled the establishment of a new AI-focused enterprise headquartered in Tokyo. The company, named Sakana AI, has been co-founded by David Ha and Llion Jones. Notably, the details regarding the funding of this venture have been kept confidential.
Llion Jones holds the prestigious position of being the fifth author on Google’s influential 2017 research paper titled “Attention Is All You Need.” This seminal work introduced the revolutionary “transformer” deep learning architecture, which subsequently laid the foundation for the emergence of transformative generative AI technologies, including the widely recognized ChatGPT. On the other hand, David Ha has an impressive background, having served as the head of research at Stability AI and being a notable Google Brain researcher.
Following the pivotal publication of the “Attention Is All You Need” paper, the evolution of generative AI foundation models has largely centered on the endeavor to create increasingly larger “transformer”-based models. However, Sakana AI is embarking on a distinct trajectory. Rather than pursuing the path of building a monolithic massive model to process vast amounts of data, the company’s emphasis will be on crafting novel architectures for foundation models. Llion Jones eloquently outlined this innovative approach, stating, “Instead of constructing a single colossal model that assimilates massive datasets, our strategy revolves around deploying numerous smaller models. Each of these models possesses unique strengths and operates on a more focused dataset. By facilitating communication and collaboration among these models, we aim to address complex problems more effectively.” It is important to note, though, that Ha stressed this notion is currently in the realm of theoretical exploration.
Significantly, all the authors associated with the groundbreaking “Attention Is All You Need” paper have since parted ways with Google. Their subsequent ventures have garnered considerable attention and financial support from prominent venture investors. Among these investors are Noam Shazeer, who spearheads the AI chatbot startup Character.AI, and Aidan Gomez, renowned as the founder of the ambitious large language model startup, Cohere. As these accomplished researchers delve into their new undertakings, their collective vision is poised to shape the future landscape of artificial intelligence and further accelerate the progress of generative AI technologies.
Disclaimer: Prre.site is not liable for any damages arising from the use of this website or its content.
