Seonglae ChoClever and beautiful idea than Back Propagation way of get gradient. Geoffrey Hinton expected this method to be how the brain updates itself, but it is said that this turned out not to be the case.
확률적 그래픽 모델로, 각 노드가 이진 값을 가지며, 에너지를 최소화하는 방식으로 학습
The learning algorithm for Boltzmann machines is beautifully elegant, it’s maybe hopeless in practice but it’s the thing I enjoyed most developing even if it’s wrong - Geoffrey Hinton
Boltzmann machine
A Boltzmann machine, named after Ludwig Boltzmann is a stochastic spin-glass model with an external field, i.e., a Sherrington–Kirkpatrick model, that is a stochastic Ising model. It is a statistical physics technique applied in the context of cognitive science. It is also classified as a Markov random field.
https://en.wikipedia.org/wiki/Boltzmann_machine
Geoffrey Hinton | On working with Ilya, choosing problems, and the power of intuition
This conversation between Geoffrey Hinton and Joel Hellermark was recorded in April 2024 at the Royal Institute of Great Britain in London. An edited version was premiered at Sana AI Summit on May 15 2024 in Stockholm, Sweden.
Geoffrey Hinton has been called “the godfather of AI” and is considered one of the most prominent thought leaders on the emergence of artificial intelligence. He has served as a faculty member at Carnegie Mellon and a fellow of the Canadian Institute for Advanced Research. He is now Emeritus Professor at the University of Toronto. In 2023, Geoffrey left his position at Google so that he could speak freely about AI’s impact on humankind.
Joel Hellermark is the founder and CEO of Sana. An enterprising child, Joel taught himself to code in C at age 13 and founded his first company, a video recommendation technology, at 16. In 2021, Joel topped the Forbes 30 Under 30. This year, Sana was recognized on the Forbes AI 50 as one of the startups developing the most promising business use cases of artificial intelligence.
Timestamps
Early inspirations (00:00:00)
Meeting Ilya Sutskever (00:05:05)
Ilya’s intuition (00:06:12)
Understanding of LLMs (00:09:00)
Scaling neural networks (00:15:15)
What is language? (00:18:30)
The GPU revolution (00:21:35)
Human Brain Insights (00:25:05)
Feelings & analogies (00:29:05
Problem selection (00:32:58)
Gradient processing (00:35:21)
Ethical implications (00:36:52)
Selecting talent (00:40:15)
Developing intuition (00:41:49)
The road to AGI (00:43:50)
Proudest moment (00:45:00)
Follow Sana
X - https://x.com/sanalabs
LinkedIn - https://www.linkedin.com/company/sana-labs
Instagram - https://www.instagram.com/sanalabs/
Try Sana AI for free - https://sana.ai
https://www.youtube.com/watch?v=n4IQOBka8bc&t=36m30s
