Boltzmann machine

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Jun 8 16:27
Editor
Edited
Edited
2024 Oct 28 12:58
Clever and beautiful idea than
Back Propagation
way of get gradient.
Geoffrey Hinton
expected this method to be how the brain updates itself, but it is said that this turned out not to be the case.
확률적 그래픽 모델로, 각 노드가 이진 값을 가지며, 에너지를 최소화하는 방식으로 학습
 
 
 
The learning algorithm for Boltzmann machines is beautifully elegant, it’s maybe hopeless in practice but it’s the thing I enjoyed most developing even if it’s wrong -
Geoffrey Hinton
Geoffrey Hinton | On working with Ilya, choosing problems, and the power of intuition
This conversation between Geoffrey Hinton and Joel Hellermark was recorded in April 2024 at the Royal Institute of Great Britain in London. An edited version was premiered at Sana AI Summit on May 15 2024 in Stockholm, Sweden. Geoffrey Hinton has been called “the godfather of AI” and is considered one of the most prominent thought leaders on the emergence of artificial intelligence. He has served as a faculty member at Carnegie Mellon and a fellow of the Canadian Institute for Advanced Research. He is now Emeritus Professor at the University of Toronto. In 2023, Geoffrey left his position at Google so that he could speak freely about AI’s impact on humankind. Joel Hellermark is the founder and CEO of Sana. An enterprising child, Joel taught himself to code in C at age 13 and founded his first company, a video recommendation technology, at 16. In 2021, Joel topped the Forbes 30 Under 30. This year, Sana was recognized on the Forbes AI 50 as one of the startups developing the most promising business use cases of artificial intelligence. Timestamps Early inspirations (00:00:00) Meeting Ilya Sutskever (00:05:05) Ilya’s intuition (00:06:12) Understanding of LLMs (00:09:00) Scaling neural networks (00:15:15) What is language? (00:18:30) The GPU revolution (00:21:35) Human Brain Insights (00:25:05) Feelings & analogies (00:29:05 Problem selection (00:32:58) Gradient processing (00:35:21) Ethical implications (00:36:52) Selecting talent (00:40:15) Developing intuition (00:41:49) The road to AGI (00:43:50) Proudest moment (00:45:00) Follow Sana X - https://x.com/sanalabs LinkedIn - https://www.linkedin.com/company/sana-labs Instagram - https://www.instagram.com/sanalabs/ Try Sana AI for free - https://sana.ai
Geoffrey Hinton | On working with Ilya, choosing problems, and the power of intuition
 

Recommendations