Seonglae ChoLeela is a transformer that treats every chessboard square like a token in language models
post-LN encoder-only transformer
Mechanistic interpretability
arxiv.org
https://arxiv.org/pdf/2406.00877
look-ahead strategy in Transformer model
미래의 이동을 예측하고 정보들을 시간에 따라 전달하는지
Layer 12 H 12 attention head 미래 이동의 타겟 칸에서 중요한 정보를 현재 이동의 타겟 칸으로 전달하는 역할
arxiv.org
https://arxiv.org/pdf/2406.00877
Leela Chess Zero
Leela Chess Zero is a free, open-source, and deep neural network–based chess engine and volunteer computing project. Development has been spearheaded by programmer Gary Linscott, who is also a developer for the Stockfish chess engine. Leela Chess Zero was adapted from the Leela Zero Go engine, which in turn was based on Google's AlphaGo Zero project. One of the purposes of Leela Chess Zero was to verify the methods in the AlphaZero paper as applied to the game of chess.
https://en.wikipedia.org/wiki/Leela_Chess_Zero
