Interpretable Sparse Coding

Creator

Creator

Seonglae Cho

Created

Created

2025 Jan 30 15:21

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Aug 1 18:2

Refs

Refs

Sparse Approximation

Dictionary Learning

Interpretable Hierarchical Coding

It is good to separate out hard zeros for interpretability. Thisis because sparsity causes a dirac delta in density at zero.

But Is sparsity actually a good proxy for interpretability? is still open question

Linear model or tree-based model are considered to have intrinsic interpretability

Interpretable Sparse Codings

Regularization forest

https://arxiv.org/pdf/1406.2035

VAE

https://arxiv.org/pdf/2009.12421

helpful for insects

NCBI - WWW Error Blocked Diagnostic

Your access to the NCBI website at www.ncbi.nlm.nih.gov has been temporarily blocked due to a possible misuse/abuse situation involving your site. This is not an indication of a security issue such as a virus or attack. It could be something as simple as a run away script or learning how to better use E-utilities, http://www.ncbi.nlm.nih.gov/books/NBK25497/, for more efficient work such that your work does not impact the ability of other researchers to also use our site. To restore access and understand how to better interact with our site to avoid this in the future, please have your system administrator contact [email protected].

https://pubmed.ncbi.nlm.nih.gov/23615618/

Helpful for human (2005)

concept cell

Invariant visual representation by single neurons in the human brain

Nature - It takes moments for the human brain to recognize a person or an object even if seen under very different conditions. This raises the question: can a single neuron respond selectively to a...

https://www.nature.com/articles/nature03687

Invariant visual representation by single neurons in the human brain

Brain sprase coding

https://oxcns.org/papers/163_Treves+Rolls92.pdf

Emergence of simple-cell receptive field properties by learning a sparse code for natural images

Nature - Emergence of simple-cell receptive field properties by learning a sparse code for natural images

https://www.nature.com/articles/381607a0

odd cell dense

www.sciencedirect.com

https://www.sciencedirect.com/science/article/pii/S0896627309006849

Sparse

NCBI - WWW Error Blocked Diagnostic

Your access to the NCBI website at www.ncbi.nlm.nih.gov has been temporarily blocked due to a possible misuse/abuse situation involving your site. This is not an indication of a security issue such as a virus or attack. It could be something as simple as a run away script or learning how to better use E-utilities, http://www.ncbi.nlm.nih.gov/books/NBK25497/, for more efficient work such that your work does not impact the ability of other researchers to also use our site. To restore access and understand how to better interact with our site to avoid this in the future, please have your system administrator contact [email protected].

https://pubmed.ncbi.nlm.nih.gov/19555653/

Superposition

https://www.nature.com/articles/s41586-023-06098-1

Place Cells

NCBI - WWW Error Blocked Diagnostic

Your access to the NCBI website at www.ncbi.nlm.nih.gov has been temporarily blocked due to a possible misuse/abuse situation involving your site. This is not an indication of a security issue such as a virus or attack. It could be something as simple as a run away script or learning how to better use E-utilities, http://www.ncbi.nlm.nih.gov/books/NBK25497/, for more efficient work such that your work does not impact the ability of other researchers to also use our site. To restore access and understand how to better interact with our site to avoid this in the future, please have your system administrator contact [email protected].

https://pubmed.ncbi.nlm.nih.gov/8036517/

Hippocampal place-cell sequences depict future paths to remembered goals

Nature - The hippocampal region of the brain has an important role in providing the memory component of human navigation. It has been known for some time that after the completion of a movement,...

https://www.nature.com/articles/nature12112

Hippocampal place-cell sequences depict future paths to remembered goals

Recommendations

////////