Seonglae ChoIt is good to separate out hard zeros for interpretability. Thisis because sparsity causes a dirac delta in density at zero.
But Is sparsity actually a good proxy for interpretability? is still open question
Linear model or tree-based model are considered to have intrinsic interpretability
Interpretable Sparse Codings
Regularization forest
arxiv.org
https://arxiv.org/pdf/1406.2035
VAE
arxiv.org
https://arxiv.org/pdf/2009.12421
helpful for insects
NCBI - WWW Error Blocked Diagnostic
Your access to the NCBI website at www.ncbi.nlm.nih.gov has been
temporarily blocked due to a possible misuse/abuse situation
involving your site. This is not an indication of a security issue
such as a virus or attack. It could be something as simple as a run
away script or learning how to better use E-utilities,
http://www.ncbi.nlm.nih.gov/books/NBK25497/,
for more efficient work such that your work does not impact the ability of other researchers
to also use our site.
To restore access and understand how to better interact with our site
to avoid this in the future, please have your system administrator
contact
info@ncbi.nlm.nih.gov.
https://pubmed.ncbi.nlm.nih.gov/23615618/
Helpful for human (2005)
concept cell
Invariant visual representation by single neurons in the human brain
Nature - It takes moments for the human brain to recognize a person or an object even if seen under very different conditions. This raises the question: can a single neuron respond selectively to a...
https://www.nature.com/articles/nature03687
Brain sprase coding
oxcns.org
https://oxcns.org/papers/163_Treves+Rolls92.pdf
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Nature - Emergence of simple-cell receptive field properties by learning a sparse code for natural images
https://www.nature.com/articles/381607a0
odd cell dense
www.sciencedirect.com
https://www.sciencedirect.com/science/article/pii/S0896627309006849
Sparse
NCBI - WWW Error Blocked Diagnostic
Your access to the NCBI website at www.ncbi.nlm.nih.gov has been
temporarily blocked due to a possible misuse/abuse situation
involving your site. This is not an indication of a security issue
such as a virus or attack. It could be something as simple as a run
away script or learning how to better use E-utilities,
http://www.ncbi.nlm.nih.gov/books/NBK25497/,
for more efficient work such that your work does not impact the ability of other researchers
to also use our site.
To restore access and understand how to better interact with our site
to avoid this in the future, please have your system administrator
contact
info@ncbi.nlm.nih.gov.
https://pubmed.ncbi.nlm.nih.gov/19555653/
Superposition
www.nature.com
https://www.nature.com/articles/s41586-023-06098-1
Place Cells
NCBI - WWW Error Blocked Diagnostic
Your access to the NCBI website at www.ncbi.nlm.nih.gov has been
temporarily blocked due to a possible misuse/abuse situation
involving your site. This is not an indication of a security issue
such as a virus or attack. It could be something as simple as a run
away script or learning how to better use E-utilities,
http://www.ncbi.nlm.nih.gov/books/NBK25497/,
for more efficient work such that your work does not impact the ability of other researchers
to also use our site.
To restore access and understand how to better interact with our site
to avoid this in the future, please have your system administrator
contact
info@ncbi.nlm.nih.gov.
https://pubmed.ncbi.nlm.nih.gov/8036517/
Hippocampal place-cell sequences depict future paths to remembered goals
Nature - The hippocampal region of the brain has an important role in providing the memory component of human navigation. It has been known for some time that after the completion of a movement,...
https://www.nature.com/articles/nature12112
