How to simulate via a sensory interface
(a) Retina mapping
- MuJoCo camera → downsample
- convert to photoreceptor neuron firing
(b) Olfaction (smell)
- No real chemical sensing so instead:
- an "odor scalar field"
- mapped to activation of a specific neuron group
(c) Touch
- contact force → mechanosensory neuron firing
- motor neuron firing → joint torque
Example:
- a specific neuron cluster → leg movement
Here too:
hard-coded mappings are almost required
4) Calibration / tuning
This is the key trick:
- synaptic weight scaling
- global gain tuning
- noise injection
- homeostasis constraints
5) (almost certainly) some learning / fitting is involved
A pure copy still won’t run, so:
- RL fine-tuning
- parameter fitting
- or:
- behavior cloning (partially)
In other words: it’s not reproducing the senses; it’s translating sensory signals into inputs compatible with the sensory neurons.
MujoCo model:
flybody
TuragaLab • Updated 2026 Apr 15 14:1
Network statistics of the whole-brain connectome of Drosophila
Nature - The network of the fly brain is highly recurrent and displays rich-club organization, with a large population (30%) of preferentially connected neurons.
https://www.nature.com/articles/s41586-024-07968-y

Amino acids and KLHL22 do not activate mTORC1 via DEPDC5 degradation
Nature - Amino acids and KLHL22 do not activate mTORC1 via DEPDC5 degradation
https://www.nature.com/articles/s41586-024-07974-0

The fly connectome reveals a path to the effectome
Nature - Analysis of the whole-brain fly connectome reveals high-dimensional dynamics supported by many small independent circuits, motivating a proposal for optogenetic perturbation to efficiently...
https://www.nature.com/articles/s41586-024-07982-0

www.nature.com
https://www.nature.com/articles/s41586-024-07763-9
volume
Nature - Wiring diagram
Neurons in the brain are connected by synapses to form sophisticated circuits that drive complex behaviours such as social interaction and navigation. But to...
https://www.nature.com/nature/volumes/634/issues/8032
MANC
MANC connectome
With about 23,000 neurons, 10 million pre-synaptic sites, and 74 million post-synaptic densities, the male adult nerve cord (MANC) connectome is a densely reconstructed map of synaptic connections in
https://www.janelia.org/project-team/flyem/manc-connectome

Seonglae Cho