Hippocampal-Cortical Model Simulation of Category Learning Consolidation over one night of sleep
This is a hippocampal-cortical model of sleep consolidation. The architecture includes C-HORSE, our model of the hippocampus (see Zhou et. al. 2021 and Schapiro et. al. 2017a) and a neocortical layer as the target of consolidation. Architecture Schematic:
During sleep, the model autonomously replays stimuli it learned while awake and uses an oscillation-based learning rule during sleep in order to improve its own performance. This version is set up to simulate the structured satellite learning task from Schapiro et al. 2017b.
- Clone this repository to your computer. See instructons on how to do this here.
cdinto the repository and run the commandgo build && slp-rep-cat. When you first run this command, go should automatically download all the packages required to run the model onto your computer. Once the command runs through, a GUI window should open up where you can interact with the model/explore its architecture.- Click the "Train" button on the top left. When you do this, the following will happen:
i) The model will learn the satellite task in its awake state. You should see blocks of training and testing occuring sequentially until the model hits a learning criterion of 0.66 (66% accuracy on the task).
ii) The model will now switch to sleep and will begin replaying the information it just learned during the wake state. At various points the model will fall into periods of high stability which the model will reinforce by contrasting it with immediately following periods of lower stability. The stability measure is displayed at the bottom of the screen as "AvgLaySim", periods of high stability are the "plus phase" of the model and subsequent periods of low stability are the "minus phase".
iii) After 30,000 cycles of sleep, the model will switch back to a wake state and will immediately run a test block to measure if there has been an improvement in performance through the learning that occured during sleep.
Note that the hippocampal projections are not actively learning during sleep so all performance changes are an outcome of learning in the cortical projections.
The model relies on two mechanisms during sleep - (i) Short-term Synaptic Depression which destabilizes item attractors and (ii) Oscillating Inhibition which reveals useful contrastive learning states in destabilized item attractors.
Synaptic depression is controlled by the "inc" and "dec" parameters which specify the rate of increase and recovery from synaptic depression over time, respectively (see line 493).
Layers in the network recieve either high or low amplitude oscillating inhibition (see line 1128). The amplitude for each is controlled via a sinusoidal equation which can be edited to change the various properties of the oscillations (see line 1556).
