How to combine human behavioral experiments and CNNs? A new preprint is on arXiv
GANs output linguistically informative results even when trained on extremely small datasets.
This means we can compare learning in human behavioral experiments and deep CNN trained on the same data.
Preprint: arXiv.
The paper proposes a technique to follow how the network searches through the space of possible sound combinations and uses linguistically interpretable strategies when learning.
Spectrograms below show how the network transforms outputs as training progresses.
Appearance of rule-like computational emerges in deep convolutional nets as an interaction between latent variables. Spectrograms below illustrate vowel harmony when 2 latent variables are manipulated.