A deep learning puzzle: Can you find out who haunts the latent space?