how can a society or any sort of structure be maintained if you can’t remember anything? The whole premise felt a bit off.
The rulers in the palace could remember, though (because of the shielding provided by some metal). And the workers/slaves remembered enough to perform their tasks.