how people very knowledgeable on the current paradigm cannot see (most of times historicaly) that a paradigm shift is about to happen ?
I’m not sure I’d agree with that assessment. Generally a new model or understanding of physics arises because of known shortcomings in the current model. Quantum physics is the classic example that resolved a number of open problems at the time: the ultraviolet catastrophe in black body radiation, the photoelectric effect, and the interference pattern of the double slit experiment, among others. In the years leading up to the development of quantum theory, it was clear to everyone active in physics that something was missing from the current understanding of Newtonian/classical physics. Obviously it wasn’t clear what the solution was until it came about, but it was obvious that a shift was coming.
The same thing happened again with electroweak unification%20and%20the%20weak%20interaction.) and the standard model of particle physics. There were known problems with the previous standard model Lagrangian, but it took a unique mathematical approach to resolve many of them.
Generally research focuses on things that are unknown or can’t be explained by our current understanding of physics. The review article you linked, for example, details open questions and contradictory observations/predictions in the state of the art.