Yeah, if one person is fired from the company the default thought in Japan is that person must have done something very wrong to even get to that place, as it's quite rare for fulltime salaried employees.
If a group of people are laid off, in Japanese culture that reflects very poorly on the company, suggesting that management was irresponsible to lead the company into this situation.