Patch panel vs straight to switch?

What are the advantages to using patch panels instead of connecting cables straight into the switch in an enterprise setting?

I know patch panels are considered best practice, but I am getting some resistance to using them from senior members of my team. They feel minimizing the number of connections between the user and the switch lessens signal loss and future issues and so patch panels should not be used.

Any suggestions?