It's a uniform. Apparently, they all started wearing the ACU uniform when mass deployment to Afghanistan and Iraq happened, as institutional acknowledgement that even if you're in the Pentagon, you're part of an organization that is also fighting in the field.
Without a top button, you used a piece of cloth around the neck to hold up the shirt. Then an infamous french king liked the look (he also basically invented men wearing wigs) and ties became fashion.