Aha, so it's both a semantic and behavioral issue. I've only ever buttoned my shirts from the bottom up, and I've never referred to shirts as either "button-up" or "button-down". To me, the term "shirt" already implies buttons, and in cases where there might be some ambiguity I would just say...