Capital letters were stored in the upper tray for typefaces used in letterpress printing. This is why they're called uppercase.