American apparel manufacturers have faced higher imported input costs and losses in business amid the tariff turmoil.