There's still good fabrics out there you just have to pay for them. I've mostly replaced my wardrobe now with natural undyed cottons and wools from the likes of "unbleached apparel" and "industry of all nations". There is cotton grown in new mexico, socks spun in north carolina. "Filson" makes a few things in Seattle. Don't skip the stuff made in Peru or India neither.
I really like the look of those unbleached + un-dyed shirts, but Unbleached Apparel and Industry of All Nations don't seem to have tall sizes :(