I think the answer to your question is yes ... but the reality is that even if the person isn't influenced by fashion, the clothes are ... unless the person in question made everything from original patterns, which is highly unlikely without knowing anything about fashion
But sure, I can see the theoretical possibility of someone dressing sharply with no knowledge of fashion.