I will answer trying to keep in mind and not miss any of the points you mentioned, but do forgive if I accidentally omit any. Also, it is going away from fashion and more into sociology, history and cultural politics, where I am no expert no matter how much I read on the subject.
Firstly, however sour and bold this may sound, the Earth has always been the survival of the fittest, and the winners write history, not the losers. We do know about workers, underpaid people, conditions, slavery, and many of these exist even now and are rampant. Nevertheless, does it may every white person responsible? I would say no, the actions of my ancestors are not my own and I had no agency or influence, and it is logical, but then I am white – it is up to the person to take it or not, there have been many scandalous events even on this forum, where a white person cannot have an opinion on this as they are white. Does that change the idea of the fittest? No. Even the first people were not white, many European countries were established by people of colour, especially Eastern Europe by Asians. Does that mean we have to give them all back and repopulate? This logic seems revanchist, but all racial questions can be reduced to the notion of revenge. The history is set and cannot be rewritten, but at the same time Germany cannot be guilty for Hitler forever, and white people (especially in the West) cannot be held accountable for what happened to POCs forever. How does this relate to fashion? We do see the changes and inclusion of more women and POCs as creative directors in 21st century that ever before, but we can't give away places and high professions "just because".
Secondly, coming from the first point, life and politics are unfair. It is up to the government, politicians, statisticians, businessmen and the elite of France, Germany, England or any other country to tell what their culture is and what population the want to be presented as or what their cultural aspects are. Is it unpleasant and annoying? Yes. But this is the reality. At the same time, things like culture are too strong of a force to control by groups of people. People mixed and always will, and it will create new sparks of culture, it always did. One cannot simply tell the world "make culture more latino/black/asian" and everyone will follow.
Now, on the third, due to Europe and the US being most accessible and the loudest due to the languages and that history, I find your point one-sided, (not as because of you, because always had this issue with such points), and let me explain. There are various people in the West as you say, which is true and is a fact. That said, there are white people that live in SA, Asia, some move to Africa too. Do we have to make Japan whiter and its culture too? Do we have to shame their rockabilly culture, because it is appropriation of Elvis? Do we have to make Mexico whiter, because a lot of white Americans move there? If you reverse the argument, and there are white people in other cultures too as we know, it does not hold the same truth. Tell people in China or Brazil to make it whiter as there are white people there too that need to be represented and look what they tell you.
I also try, while not always succeed, to separate the art from the artist. Coco was a collaborator, but that makes her a terrible person, that does not make her work terrible or less groundbreaking. Was the privileged? Yes. But was she an innovator and a hard worker? Yes as well. It does not only take Coco to make Chanel. It takes all her connections, circumstances, luck and chance to happen. It could've been anyone, but it was her and that will never change. Same applies to D&G, and I despise their brand or their social claims, the majority does. The does not make them less of who they are, and if they were smart enough to keep mouths shut until the success became too large - kudos to them and the life is unfair/survival of the fittest point comes back.
That history is exclusionist or written by the privileged elite that came out as winner has never been a secret. We cannot change that. We go to European museums and see hundreds of years of portraits of royalty and high society: from C.Z. Guest to Elizabeth the I, Duchess Olga of Russia and Adele Bloch-Bauer. The traditional clients of European couture have been for decades white rich women. I think trying to disprove this point simply by saying 'no', while looking at all the historical literature and portraiture is ridiculous, if one can excuse me. Therefore I still appeal and cling to my point - clients and key audience of European couture are white women of the elite circle, and have always been, except only some recent times when other races delved deeper into couture houses.
Edison claimed the bulb that he did not create, Steve Jobs claimed something Wozniak created, Richard Prince took other s' Instagram posts and made them 'his art'. Successful stealers succeed, this is also not news of our unfair living. Nonetheless, as I said before, for some reason nobody is angry at Japanese rockabillies or at the 'White Chicks' movie. Whiteface does not exist or is it simply inconvenient to acknowledge it?
Lastly, while I agree that it happened that US/Europe white culture happened to be dominant in these places, these places also have the highest amount of white people in them. Where does the point of balance sit, and who is the judge? When enough models of other colour is enough? Or creative directors, or actors, or even dentists? Who is the judge to that? The protectionist reaction and the resistance/struggle are logical, nobody wants to give a piece of their cake. With all said above, white people constitute only 6.5% of the worldwide population, the smallest amount of any other race (I never understood the choice of the world 'minority' for the others, which is such a false statement), and having that much power over culture and media, certainly nobody would want to give that up.
TL;DR : life is not fair and the world is not too. The conversations always should take place and are food for thought and development, but this is akin to "why some people are famous and rich, but I am not?".