Since the literary readings of the vernaculars of Sinitic languages are theoretically from Middle Chinese language, there may be some rules (which may have exceptions) of M.Ch. reading to literary reading of Mandarin/Cantonese/Taiwanese(Hokkien)/Hakka correspondence.
For example, in the book 福爾摩沙的烙印--臺灣閩南語概要(下冊), there is a correspondent table of the onsets ...
I have found an interesting answer to this question on the Internet.
YinYang is from 《易》， in 易，至阴为坤， 至阳为乾， 卦 is read from top to bottom （上卦下卦）。
So if we read yang-yin，that is 乾坤， ䷋ 否卦 (天地否) 。
But， read as yin-yang， it is ䷊ 泰卦 (地天泰)。
In my opinion, as a native speaker, this is about phonology, and has nothing to do with the word meanings - that is, 陰陽 is preferred than 陽陰 is only a result of the sounds yin1 and yang2, and the meanings of the characters 陰 and 陽 have no influence.
陰 is 阴平（一声） and 陽 阳平（二声）, and the 音韵 of 陰陽 is more natural to me than 陽陰 - I believe a general study of how 声调 ...