the caste system is inherently racist. Merriam-Webster define racism as "a belief that race is the primary determinant of human traits and capacities and that racial differences produce an inherent superiority of a particular race." They define race itself as "a class or kind of people unified by shared... characteristics" and "a category of humankind that shares distinctive physical traits."

You're saying lighter skin = higher caste = easier access to wealth. That's a classic case of racist rationalization.