Racism has a definition that's fairly easy to understand and yes people of all colors can be victims and even people of the same skin colour can be racists against one another because racism isn't necessarily about the color of your skin, it can be about your ethnicity.

Racism:

prejudice, discrimination, or antagonism by an individual, community, or institution against a person or people on the basis of their membership in a particular racial or ethnic group, typically one that is a minority or marginalized.

Ethnicity:

the quality or fact of belonging to a population group or subgroup made up of people who share a common cultural background or descent.

If you had taken a crowd of anonymous Germans all dressed the same in 1935, how would you have told who was a Jew and who wasn't? You wouldn't have been able to because they were all just white people.

What do you call it when 100 years ago in a first world white country the population that speaks one official language has an infant mortality rate comparable to that of colonial Africa while the population that speaks the other official language and lives in the same cities has an infant mortality rate comparable to any other first world nation?

Was the Rwanda genocide not racism because it was two groups with the same skin colour? What about what happened in Yugoslavia?

My white friend who went to China to study had to sit through multiple explanations by many Chinese student of the levels of intelligence being affected by skin colour and ethnicity and guess what, whites weren't at the top! "All white people are dumber than Indians who are dumber than Koreans who are dumber than Chinese." Are you telling me that isn't racism against white people (and anyone that isn't Chinese)? Because I sure would hope someone would call me a racist if I was saying the same thing about people of another skin colour or ethnicity!