Refugees were never a problem for the ruling class, of this I am convinced.

Migrant communities are difficult to police and to surveil, particularly when they're ghettoized but still heavily relied on for cheap labor. They can regularly form the heart of nascent union movements, rebellious groups, and revolutionary cohorts targeting neighboring bourgeoisie-friendly-but-unstable regimes. Russian exiles in the UK and France ended up toppling the Tsar. Cuban exiles overthrew Batista (and have threatened to overthrow the Castros in turn). Somali expats in America are a chronic thorn in the side of both Democrat and Republican regimes, as they push politicians in a direction that the national government doesn't want to go. Palestinians in Jordan are a major security concern for both the local King and his neighboring allies in Saudi Arabia, Israel, and Egypt.

There are plenty of ruling-class residents of these countries that are under real pressure thanks to the impact large, often-well-educated and politically active migrant communities have on the global geopolitics.

The "migrant crisis" have been overblown pretty heavily by the media, but even if it wasn't, and there were indeed droves upon droves of desperate people paddling to Europe's white shores - the bourgeoisie (who made them paddle in the first place) don't actually interact with them, nor are in danger of the potential criminal element among their ranks.

The "migrant crisis" is a tool by southwestern and midwestern conservative Republicans to attack their Democrat peers. However you perceive the actual presence of Latin American migrants (or Eastern European / East Asian / Middle Eastern migrants, depending on how far you want to take the hysterical claims), the fixation on climate refugees as a threat is destabilizing to the current national government.

If you're aligned with the Biden Administration, your bourgeoisie affiliation does not leave you immune to the threat that a Trump-ascendant government presents. If nothing else, Trump's fixation on Right Wing Bugbears (the entire state of California, the mastheads of DC and New York news media, the rapidly growing private green energy industries) pose a threat to the financial elites tied in with these wealth aggregating sectors.