Well, yeah, because doing things with hardware is just always unsafe in that sense, no matter if you're implementing it in Rust or C or Assembly. As long as you know what you're doing (and the hardware manufacturer did, too), it's not actually unsafe.

Rust just decided to isolate the code parts where you need to be extra smart like that, whereas in C or Assembly, you might need to be extra smart throughout the entire code base.
Obviously, no sane C programmer would just randomly start scrubbing memory addresses in UI code, but it's still just helpful to have the naughty code clearly indicated.