I think a lot of sexual fantasies, if they happened in real life, would be blatantly nonconsensual. A lot of things just go over in fantasy, and a lot of pornographic material is written in this fantasy headspace with relaxed rules. I read something on literotica a few weeks ago (nothing very good) about a paralyzed/unresponsive patient getting a handjob from their nurse, which irl would obviously be actual sexual assault, but was normalized within the fiction. The patient was surprised, but not traumatized, and it was otherwise treated as a normal part of the hospital's function.
Creating imaginary worlds with strange & permissive rules of sexual conduct is part of the fantasy, I think; it's not so much that they're rape-fantasies as they are a fantasy world where the sex act wouldn't be rape. It's a kind of fantasiser's poetic license. Many fantasies take place in a fantasy culture where sex is kind of formalized & considered an essential part of specific social relations - the nurse/patient, teacher/student, prison-guard/prisoner, etc., ("its penis inspection day" etc.) and in more fetish-y material, between women and inferior men or whatever. Many JOI clips take the form of some kind of desexualized encouner - 'tease & denial therapy' or 'slave training' and so on. The fantasy recontextualizes ordinary situations & creates new, strange ones.
To answer: yes, usually.