As far as I'm concerned, only if I request a cast member come to my room am I required to let them in. If someone wants in unexpectedly, and everyone in the room is decent for company, then the bar can be removed from the door and that person can unlock the door for themselves. I have seen cast costume pieces and name badges for sale, so just having those does not mean that an individual is a cast member allowed to enter my room whether I want that person there or not. Being able to use a key or MagicBand makes it much more likely that Disney wants that person in my room. And if someone attempts to force their way in when I am not dressed properly? I am not afraid to be very loud at that time, go to the front desk in person and complain loudly, and also complain on the internet. Disney may have the right to visit the room, but that should not require me to made uncomfortable when a short delay would solve my objection. They can even wait just outside the door until I'm ready if they want.