Bay Lake Towers possibly?
If you are an onsite guest, that would be all you need (a room key). Well, you also need park admission.
You don’t have to be in the park when Extra Magic Hours starts.
Edit- Checked your trip list and see BLT on there. So yes, you need your room key to show at the entrance to attractions. If anything has changed, feel free to correct me friends!