If you just pull the drive, it will probably be marked as “offline” and “pool degraded”. So when you put the drive back into a different port, you may need to go back into the pool and and “online” the drive at the new location. Safe thing would be to offline the drive, then pull it and move it. Safest thing would be to power the NAS down and move the drive.
I’ve never done this, so the above is just a guess based on what I’ve done when replacing drives in the pool.