Taking the good face from a second shot
If you took a burst, the usual move is to take the person's face from the frame where they did look good and bring it into the frame where everyone else did. Because both frames come from the same session, the lighting, camera and distance already match โ which is exactly the condition under which a swap looks invisible rather than composited.
This is the single highest-success-rate use of a face swapper, and it is worth doing before reaching for anything more elaborate.