In a constant and steadfast manner; "an unswervingly loyal man".
Without swerving; in a direct and unswerving manner; "the ship travelled unswervingly through the night".