From the Active Registry view, next to an Unpublished or Invite Unaccepted registry row.... hit the Gear option icon and click Delete Registry.