A senior executive at Australia's financial regulator has left the public sector to join global investment fund Vanguard to lead its Australian office of the general counsel.