Gov. Brian Kemp has suspended a south Georgia mayor who was indicted on charges that he stole nearly $65,000 from his town.