The former chief financial officer for Atlanta pleaded guilty on Monday to stealing money from the city for personal travel and guns and trying to cheat the federal government on his income taxes.