A federal judge in Atlanta declined Wednesday to order Georgia's secretary of state to restore to the voter rolls nearly 200,000 state residents, whose registrations civil rights groups contend were wrongly canceled.