The defense attorney for a man charged with fatally shooting rapper Young Dolph said Friday he has asked a judge to remove himself from the case based on claims that the judge is not being impartial.