Public confidence in courts could be nearing a crisis point in an era of polarization, a panel including veteran judicial leaders and lawyers said Friday.