Generative artificial intelligence applications are unreliable when answering legal questions and may fabricate legal citations so they should not be used for legal advice without expert supervision, according to law firm Allens in its first benchmark report on AI and Australian law.

“While the answers produced by [large language models] can be superficially convincing, they are not always correct and often lack nuance and context,” the study found.