ai newsSa., 24. Okt.

Your AI assistant cited a law that does not exist. Here is the fix.

I watched an LLM cite a law that does not exist. Not a hypothetical: it produced 18 U.S.C. § 301 as the basis for a data-protection claim, and quoted Consumer Credit Act 1974 s. 157 for a rule that lives somewhere else entirely. Both looked authoritative. Both were wrong in ways only a lawyer — or

dev.toFreitag 23:32 · 23.10.2 Min. Lesezeit
Bild: dev.to

Posted on Oct 23 • Originally published at ailegal.legal

I watched an LLM cite a law that does not exist.

Not a hypothetical: it produced 18 U.S.C. § 301 as the basis for a data-protection claim, and quoted Consumer Credit Act 1974 s. 157 for a rule that lives somewhere else entirely. Both looked authoritative. Both were wrong in ways only a lawyer — or a very suspicious engineer — would catch.

Prompting did not fix it. "Be careful" is not a data structure. So we turned the rule into one.

Every norm in our corpus is stored as a record, not as text inside a prompt:

A scheduled job re-reads the sources and compares hashes. If a source changes, the norm is flagged for review. If a source cannot be reached, the product does not quietly keep citing it — it says the source could not be confirmed and withholds the deadline.

That last part matters more than it sounds. "I don't know, here is the official link" is a better answer than a confident number with nothing behind it.

92 norms across six jurisdictions — Russia 25, United States 26, India 14, Hong Kong 11, United Kingdom 9, Canada 7. Each one was read in the official text; the verification script re-checks the numbers in the summary against the source.

This makes the product less impressive in a demo and more useful in a conversation. That trade-off is the whole point.

Plain-language breakdown of a situation: what happened, which paths exist, what they cost, how long they take, what the other side will argue. Contracts are scanned for traps. A document can be generated once the situation is understood.

Free: the breakdown. Paid: documents — $4.99 for three, $6.99 for ten. Payment by crypto or Telegram Stars. Interface in 26 languages; legal content in Russian and English for now, with the language boundary shown rather than hidden.

Take any norm on the site, open the official source next to it, and try to make the summary say something the source does not. Or find a field where a clear instruction is scored lower than a harmless example. Those are the bugs that matter for this design — not a broken button.

Live: https://ailegal.legal Method note: the verification pipeline and the corpus boundaries are described in the app itself, including the parts we have not covered.

We are early. Nobody has paid yet. That is exactly why the critique is worth more than the launch metrics.

Quelle: dev.to (dev.to). Original öffnen