ai newsFr., 23. Okt.
EilmeldungOpenAI senkt Bewertungserwartung: Finanzierungsrunde über bis zu 30 Milliarden Dollar

We audited 134,522 posts to see why AI writing still sounds fake (and open-sourced a deterministic syntactic gate)

in 2025/2026, everyone removed the obviously AI keywords from their prompts. but even non-dev/tech-minded readers can detect an LLM post in the first 3 sentences. why? because they removed the words that people made fun of, but not the syntactic patterns that betray RLHF models. to quantify the cha

dev.toFreitag 11:30 · 23.10.2 Min. Lesezeit
Bild: dev.to

in 2025/2026, everyone removed the obviously AI keywords from their prompts. but even non-dev/tech-minded readers can detect an LLM post in the first 3 sentences.

why? because they removed the words that people made fun of, but not the syntactic patterns that betray RLHF models.

to quantify the change, we audited 134,522 random organic linkedin posts on 1,499 founder profiles, over jan'23 to sep'26 timeframe (LigoSocial dataset).

most indicative is burstiness (CV=$\sigma$/$\mu$ - std.dev. of sentence word count over avg. sentence word count)

normal human, non-assisted text: CV=0.48. you may see sharp jumps of 4-word observation. and then next to it, 32-word breakdown of architecture. default GPT4o/claude 3.5 sonnet. tightly cluster around 14-18 words/sentence. (CV=0.21-0.23).

if you ask llm "vary sentence length. don't use contrastive negatives". the model takes it as a soft weighting in attention. but then, in 3rd paragraph it tries to converge back to a safe, well-mannered 15-word mean (rlhf).

you can't use a prob. generator as deterministic linter.

The model will not self-censor: deterministic external (non-LLM) vanilla JS preflight engine is applied to each draft:

HARD_BURSTINESS_FLOOR ($CV > 0.32). Computes sentence wordcount variance. (Preserves decimal "3.14", abbreviations "U.S.", "Dr." etc.) Any draft that does not have $CV > 0.32, is rejected.

Engineering quirk. FIPS 180-4 SHA256 on "file://"

We made the workbench (grai.html) to be 100% offline from disk. Use the file:// protocol and strict Content-Security-Policy (connect-src 'none' by default).

Here's where we ran into some problems testing on WebKit/Chromium. They block window.crypto.subtle.digest("SHA-256") on file:// (local files are not Secure Context). We need SHA256 fingerprint of author's voice profile to be deterministic for our printable A4 Voice DNA Dossier. So we created a pure JS FIPS 180-4 SHA256 workaround. To have the same hash whether we load it from disk or over HTTPS.

• Live Cadence Gate Scorer (free - no signup required) https://grai.page/#test

• Full 134522-post Methodology Report https://grai.page/methodology

• Github repo (MIT skill & instructions) https://github.com/adrianpeticila/grai

Quelle: dev.to (dev.to). Original öffnen