Model and System Cards

A card is a structured description of an AI model or an AI system, written for the people who review, approve, audit or use it.

• A model card follows Model Cards for Model Reporting (Mitchell et al., 2019): model details, intended use, factors, metrics, evaluation data, training data, quantitative analyses, ethical considerations, and caveats and recommendations.
• A system card covers system details, intended use, out-of-scope uses, affected people, human oversight, data, performance and monitoring, and risks and limitations. It also includes the latest published card of each model the system uses.

Drafting

A section you leave empty is filled from the registry: the system's intended use, its oversight design, a model's training-data summary, and so on. Write a section yourself to replace that text. A system's card can be edited by anyone who can edit the system. A model's card can be edited by anyone except auditors.

Publishing

Publishing freezes the card as a numbered version and records who published it and when. A published version never changes. Edit the draft and publish again to make a new version.

Each version carries a tamper-evidence check, shown as Intact. It shows whether the version has been altered without the application's signing key since it was published. Publishing a card records who published it; it is not an approval of the system, which only a review decides.

Save and publish saves what is on screen and publishes it in one step, so an unsaved edit is never lost.

Draft with Watney

If you can edit the card, Draft with Watney drafts every section from the record: for a system card, the system's registry entry, its models, its open risks and a count of its incidents by type; for a model card, the model, its versions and its evaluation results. You can paste the relevant parts of the vendor's documentation for it to use. The draft fills the fields on screen and is not saved: read and correct every section, then save or publish it yourself. Where the record is silent, the draft says [To confirm: …] instead of guessing, and Watney lists what the record does not say. If you have already typed in the fields, you are asked before they are replaced. A card that still says [To confirm anywhere cannot be published: state the fact or remove the sentence first, because a published version never changes.

Published versions can be downloaded as Markdown, JSON or PDF once your organization is on a plan (downloads are not in the demo). The latest ones are included in the system's approval dossier.