Contents
  1. Purpose and foundations
    1. What governance decides
      1. The handling decision
    2. Specify the intended use
      1. One conversation, different purposes
    3. Enduring privacy principles
      1. Selected foundations
  2. Information and responsibility
    1. Inventory flows and copies
      1. Artifacts commonly missed
    2. Assign accountable decisions
      1. Decision responsibility
      2. A reviewable decision record
    3. Distinguish people and actors
      1. Do not collapse the actors
    4. Establish permitted uses
      1. Different permission questions
      2. Implementable permission record
  3. Transformation and access
    1. Minimize without losing the task
      1. Transformations make different claims
      2. Before and after minimization
    2. Preserve origins and dependencies
    3. Enforce current authority
    4. Control derived disclosures
  4. Retention and changed rights
    1. Set artifact lifetimes
      1. Artifact-specific retention
    2. Respond to changed authority
      1. Do not collapse unlike requests
      2. Response record
    3. Propagate correction and deletion
      1. Propagation obligations
    4. Address learned influence
      1. Different responses make different claims
  5. Suppliers and assurance
    1. Approve actual service paths
      1. Review each request path separately
    2. Verify and revisit decisions
      1. Requirement-to-check matrix
  6. Check understanding
  7. Open questions
  8. Selected talks
  9. References
  10. Talk library
← All topics

Privacy and Data Governance

An AI system can behave exactly as designed and still handle information inappropriately. It may reuse a support conversation for training, disclose a mixed-source summary to the wrong audience, retain prompts longer than their purpose requires, or change a record under stale authority. Privacy and data governance addresses these intended processing decisions—not only attacks or accidental leaks. A useful governance decision specifies the information, purpose, actor, operation, recipient, duration, and accountable decision maker. Those choices must then survive implementation: data is copied into requests and logs, transformed into embeddings and summaries, combined across sources, sent to suppliers, and sometimes incorporated into learned model parameters. The central engineering task is to keep the approved handling conditions meaningful as information changes form, location, audience, and lifetime.

Purpose and foundations

What governance decides

Privacy concerns the appropriate handling of information about people, including adverse consequences produced by planned and authorized processing. This is broader than confidentiality. Encrypting a dataset and excluding attackers can protect it from unauthorized access while leaving unresolved whether collecting it, inferring from it, or using it to make a consequential decision is appropriate.

Data governance assigns responsibility for decisions about information and ensures that those decisions are implemented throughout its lifecycle. Its scope includes personal information and confidential organizational information. Internal owners decide or escalate important uses; stewards administer definitions, access, retention, and quality; custodians implement storage, access, and disposal controls. These are accountability roles, not claims that an organization possesses unrestricted rights over the data.

In the European Union's General Data Protection Regulation (GDPR), personal data is information relating to an identified or identifiable person, called a data subject. Identification can be indirect, and processing includes collecting, storing, using, altering, disclosing, and erasing information. Inferences and linked records can therefore remain personal even when a direct identifier is absent. Other jurisdictions use different definitions, so an organization must determine which rules apply rather than treating this chapter as jurisdiction-free legal advice.

The handling decision

ElementQuestion it answers
InformationWhat source, fields, representations, or inferred attributes are involved?
PurposeWhat specific outcome justifies the processing?
ActorWho requests, performs, or is affected by it?
OperationIs the system reading, deriving, disclosing, changing, or deleting?
RecipientWhich person, team, service, or organization receives information?
DurationHow long does the continuing purpose justify each artifact?
AccountabilityWho may approve the use and answer for its consequences?

Security remains essential because attackers can bypass approved decisions, but it answers a complementary question: how are assets protected against hostile or unauthorized behavior? The AI Security chapter develops that boundary. Here the focus is the prior and continuing decision about what the system is allowed to do when it works as intended.

Specify the intended use

A purpose is the concrete outcome for which information is processed. Purpose limitation requires purposes to be specified early enough to constrain collection and later use; collection limitation asks whether the information gathered is necessary for that purpose. A proposed secondary use—a use beyond the original purpose—may require a new decision about authority, affected people, fields, recipients, and retention.

“Improve the product” is usually too broad to guide engineering. Answering a support request, measuring response quality, studying recurring defects, and training a model are different activities. Training changes learned model parameters using examples; ordinary inference uses an existing model to produce an output. The Machine Learning Fundamentals chapter explains that distinction in depth.

One conversation, different purposes

Suppose a support conversation contains an issue description, product version, account identifier, contact details, and an agent's reply. Holding the source constant does not hold its handling requirements constant.
PurposePotentially necessary informationRecipients and continuing need
Answer the requestIssue, product version, account context, reply channelSupport systems and assigned staff; retain according to the service and record purpose
Evaluate response qualityIssue and reply; direct contact fields may be unnecessaryAuthorized reviewers or evaluation service; retain only the evaluation evidence needed
Train a modelSelected examples and target responses after a separate reuse decisionTraining pipeline and any model supplier; dataset and resulting model require distinct lifecycle decisions

Availability is not permission. Public webpages, customer uploads, purchased datasets, and employee records each require examination of their source, original purpose, applicable rights, notices, confidentiality, and proposed reuse. Permission is also different from fitness: authorized data can still be inaccurate, unrepresentative, stale, or unsuitable. Dataset fitness belongs in Data Quality and Curation.

Enduring privacy principles

Modern AI adds new representations and inferences, but its governance questions have older roots. Networked records increased organizations' capacity to combine information long before generative models. Three landmarks help explain why purpose, individual participation, and accountability remain central without suggesting that one framework replaced the others.

Enduring privacy principles

  1. July 1973Records, Computers and the Rights of CitizensEstablished safeguards for openness, access, correction, secondary use, reliability, and protection against misuse in computerized record systems.Sources & context

    Contributors: U.S. Department of Health, Education, and Welfare advisory committee

    What changed: Made the imbalance between record-keeping organizations and affected individuals an explicit systems problem, including the risks created by linking records across systems.

  2. 23 September 1980OECD Privacy GuidelinesConnected collection and purpose limits, individual participation, accountability, and transborder information flows.Sources & context

    Contributors: OECD Council and member-country representatives

    What changed: Expressed privacy as a coordinated set of limits and responsibilities that remain relevant when information crosses organizational or national boundaries. The currently published recommendation contains revised text.

  3. Developed during the 1990s; principles published 2009 and revised 2011Privacy by DesignMade preventive defaults, lifecycle protection, transparency, and privacy embedded in systems and organizational practices central design principles.Sources & context

    Contributors: Ann Cavoukian

    What changed: Shifted attention toward building protective behavior into technology, infrastructure, and operations instead of depending primarily on operator restraint after deployment.

Notice the progression from participation in computerized record systems, through purpose limits and organizational accountability, to privacy embedded in design and defaults. Spacing is not to scale.

Selected foundations

DateDevelopmentContribution
July 1973Records, Computers and the Rights of CitizensThe US HEW committee described the imbalance created by computerized record systems and proposed openness, access, correction, limits on secondary use, reliability, and safeguards against misuse.
23 September 1980OECD Privacy GuidelinesThe original recommendation connected collection and purpose limits, individual participation, accountability, and transborder information flows. The currently published recommendation is revised text.
Developed during the 1990s; principles published 2009, revised 2011Privacy by DesignAnn Cavoukian argued for preventive defaults, lifecycle protection, transparency, and privacy embedded in systems, infrastructure, and organizational practices.

These contributions solve different parts of the problem. Participation gives people ways to understand and challenge records. Purpose and use limits constrain organizational reuse. Preventive design asks engineers to make protective behavior the default instead of depending on operator restraint. AI makes all three more important because a system can synthesize new attributes, copy material into new services, and make a derived claim influential without reproducing any source sentence verbatim.

Information and responsibility

Inventory flows and copies

A useful inventory describes processing, not merely infrastructure. For every activity, record the source, affected people, purpose, fields, operation, recipient, storage location, responsible team, and retention rule. Then compare the declared design with requests, traces, configurations, supplier documentation, and observed storage. A diagram that names “database, app, model” can miss most of the governed artifacts.

A retrieval system illustrates the problem. Retrieval-augmented generation (RAG) supplies selected source material to a model while producing an answer; its full mechanism belongs in Retrieval-Augmented Generation. The source may also produce chunks, an index, provider requests, outputs, traces, feedback records, and evaluation exports. Each can differ in recipients, access controls, and lifetime.

An embedding is a numerical representation used for operations such as similarity search; Embeddings and Representation Learning explains how such representations work. Embeddings can reveal source information and belong in a sensitive-data inventory rather than being treated as anonymous. Model weights are learned parameters. They do not behave like ordinary rows: source deletion can remove a stored record without reversing its influence on trained parameters.

One answer, several governed artifacts

Example

A single response can create independently governed copies across organizational boundaries.

A source record is transformed into a search representation, retrieved by an application, sent in a minimized model request, returned as an answer, and observed through a reduced trace. The provider request and telemetry exporter are separate organizational recipients; each retained artifact needs its own purpose, permissions, and lifetime.
Read the diagram as text
  • Source record. Issue text, product version, account context, and source permissions.
  • Search representation. Derived chunk and embedding linked to the source version.
  • Application. Authenticates the requester, retrieves permitted context, and assembles a minimized request.
  • Model provider request. Selected instructions and source facts cross an organizational boundary.
  • Generated answer. Derived output whose recipient and content require disclosure authorization.
  • Reduced trace. Identifiers, versions, timing, policy outcome, and status without full payload capture.
  • Telemetry destination. A separate recipient receiving only approved trace fields.
  • Source recordSearch representation: data: derive chunk and embedding.
  • Search representationApplication: data: permitted retrieved context.
  • ApplicationModel provider request: data: minimized model request.
  • Model provider requestGenerated answer: data: generated response.
  • ApplicationReduced trace: data: selected event fields.
  • Model provider requestReduced trace: data: provider status and model ID.
  • Reduced traceTelemetry destination: data: filtered telemetry.

Artifacts commonly missed

ArtifactInventory questions
Uploads and connector copiesWhich account supplied them, whose information appears, and where is a managed copy retained?
Indexes and embeddingsWhich source/version produced them, which permissions apply, and how are updates or deletion propagated?
Prompts, outputs, and tool payloadsWhich fields cross an organizational boundary, and can generated output disclose more than its destination permits?
Traces, caches, and feedbackIs content captured, who can inspect it, and what diagnostic purpose justifies retention?
Evaluation and training exportsWas reuse approved, are labels or responses generated, and which later artifacts depend on the dataset?
Unregistered applicationsCan staff upload governed information outside approved identities, contracts, regions, or controls?

Real products can create governed artifacts beyond the visible answer. Microsoft documents interaction records, retained versions of referenced files, uploads, and Copilot Pages under separate storage and retention behavior. That does not establish any tenant's configuration, but it demonstrates why feature-level inventory is necessary: the user-facing task alone does not enumerate the copies.

Assign accountable decisions

A processing activity needs explicit decision authority. A senior owner may approve major purposes; a steward may administer access and retention; a custodian may implement storage controls; an independent reviewer may examine whether the design meets its conditions. Separating these responsibilities prevents implementation convenience from silently deciding the purpose.

In the GDPR, a controller determines purposes and essential means, while a processor is a separate entity processing on a controller's behalf. Actual activities determine these roles, not contractual labels or internal titles. A supplier can therefore have different roles for different activities, and a controller remains responsible for choosing and overseeing processors within the applicable framework.

A privacy impact assessment examines the nature and purpose of processing, necessity, alternatives, affected people, foreseeable consequences, safeguards, and remaining risk. A Data Protection Impact Assessment (DPIA) is a named legal assessment in GDPR contexts for processing likely to create high risk; its trigger and required consultation are jurisdiction-specific. An assessment is useful only when its conditions influence scope, mitigation, approval, or rejection and are revisited when the processing changes.

Decision responsibility

DecisionAccountable work
Add model-training reuseApprove the purpose and authority, identify affected people, set conditions, and accept or reject remaining risk
Admit an external recipientVerify the recipient, purpose, contractual role, onward sharing, region, and permitted fields
Implement restrictionsConfigure identities, policy checks, routing, storage, retention, and deletion behavior
Verify operationInspect specifications and mechanisms, interview responsible operators, and test expected behavior
Handle a challengeRestrict use when appropriate, inspect evidence, decide correction or other action, propagate the result, and communicate it

A reviewable decision record

  • Purpose and authorityThe precise outcome, applicable organizational and external authority, and affected information.
  • ConditionsAllowed actors, operations, recipients, regions, duration, safeguards, and prohibited reuse.
  • ResponsibilityThe accountable decision maker, implementers, reviewers, and complaint or correction owner.
  • UncertaintyUnresolved risks, rejected alternatives, evidence limits, and assumptions that must remain true.
  • ReconsiderationException expiry and triggers such as a new source, model, supplier path, recipient, incident, or purpose.

Distinguish people and actors

A digital identity distinguishes an actor within an online context. It need not establish a real-world identity, and one person can have several digital identities. Identity proofing validates evidence and attributes when real-world assurance is needed. Authentication verifies control of an authenticator bound to an account; authorization decides which operations that identity may perform on particular resources.

Do not collapse the actors

EntityRole in a requestAuthority to establish
Person described by the recordThe data subject or another affected personNot implied by the requester's login; disclosure and correction can affect this person
Authenticated requesterThe account initiating the operationWhat this requester may do in the current tenant and context
Executing application or agentThe service principal performing callsIts own powers and the delegated limits under which it acts
Resource serviceThe system holding the protected recordWhich current policy and target version govern the operation
RecipientThe person, team, or service receiving outputWhether this destination may receive the specific derived information

Delegation preserves the distinction between the represented party and the actor exercising delegated rights. OAuth token exchange, for example, can express subject and actor identities, but issuance and scope still depend on policy. The token's subject is not necessarily every person mentioned in the accessed records. The system must preserve tenant context and attributable actor identity through downstream calls instead of treating a broadly privileged service account as the user's authority.

A workshop on identity for AI agents demonstrates a useful boundary: signing into an agent establishes a user–agent relationship, while connecting an upstream account is a separate authorization step with additional scopes. Likewise, an agent's permitted task must remain bounded as explained in Agent Engineering. Neither step grants authority over every third party described in the resulting records.

Identity errors can invert governance outcomes. A mistaken record association may disclose another person's information, correct the wrong record, or delete the wrong person's material. Shared human accounts also erase attribution. Consequential requests therefore need proportionate requester verification, tenant-bound record matching, target validation, and a review path when identity remains uncertain.

Establish permitted uses

Permission is layered. Organizational approval answers whether the organization accepts a purpose and its risks. A legal ground may be required for personal-data processing. Contracts and licenses determine some acquisition, confidentiality, and reuse rights. Individual consent may authorize a specified activity where valid. A technical grant controls API access. Evidence for one layer does not establish the others.

Different permission questions

QuestionPossible evidenceWhat it does not establish
Did the organization approve the purpose?Decision record and accountable approvalExternal legal, contractual, or individual authority
Is there an applicable legal ground?Jurisdiction-specific analysis and required noticesCopyright permission, confidentiality rights, or technical access
Are acquisition and reuse authorized?License, contract, source documentation, confidentiality terms, or applicable exceptionData quality or authority over third-party personal information
Was valid consent obtained where relied upon?Contemporaneous notice, granular choice, actor, time, purpose, and withdrawal pathThat consent was freely given merely because a checkbox was stored
Can this identity call the service now?Current token, scope, resource policy, and target contextPermission for every processing purpose or downstream recipient

Under GDPR guidance, valid consent must be freely given, specific, informed, and unambiguous. The controller must be able to demonstrate what the person was told and how and when the choice was made; withdrawal should be as easy as giving consent. Employment relationships can undermine voluntariness. CNIL illustrates purpose specificity with company-event photographs: agreement to use an image in communications does not establish agreement to use it for AI training.

Consent is not the only possible authority for processing, and withdrawal does not mean every record must always be erased. Different purposes may have independently established authority, while exceptions or preservation obligations may apply. Conversely, a broad interface notice, public availability, or a supplier's bare assurance cannot manufacture permission. CNIL recommends examining third-party dataset sources, collection conditions, notices, legal grounds, and sharing terms; a contractual statement that consent exists is not the underlying evidence.

Implementable permission record

  • PurposeThe single processing purpose this record supports.
  • ScopeInformation, represented party, operations, recipients, and prohibited uses.
  • AuthorityThe organizational decision and applicable legal, contractual, licensing, consent, or delegation basis.
  • ConditionsEffective period, region, notice version, supplier restrictions, review triggers, and withdrawal handling.
  • EvidenceReferences to supporting records without copying unnecessary personal information into the permission record itself.

Transformation and access

Minimize without losing the task

Data minimization asks for the least information needed for the approved purpose across several dimensions: fields, number of people, precision, recipients, and duration. Start with the task. If support triage needs an issue description and product version, a direct email address, full account history, and exact location may be unnecessary even if they are available.

Sensitivity depends on consequences and context. UK GDPR special categories include health, genetic information, political opinions, religious beliefs, and biometrics processed for unique identification. Financial or commercially confidential information can be highly sensitive without falling into those categories. Intentionally inferring a protected attribute can matter even when the input fields appear ordinary.

Transformations make different claims

TransformationWhat changesWhat can remain
RedactionRemoves selected contentOther identifiers, surrounding context, and recoverable copies
PseudonymizationReplaces direct associations with pseudonymsLinkability across records and reidentification using separately held information
AggregationProduces group summaries rather than individual rowsDisclosure through small groups, repeated releases, or unusual combinations
Anonymization assessmentEvaluates whether identification remains reasonably possible in contextA conclusion limited to the release, auxiliary information, recipients, and threat assumptions assessed

A quasi-identifier is an attribute that can identify someone when combined with other information. Removing names is therefore not enough. Narayanan and Shmatikov showed that auxiliary knowledge of a few movie ratings and approximate dates could help link a person to a Netflix Prize rating record, exposing additional ratings. The research used specific datasets and assumptions; it demonstrates a mechanism, not a population-wide reidentification rate.

Before and after minimization

For a support-triage task that needs the issue and product version, reduction should preserve those facts while separately examining residual identification.
VersionInputAssessment
Original“Maya Chen, maya@example.test, enterprise tenant Northwind-Research, version 4.8: PDF exports omit table headers.”Contains direct contact information and a distinctive tenant name beyond the stated triage need.
Reduced“Enterprise tenant, version 4.8: PDF exports omit table headers.”Preserves the issue and version; the tenant class may still narrow identity and should be retained only if routing or reproduction needs it.
Further reduced“Version 4.8: PDF exports omit table headers.”Reduces exposure further; usefulness must be tested if tenant-specific configuration affects diagnosis.

Utility and privacy are separate tests. Research on privacy-preserving prompting found that acceptable reductions differed across tasks and models, while recovery tests showed that some transformed information remained inferable. Embeddings also require their own assessment: reconstruction research has recovered source text and names under particular encoder and access assumptions. Hashes, synthetic replacements, or vectors are transformations—not automatic anonymity guarantees.

Preserve origins and dependencies

Lineage records how identified information and artifacts originate and change. The W3C PROV model distinguishes entities, activities, and responsible agents. Derivation links a resulting entity to a source that affected it; attribution and association describe responsibility. These records are assertions, not proof that the source is true, the transformation was authorized, or the lineage is complete.

Version and granularity matter. A summary may depend on particular source records. An index entry may depend on one document version. A training dataset can be linked to a model version, but that coarse relationship does not show which training record caused a generated sentence. OpenLineage also distinguishes direct value transformations from indirect influences such as filtering or joining: a field can affect which output records exist without appearing in their values.

Lineage has different granularities

Example

Record-level derivatives can support targeted cleanup, while a dataset-to-model link is a coarser provenance claim.

Source version S7 directly contributes to a summary and search record and is selected into training dataset D3. Model M4 is trained from D3, but that relationship does not attribute a particular generated statement to S7. Responsible activities remain distinct from the artifacts they produce.
Read the diagram as text
  • Source S7. An identified and versioned source record with handling-policy references.
  • Summarization activity. Creates a derived record while retaining the source dependency.
  • Summary R2. Record-level lineage can identify S7 as a contributor.
  • Indexing activity. Creates a search representation for S7.
  • Search record I9. Stable source and chunk identities support targeted update or removal.
  • Training dataset D3. Contains selected examples, including a version derived from S7.
  • Training activity. Changes model parameters using the dataset.
  • Model M4. Dataset-level provenance links M4 to D3, not each output to each record.
  • Source S7Summarization activity: data: source input.
  • Summarization activitySummary R2: derivation: produces.
  • Source S7Indexing activity: data: source input.
  • Indexing activitySearch record I9: derivation: produces.
  • Source S7Training dataset D3: selection: contributes example.
  • Training dataset D3Training activity: data: training input.
  • Training activityModel M4: derivation: produces parameters.

Synthesized context makes this operational. A fact created from chat, documents, or business records may not appear verbatim in any source, and the sources may carry different authority. The provenance for LLM-built knowledge graphs talk describes retaining source episodes and linking derived facts back to them. When entities merge, their source relationships must survive; when a fact changes, the evidence responsible for invalidation should remain inspectable.

Lineage should carry purpose and handling references without becoming an unrestricted duplicate of source content. Keep stable source and artifact identifiers, versions, transformation identity, responsible actor, timestamps, and policy references. Retain source payloads only under their own access and retention rules. When sources are combined, preserve each source relationship so policy can evaluate the resulting artifact explicitly.

Enforce current authority

A policy affects behavior only when an enforcement mechanism controls the protected operation. Least privilege limits each actor to necessary authority. Complete mediation requires authorization checks for every access path, including recovery and maintenance. Fail-safe defaults deny access without explicit permission. A model instruction or tool description can express intent, but the model must not be able to bypass or modify the enforcement point.

Role-based access control assigns permissions through roles. Attribute-based access control (ABAC) evaluates attributes of the requester, resource, operation, and environment against policy. ABAC can express conditions such as tenant, record classification, purpose, action, destination, and time. Whatever vocabulary is used, authorization must reach copied indexes, caches, and downstream services; organizing documents into categories is not enforcement.

Authority is operation-specific. Permission to read a record does not imply permission to send it to an external recipient or modify it. Rich Authorization Requests can represent structured details such as operation, amount, recipient, or file path, but the resource server must enforce the approved details. A proposed record change also needs target validation and factual review. An HTTP If-Match precondition can reject a write if the reviewed version became stale; a matching version establishes neither authority nor correctness.

Long-running work creates a time-of-check problem. A task can retrieve material while permission is valid, continue computing after revocation, and later attempt a disclosure. Google Zanzibar's 2019 design illustrates coordination between content and authorization versions so checks can respect relevant permission changes. Its guarantee depends on participating clients following the consistency protocol; it does not automatically govern copied summaries or external recipients.

Authority can change before the effect

Example

A permitted read does not establish continuing permission for a later disclosure.

1 / 3 · Read under an active grant

The read enforcement point checks current policy and permits the source read. The application creates a working result.

The requester reads the source through one authorization check and later submits the working result to a separate check at the disclosure boundary. Permission is valid when the source is read, then a distinct revocation state becomes current. The external disclosure is denied under current policy; the historical grant explains the earlier read but does not authorize the later effect.
Read the diagram as text
  • Requester. Authenticated in tenant A.
  • Protected source. A tenant A record.
  • Policy service. Supplies current authorization state.
  • Read enforcement point. Checks current authority before releasing the protected source.
  • Disclosure enforcement point. Checks current authority before sending the working result.
  • Read grant active. Historical state permitting the initial read.
  • Working result. Computation derived from the permitted read.
  • Disclosure permission revoked. New current state established while computation continues.
  • External recipient. Proposed destination for the result.
  • Disclosure denied. The effect is blocked under current policy.
  • RequesterRead enforcement point: control: request read.
  • Read grant activePolicy service: state: initial authority.
  • Policy serviceRead enforcement point: control: read decision.
  • Read enforcement pointProtected source: data: authorized read.
  • Protected sourceWorking result: data: derive result.
  • Disclosure permission revokedPolicy service: state: current authority.
  • Working resultDisclosure enforcement point: data: proposed disclosure.
  • Policy serviceDisclosure enforcement point: control: disclosure decision.
  • Disclosure enforcement pointDisclosure denied: control: deny effect.
  1. Read under an active grant. The read enforcement point checks current policy and permits the source read. The application creates a working result. Active: Requester, Protected source, Policy service, Read enforcement point, Read grant active, Working result. New: Requester, Protected source, Policy service, Read enforcement point, Read grant active, Working result.
  2. Permission changes. The historical grant remains visible as the reason the read occurred, while a distinct revocation state becomes current. Active: Requester, Protected source, Policy service, Read enforcement point, Read grant active, Working result, Disclosure permission revoked. New: Disclosure permission revoked.
  3. Recheck before disclosure. The application submits the retained result to the disclosure enforcement point. Current policy produces an explicit denial, so no payload is sent. Active: Requester, Protected source, Policy service, Read enforcement point, Disclosure enforcement point, Read grant active, Working result, Disclosure permission revoked, External recipient, Disclosure denied. New: Disclosure enforcement point, External recipient, Disclosure denied.

The practical rule is simple: recheck current authority immediately before a consequential disclosure or mutation, using the actual requester, acting service, resource, action, recipient, and relevant policy state. The model may propose an operation, while Structured Outputs and Tool Calling explains validation at the proposal boundary. AI Security covers malicious attempts to redirect that proposal; governance still defines the allowed effect.

Control derived disclosures

An output can reproduce a fact, combine several facts, or infer a new attribute. Disclosure should therefore be evaluated using the output's content, purpose, audience, and destination—not merely the requester's ability to read each input. A permitted internal answer can become an impermissible external export when the recipient or downstream reuse changes.

Information-flow control constrains where information may travel as it is transformed. Myers and Liskov's October 1997 decentralized model attached owners and permitted readers to information. Combining two values preserved both restrictions: if one source allowed readers r1 and r2 while another allowed r2 and r3, their combined value could flow to r2, the common permitted reader. Relaxing an owner's restriction—declassification—required that owner's authority. Applying this formal model to AI requires an actual enforcement implementation; the paper does not prove that an LLM will obey labels.

Combined information preserves both source restrictions

A result derived from two sources can flow only to readers permitted by every contributing source policy.

Source A permits r1 and r2; source B permits r2 and r3. Their combined value may flow to r2, the only common permitted reader. Relaxing either source restriction requires authority for that source’s owner, and no declassification occurs here. An enforcement implementation is still required; labels alone do not constrain an LLM.
Read the diagram as text
  • Source A: {r1, r2}. Owner A permits readers r1 and r2.
  • Source B: {r2, r3}. Owner B permits readers r2 and r3.
  • Combined value: {r2}. The result preserves both policies, leaving their common permitted reader.
  • Reader r2. The only reader permitted by both contributing sources.
  • Reader r1 excluded. Permitted by Source A but not Source B, so the combined value cannot flow here.
  • Reader r3 excluded. Permitted by Source B but not Source A, so the combined value cannot flow here.
  • Owner-authorized declassification. A possible policy change requiring authority for the owner whose restriction would be relaxed; it is not exercised in this example.
  • Source A: {r1, r2}Combined value: {r2}: contributes value and policy.
  • Source B: {r2, r3}Combined value: {r2}: contributes value and policy.
  • Combined value: {r2}Reader r2: permits disclosure.

Implementation semantics can be subtle. Zep documents that a search result can match a metadata filter when at least one associated source episode satisfies it, while access policy evaluates effective metadata combined from associated episodes. A source filter therefore answers “can this artifact be found through this source?” rather than “do all contributing sources permit this recipient?” Those questions must not share an accidental boolean shortcut.

Sensitivity labels and output redaction can support decisions but do not replace authorization. Microsoft documents conditional label inheritance for supported Copilot content paths, while also documenting separately retained artifacts. The application must still identify the recipient, purpose, contributing sources, and permitted reuse. A personal assistant may choose a private channel instead of a group response, as one family-and-friends agent talk describes, but reliable routing requires verifiable audience and channel policy rather than model discretion alone.

Finally, keep a generated assertion distinct from an approved record change. An answer may be labeled as an inference with source links and uncertainty. Writing that claim into a customer, medical, or employment record can require stronger evidence, an authorized reviewer, a version precondition, and a correction path. Fluent text is not a change authorization.

Retention and changed rights

Set artifact lifetimes

Retention keeps information available over time. A retention rule should name the continuing purpose, clock-start event, review or expiry condition, authorized readers, disposition action, and owner of any exception. Indefinite retention needs an actual continuing justification rather than cheap storage or imagined future usefulness.

Records schedules distinguish active use, cutoff, a retention period, and eventual destruction or transfer. NARA's guidance illustrates event-based triggers such as case closure and age-based triggers measured from creation or receipt. It supplies a scheduling model, not durations for private AI systems. An applicable, separately established preservation duty can postpone the scheduled disposition.

Artifact-specific retention

The entries below identify decisions rather than universal durations.
ArtifactContinuing purpose and triggerDisposition questions
Source recordsOperational, contractual, or record purpose; trigger may be case closure or relationship endDelete, archive, restrict, or preserve under an applicable exception
Model requests and outputsUser-visible history, safety review, or dispute handling; trigger may be response completionCan selected metadata replace full content? Are provider copies governed separately?
Traces and logsSpecific diagnostic, security, or accountability question; trigger may be event creationExclude secrets and unnecessary payloads; control access, exports, backups, and disposal
Indexes and memorySearch or continuity purpose; trigger follows source expiry, correction, or relationship endPropagate permissions and deletion; prevent restoration from stale sources
Evaluation and training datasetsApproved evaluation or learning purpose; trigger may be experiment or model lifecycleTrack source dependencies, permitted reuse, versions, and resulting model artifacts
Provider application stateFeature operation under supplier terms; trigger and eligibility are feature-specificVerify settings, exceptions, third parties, and deletion support
BackupsRecovery purpose; trigger follows backup generation and rotation policyPlace erased information beyond use while awaiting overwrite and prevent restoration to active processing
Model artifactsApproved deployment and reproducibility purpose; trigger may be replacement or withdrawalGovern learned influence, access, provenance, and retired checkpoints separately

Auditability does not require indiscriminate payload retention. A decision record can preserve actor, operation, artifact and version reference, policy result, effect, time, and reviewer while sensitive evidence remains separately access-controlled and expires under its own rule. OWASP advises excluding credentials, tokens, sensitive personal data, and payment information from ordinary logs unless appropriately protected. Observability develops diagnostic signal design; Agent Memory covers retained information across interactions.

Backups require explicit communication. Under ICO erasure guidance, information may be removed from live systems while backup copies await scheduled overwrite, but those copies should remain beyond use and not be restored for another purpose. Exceptions can apply. “Deleted from the active database” and “physically absent from every backup” are therefore different completion claims.

Respond to changed authority

Changed authority is not one operation. Consent withdrawal stops processing that depended on that consent, subject to applicable distinctions and exceptions. Access revocation disables a credential or permission. Restriction limits processing while a dispute or objection is resolved. Rectification addresses inaccurate information. Erasure addresses qualifying records. Each has different triggers, targets, and completion evidence.

Do not collapse unlike requests

ChangeImmediate questionPossible continuing state
Consent withdrawalWhich purposes relied on this consent, and how is future processing stopped?Records may remain for another independently established purpose or applicable obligation
Credential or access revocationWhich tokens, sessions, API keys, jobs, and downstream grants remain active?Existing records may remain while future access is blocked
Restriction or objectionWhich processing must pause while grounds or accuracy are examined?Storage can continue under limited conditions
RectificationWhat does the record assert, what evidence bears on accuracy, and who decides?An accurate history of the former error or dispute can remain alongside correction
ErasureWhich active, derived, supplier, and backup copies are covered, and which exceptions apply?Backup disposal or learned influence may remain unresolved and must be described accurately

A disputed inference needs careful classification. ICO guidance distinguishes incorrect or misleading factual information from a record clearly identifying an opinion and, where appropriate, its author. That does not make every AI inference an exempt opinion. The organization should examine what the record asserts, the consequences of continued use, the person's evidence, and whether processing should be restricted during review.

Revoking single sign-on may leave independent access paths. In a cross-app access talk, incident response invalidated network and Okta sessions while separately configured MCP tokens and API keys still required inventory and revocation. Token survival depends on each service's behavior, but the example shows why one identity lifecycle cannot be assumed to cover every credential.

Response record

  • Requester and authorityHow identity and any representative authority were verified proportionately.
  • TargetsThe records, purposes, credentials, derived artifacts, recipients, and pending operations affected.
  • Interim controlAny restriction needed while accuracy, authority, or scope is investigated.
  • DecisionResponsible reviewer, evidence, rationale, exceptions, and resulting disposition.
  • Propagation and communicationDownstream actions, unresolved states, and the outcome communicated to the affected person.

Propagate correction and deletion

Propagation begins with stable identities and observable change records. A deletion marker, or tombstone, lets asynchronous consumers learn that a source was removed. The system must keep the marker long enough for delayed indexers and failed jobs, prevent stale events from recreating the record, and verify derived cleanup before purging the evidence needed to coordinate it.

Source deletion is not automatically index deletion. Azure AI Search documents that physical blob deletion alone does not remove the corresponding search document. Deletion detection must be configured, and a soft-deletion marker must remain observable long enough for the indexer to process it. Adding a policy after missed deletions cannot reconstruct those events. Stable source and chunk identities are essential, especially when one source produces several derived documents.

Even a graph-aware deletion can leave derived information. Zep documents that deleting an episode removes nodes and edges only under specified association conditions, while shared names and summaries are not regenerated and may retain information from the deleted episode. A successful episode-deletion response therefore establishes a bounded operation, not removal of all derived content.

Deletion has several completion states

Example

Future use can be blocked before every active derivative and backup copy has been disposed of.

1 / 3 · Block future use

A durable deletion marker updates current policy before asynchronous cleanup is complete.

The source, derived search record, backup, policy service, and deletion marker keep stable identities. First, a tombstone blocks future use. Next, the active source and search derivative are removed and verified. The backup remains beyond use until scheduled disposal, so active deletion can be complete while physical disposition is still pending.
Read the diagram as text
  • Source record. The active record targeted by an approved deletion decision.
  • Search derivative. An index entry linked to the source identity.
  • Backup copy. A recovery copy governed by rotation and beyond-use controls.
  • Policy service. Blocks future processing and restoration under current state.
  • Deletion marker active. Makes the changed decision observable to asynchronous consumers.
  • Future use blocked. Reads, jobs, and exports are denied while cleanup continues.
  • Active copies removed. The source and linked search derivative are deleted and checked.
  • Backup awaiting disposal. The copy is beyond use and remains pending scheduled overwrite.
  • Deletion marker activePolicy service: state: deletion required.
  • Policy serviceFuture use blocked: control: deny future use.
  • Source recordActive copies removed: disposition: delete active source.
  • Search derivativeActive copies removed: disposition: remove linked derivative.
  • Backup copyBackup awaiting disposal: disposition: place beyond use.
  • Deletion marker activeBackup awaiting disposal: control: prevent restoration.
  1. Block future use. A durable deletion marker updates current policy before asynchronous cleanup is complete. Active: Source record, Search derivative, Backup copy, Policy service, Deletion marker active, Future use blocked. New: Source record, Search derivative, Backup copy, Policy service, Deletion marker active, Future use blocked.
  2. Remove active copies. The source and linked search derivative are deleted and their active absence is verified. The backup still exists. Active: Source record, Search derivative, Backup copy, Policy service, Deletion marker active, Future use blocked, Active copies removed. New: Active copies removed.
  3. Track backup disposition. The backup is placed beyond use and cannot restore the deleted record, but physical disposal remains pending under the rotation schedule. Active: Source record, Search derivative, Backup copy, Policy service, Deletion marker active, Future use blocked, Active copies removed, Backup awaiting disposal. New: Backup awaiting disposal.

Propagation obligations

  • Block future useApply current restriction at reads, jobs, exports, and writes before cleanup finishes.
  • Stop or fence pending workPrevent queued ingestion, delayed retries, and long-running jobs from recreating obsolete state.
  • Remove or rebuild derivativesDelete affected index entries, caches, summaries, and evaluation copies, or recompute them from permitted sources.
  • Coordinate suppliersRequest deletion or return and track the scoped result and any unresolved exceptions.
  • Protect restorationKeep backup copies beyond use and replay current tombstones or policy state before restored data becomes active.
  • Communicate scopeReport what is blocked, removed, awaiting disposal, excepted, or unresolved rather than returning one ambiguous success flag.

Search visibility is also separate from deletion acknowledgement. Some stores expose deletion only after a refresh, while retained replay windows can allow late events to recreate state. Verify the user-visible search result, the underlying active record, each derived copy, and the restoration path independently. The next section treats model parameters separately because they are not deletable rows.

Address learned influence

Training changes learned parameters, so removing a training record does not reverse its contribution. Machine unlearning refers to attempts to remove selected training influence from a learned model. The claim is stronger than deleting the dataset or suppressing a few outputs and needs its own evidence.

Cao and Yang's 2015 work made the distinction explicit: retraining after removing records is conceptually straightforward but can be expensive, while their evaluated alternative reorganized suitable algorithms around stored sums so selected contributions could be subtracted. Their experiments included recommendation, spam, and malware tasks. This does not establish an unlearning method for arbitrary large language models; training mechanics belong in Pretraining and Midtraining.

Different responses make different claims

ResponseWhat changesEvidence still needed
Delete training recordStored dataset and its ordinary derivativesProof of propagation; no claim that learned influence changed
Retrain with excluded recordsParameters produced by a new training runVerified exclusion, baseline and pipeline provenance, evaluation, and deployment replacement
Apply an unlearning methodSelected parameter state under the method's assumptionsMethod-specific removal and utility tests, threat model, and resistance to misleading verification
Replace the modelDeployed artifact and future request pathApproval of the replacement's data, supplier, behavior, and handling conditions
Restrict deploymentWho can use the existing artifact and for what purposeEnforced scope, monitoring, review trigger, and accurate statement of unresolved influence

Verification is fragile. Research on image-classification datasets demonstrated methods by which a dishonest provider could pass studied unlearning checks while preserving information associated with supposedly removed data. The result is bounded to its attacks and experiments, but it establishes an important governance rule: a passing check supports only the removal property, model family, and adversary conditions assessed.

A model trained on personal information is not automatically anonymous. The European Data Protection Board calls for examining extraction and identification through queries, release context, auxiliary information, and reasonably available means. When complete removal of influence is not established, governance may require retraining, replacement, narrower deployment, or an explicit unresolved limitation rather than a claim that the model has forgotten.

Suppliers and assurance

Approve actual service paths

Supplier approval attaches to an actual path: product, endpoint, feature, model version, settings, deployment region, organizational recipients, contractual role, human-access rules, and additional suppliers. “We use provider X” is not precise enough because different features can have different storage requirements and eligibility for restrictive controls.

A data processing agreement (DPA) defines processing obligations where that relationship applies. A subprocessor is another processor engaged in the processing chain. Review its actual activity, location, safeguards, change-notification terms, audit support, and exit behavior. Contracts allocate obligations but do not prove operational fulfillment.

Separate the questions vendors often compress. “Not used for training” does not mean “not stored”: logs, application state, files, caches, and human review can follow different rules. Data residency concerns storage location, while regional processing concerns computation location. Verify both for the selected feature and deployment path.

Review each request path separately

  • Use and storageVerify training use, feature-required state, retention triggers, deletion support, and documented exceptions.
  • Recipients and locationIdentify the provider, infrastructure route, support access, subprocessors, and storage and processing regions.
  • Exit and changeDefine export, deletion or return, replacement behavior, and renewed review when a model, feature, fallback, setting, or supplier changes.

Apple's Private Cloud Compute (PCC) provides a bounded architecture example. Its June 10, 2024 introduction stated requirements to use personal inputs only to fulfill the request, retain none after returning the response, and prevent privileged operators from bypassing those limits. The design removed general-purpose administrative paths and described direct encryption to validated nodes and deletion on completion. These are Apple's architecture assertions, not a universal property of cloud inference or an independent audit.

On June 8, 2026, Apple announced extending PCC onto Google Cloud infrastructure with NVIDIA GPUs while retaining its declared handling requirements and Apple-controlled software trust. The announcement described a preview that would gradually reach the complete protections. It illustrates why an infrastructure or supplier change requires renewed review even when the intended product capability is unchanged; it does not establish that every promised protection or research resource was later completed.

Self-hosting changes responsibility rather than eliminating it. Operators take on more patching, capacity, availability, inference-server, and storage work while remaining responsible for application authorization and appropriate data use. Managed services transfer some operational work under service-specific terms. Deployment choices belong in Local and On-Device AI, while dispatch and fallback policy belongs in Model Routing and LLM Gateways.

Verify and revisit decisions

Governance becomes assurance when each material requirement has an owner, implementation point, assessment method, expected outcome, and response to failure. NIST control-assessment guidance distinguishes examination of specifications and mechanisms, interviews about operation, and tests that exercise controls under stated conditions. Evidence supports only the scope and conditions assessed.

Requirement-to-check matrix

RequirementEnforcement and ownerAssessment and expected outcomeWhat remains separate
Unauthorized recipients cannot retrieve or receive restricted materialRead and disclosure policy; application ownerNegative tests across tenants and destinations are denied and recordedSupplier internal access and undiscovered bypass paths
Permission changes affect later operationsCurrent authorization check; identity and service ownersRevoke during a long-running task; later disclosure or write is deniedAlready authorized copies and external recipients
Training reuse is disabledDataset export and provider project controls; data ownerInspect configuration and attempt prohibited export; no training dataset or eligible provider path is createdProvider internal behavior, requiring contractual or supplier evidence
Deletion reaches derived stateTombstone, lineage, index cleanup, supplier workflow; storage ownerDelete a source, verify search absence, summary regeneration, supplier status, and restore behaviorLearned influence and lawful preservation exceptions
Record changes require correct authority and target versionWrite policy, review gate, and version precondition; record ownerUnauthorized, stale, and wrong-target writes fail without mutationTruth of an approved new value
Telemetry excludes unnecessary sensitive contentInstrumentation and collector rules; observability ownerInspect emitted records and send seeded sensitive fields; fields are absent or transformed as specifiedUnknown fields and downstream retention or access

Different evidence establishes different facts. An application test can show routing behavior but not a provider's undisclosed internal retention. A contract can establish an obligation but not a tenant's configuration. A configuration screenshot cannot prove runtime enforcement. Execution records help reconstruct effects but may be incomplete or overly sensitive. Supplier attestations support their stated scope rather than universal compliance.

Telemetry is itself governed information. OpenTelemetry advises collecting attributes that serve a diagnostic purpose and using processors to remove fields, filter records, transform values, or enforce allowlists. The OpenLLMetry talk describes placing such preprocessing in a self-deployed collector before export. Installing a collector proves nothing about its rules; seeded tests and inspection of actual exported records are still required.

Reviews should be triggered by new purposes, sources, recipients, models, features, supplier paths, retention terms, legal conditions, incidents, or evidence that a control failed. When a violation occurs, stop or contain affected processing, preserve only necessary evidence with provenance and restricted access, identify affected records and people, correct or delete state as appropriate, communicate through the accountable process, and require renewed approval before resuming. AI Security covers incident mechanics; Evals and Benchmarks covers broader behavioral evaluation.

The resulting discipline is continuous but not vague: decide a specific purpose, inventory the real path, identify actors, establish authority, minimize inputs, preserve dependencies, enforce current policy, set artifact lifetimes, propagate changes, verify scoped outcomes, and reconsider the decision when its assumptions change. Governance succeeds when an approved handling decision remains true in the running system—and when the organization can detect, explain, and repair the cases where it does not.

Open questions

  1. How can organizations verify removal of learned influence at useful scale? Retraining can be expensive, and studied unlearning checks can be fooled under bounded attack models. Progress would require model-appropriate removal definitions, reproducible adversarial verification, and honest deployment decisions when influence remains uncertain.

  2. How should mixed-source permissions compose in real AI applications? Operational metadata systems can apply different semantics to source filtering and access-policy evaluation. Progress would require tested lineage and policy behavior for summaries, inferred facts, exports, and permission changes.

  3. How can privacy-minimal evidence support strong assurance? Complete prompts and tool results aid investigation but create another sensitive dataset; sparse logs can omit the cause of failure. Progress would define question-driven evidence schemas, protected linkage to separately retained source material, and tests showing that investigators can reconstruct consequential decisions without indiscriminate payload capture.

  4. How should governance adapt when supplier infrastructure changes beneath a stable product interface? A model, fallback, region, feature, or subprocessor can change handling boundaries without changing the visible task. Progress would include machine-readable service-path declarations, configuration-linked change notices, and blocking when a path no longer satisfies approved conditions.

Follow the curated reading path through the speakers and demonstrations behind this entry.

82 min

AI Engineer Code 2025 · 2025

Identity for AI Agents

Cited in this entry

Separates authentication to an agent from authorization to an upstream account, making delegated identity and permission boundaries concrete.

Watch talk
9 min

AI Engineer Summit 2025 · 2025

OpenLLMetry is all you need

Nir Gazit

Cited in this entry

Provides a practical placement for telemetry filtering before export while leaving configuration coverage and validation as explicit engineering responsibilities.

Watch talk

Explore more talks

The rest of the library, beyond the curated path. Cited talks support this entry; reviewed transcripts were processed in full. Metadata candidates have not been reviewed as sources or verified as topic members.

24 matching talks

TalkSpeakerEventYear
Sumit AgarwalAI Engineer World's Fair 20242024
Daniel WhitenackAI Engineer World's Fair 20242024
Thierry Moreau, Pedro TorruellaAI Engineer World's Fair 20242024
Uday Kiran Medisetty, Adam HudaAI Engineer World's Fair 20262026
Ofer MendelevitchAI Engineer Summit 20252025
Lovina DmelloAI Engineer World's Fair 20262026
Eliza Cabrera, Jeremy SilvaAI Engineer World's Fair 20252025
Andreas KolleggerAI Engineer World's Fair 20252025
Christopher Lovejoy, Saul HowardAI Engineer World's Fair 20262026
Michael GrinichAI Engineer World's Fair 20252025
Nina Lopatina, Rajiv ShahAI Engineer World's Fair 20252025
Rachna SrivastavaAI Engineer World's Fair 20252025
Sam JulienAI Engineer World's Fair 20252025
Ravi MadabhushiAI Engineer World's Fair 20262026
Sarthak AggarwalAI Engineer World's Fair 20262026
Jared HansonAI Engineer World's Fair 20252025
Bobby Tiernay, Kam SweenAI Engineer World's Fair 20252025
Calvin Qi, Chang SheAI Engineer World's Fair 20252025
Sumaiya ShrabonyAI Engineer World's Fair 20262026
Sai Krishna RallabandiAI Engineer World's Fair 20262026
Jonathan MortensenAI Engineer World's Fair 20252025
Mike BursellAI Engineer World's Fair 20252025
Carter Abdallah, Vincent Weisser, Lucas Atkins, Chris AlexiukAI Engineer World's Fair 20262026
AI’s Jurassic Park Period

Transcript reviewed

Aaron StanleyAI Engineer World's Fair 20262026

References

Coverage and source review
Processed transcripts
28 processed in full · 4 in the curated path
Automated source review
Passed
Metadata candidates
0 unreviewed; not verified topic membership
Corpus version
1bd8e407b26a07b33815594e1b2db5f41827119a2b3cb6fbf240f9fc571fc767

Automated review checks source support; it is not publication approval.

A synthesis of selected conference talks and technical references. Citations link to the source material; they do not imply that every talk on this subject is included.

  1. NISTIR 8062: An Introduction to Privacy Engineering and Risk Management in Federal Systems

    NIST distinguishes privacy risks arising from planned, authorized processing from security risks involving unauthorized activity. A system can meet its intended operational purpose while creating adverse consequences for people. The report uses persistent activity monitoring to illustrate how a security measure can reveal information unrelated to its security purpose. Privacy engineering therefore requires examining what processing does to people, alongside protecting information against unauthorized access.

  2. UK Government: Data ownership model

    This model treats data ownership as organizational accountability rather than possession. Senior data owners decide major uses and changes, understand flows and ensure retention arrangements. Stewards manage daily governance, maintain definitions, coordinate access and deletion, and escalate issues. Technical custodians implement storage, disposal and access policies and make changes auditable. The guidance identifies unclear responsibilities as an obstacle to sharing and reusing data across organizations.

  3. Regulation (EU) 2016/679: definitions, processing principles and correction

    Personal data concerns an identified or identifiable person, called the data subject; identification can be indirect. Processing includes storage, use, alteration, disclosure and erasure. Pseudonymization separates identifying information under safeguards rather than necessarily removing identifiability. Purpose limitation constrains collection and incompatible subsequent use; minimization limits data to what the purpose requires; storage limitation constrains identifiable retention. Accuracy, security and lawfulness are separate requirements. Article 6 provides multiple lawful grounds, so consent is not universally required. Article 16 addresses rectification; Article 19 requires communicating qualifying corrections, erasures and restrictions to recipients, subject to impossibility or disproportionate effort.

  4. Saltzer and Schroeder: Basic Principles of Information Protection

    Least privilege limits each program and user to the authority needed for its task, reducing the damage from error or compromise. Complete mediation requires authorization checks for every access, including lifecycle paths such as recovery, and reliable identification of the requester. Cached authorization decisions must account for changed permissions. Fail-safe defaults make access depend on explicit permission. Applied to an agent, these principles require enforcement where a proposed operation actually reaches a protected resource; a model promise or a tool description is not that enforcement.

  5. OECD Recommendation: Guidelines Governing the Protection of Privacy and Transborder Flows of Personal Data

    The OECD guidelines connect privacy protection with cross-border information flows. Purposes should be specified by collection time, and subsequent uses constrained by compatibility and stated changes of purpose. The revised recommendation makes accountability operational through a privacy management programme proportionate to processing scale and sensitivity, integrated oversight, risk assessment, monitoring and periodic reassessment. Controllers remain accountable for personal data under their control regardless of its location.

  6. LLM Quality Optimization Bootcamp

    Real production prompts paired with responses from a stronger LLM are presented as a middle ground between fully human and fully synthetic training data.

  7. CNIL: Ensuring the lawfulness of the data processing—Defining a legal basis

    Valid GDPR consent must be freely given, specific, informed and unambiguous. CNIL illustrates purpose specificity with company-event photographs: agreement to use an image for communications does not establish agreement to reuse it for AI training. Separate purposes require granular choices when relying on consent. Employment relationships can undermine voluntariness; the guidance describes employee consent as exceptional, requiring refusal and withdrawal without adverse consequences. Including product-improvement processing in contractual terms does not itself make that processing necessary to perform the service contract.

  8. CNIL: Ensuring the lawfulness of data processing—Additional verifications when reusing data

    CNIL distinguishes reusing an organization's own data, downloading public datasets and acquiring datasets from suppliers. Compatibility review considers the original purpose, collection context, reasonable expectations, sensitivity, consequences and safeguards. For acquired datasets, recommended documentation covers sources, collection circumstances, legal basis, notices and sharing conditions. A contractual promise that a supplier obtained consent is insufficient proof that valid consent exists; arrangements should provide the underlying evidence. Using statistical machine-learning techniques does not automatically make the processing a statistical purpose under the GDPR.

  9. U.S. Copyright Office: Copyright and Artificial Intelligence, Part 3—Generative AI Training

    The report distinguishes internet availability from authorization. Downloading and preparing copyrighted training material can implicate reproduction rights. Different uses during development and deployment require separate consideration. Fair use depends on circumstances including the works, their source, the purpose and output controls; the report does not declare all training permissible or infringing. Voluntary licensing can authorize uses and impose contractual conditions, but availability varies across sectors. The Office recommends allowing licensing markets to develop rather than immediately imposing a compulsory regime.

  10. Records, Computers and the Rights of Citizens: Summary and Recommendations

    The HEW committee identified an imbalance: computerization expanded organizations’ capacity to collect, link and use records while individuals had fewer ways to influence their handling. It proposed fair-information safeguards covering openness about record systems, access to information and its uses, control over secondary uses, correction, reliability and protection against misuse. Its concern about Social Security numbers becoming general identifiers connected privacy risk to linkage across otherwise separate systems.

  11. Privacy by Design: The 7 Foundational Principles

    Ann Cavoukian describes developing Privacy by Design during the 1990s in response to expanding networked information systems. The approach extends beyond privacy-enhancing technologies to business practices and infrastructure. Its principles call for preventive design, protective defaults, privacy embedded in functionality, lifecycle protection, transparency and independent verification. It asks designers to pursue legitimate functionality and privacy together rather than assume that protecting privacy necessarily requires abandoning the service.

  12. Beyond Memorization: Violating Privacy via Inference with Large Language Models

    The free-text experiment gives pretrained models author-grouped Reddit comments through a fixed prompt, without subreddit metadata or added retrieval information, and asks for personal attributes. Evaluation uses 520 profiles and 1,066 author-annotated labels meeting a certainty threshold; GPT-4 reaches 85.5% top-one accuracy across attributes. An introductory example infers Melbourne from a commuting comment mentioning a locally characteristic turning maneuver, illustrating location inference without an explicit address or name.

  13. NIST Privacy Framework 1.0: lifecycle and minimized audit evidence

    The framework inventories data elements, processing purposes, actions, owners and flows. Policies define permitted uses and retention periods; the data lifecycle aligns with system development and operations. Authorizations must be maintained and revocable, access limited by least privilege, and deletion and destruction performed under policy. Audit records themselves must incorporate data minimization. Engineering application: define the decision evidence needed for review, its purpose, authorized readers, retention trigger and disposal method before logging. Retain the necessary decision, model and policy versions and relevant evidence without indiscriminately copying personal data into logs, prompts or backups. Where review requires sensitive evidence, constrain fields, access and retention rather than treating auditability as permission to keep everything. Assess removal and disclosure across downstream copies and service providers.

  14. ICO: Data protection impact assessments

    A DPIA systematically examines a project’s processing and risks to people. The ICO calls for describing nature, scope, context and purposes; assessing necessity and proportionality; identifying risks and mitigations; consulting relevant stakeholders; documenting decisions; and implementing identified measures. It distinguishes legally required assessments for likely high-risk processing from good practice for other major personal-data projects. Its checklist calls for renewed assessment when processing changes and a documented review schedule.

  15. LLM Safeguards: Security, Privacy, Compliance, Anti-Hallucination

    Treat a model server as an API service requiring endpoint monitoring and ordinary infrastructure security.

  16. Microsoft: How data is protected and audited in Microsoft 365 and Microsoft Copilot

    Microsoft documents that Copilot summarizes or references content the user is authorized to access. For supported content-generation paths, new content inherits the highest-priority sensitivity label among labeled sources; Copilot Chat can also display source sensitivity. The system creates additional governed artifacts: interaction records, retained versions of referenced files, uploads in OneDrive and Copilot Pages in SharePoint Embedded containers. Retention and deletion depend on configured Purview policies.

  17. Text Embeddings Reveal (Almost) As Much As Text

    Text embeddings represent text numerically for uses including retrieval, but that transformation need not conceal the source. The authors train Vec2Text to reconstruct inputs from embeddings and demonstrate recovery of names from clinical-note embeddings. Their threat model includes access to embeddings and text–embedding pairs from the relevant encoder. The experiments provide a concrete reason to include retrieval representations in sensitive-data inventories rather than treating them as automatically anonymous.

  18. Towards Making Systems Forget with Machine Unlearning

    Cao and Yang distinguish removing training records from reversing their effects on learned features and models. Retraining after removing records supplies a straightforward but potentially expensive approach. Their alternative restructures suitable learning algorithms around stored sums, subtracts the removed samples’ contributions and updates the model. Evaluations include a recommendation system, spam filtering and malware detection. Their broader proposal treats forgetting as a problem of both completeness and timeliness across derived information.

  19. OpenTelemetry: Handling sensitive data

    Telemetry instrumentation cannot determine on its own which fields are sensitive in a particular application. OpenTelemetry recommends collecting only attributes that serve an observability purpose, reviewing instrumentation output, and considering aggregates or anonymized data. Collector processors can remove attributes, filter whole records, transform values, or enforce an attribute allowlist. This makes observability a data-design decision: retain enough context to answer a specific diagnostic question, while recognizing that full prompts, tool results, tokens, and identifiers can create an additional sensitive dataset.

  20. NIST AI Risk Management Framework 1.0

    NIST organizes lifecycle risk work into Govern, Map, Measure and Manage. Identify affected populations and deployment context, consult relevant communities, evaluate harmful bias and document results rather than relying only on aggregate performance. Assign clear responsibilities, executive accountability and human-oversight roles. Evaluate under conditions resembling deployment, document limits and unmeasurable risks, and monitor after release. Engineering implication: material subgroup harms or ineffective oversight should affect deployment scope, mitigations and whether to proceed, with explicit ownership of acceptance and incident decisions.

  21. EDPB Guidelines 07/2020 on controller and processor

    Controller and processor roles follow actual activities rather than contractual labels. A controller determines purposes and essential means; a processor is a separate entity processing on its behalf. The controller is ordinarily the organization, not its individual employee. A subprocessor is another processor engaged within that processing chain. Engagement requires prior specific or general written authorization, with change notification and opportunities to object under general authorization. Assessment includes intended subprocessors’ locations, activities and safeguards. At termination, deletion or return follows the controller’s choice; existing copies must be deleted unless applicable EU or Member State law requires storage. Processors must provide compliance information and support audits.

  22. NIST SP 800-53A Revision 5: Assessing Security and Privacy Controls

    NIST connects assessment findings to explicit control requirements. Assessment objects include written specifications, technical mechanisms, human activities and responsible people. Examination gathers evidence through inspection or observation; interviews clarify operation; tests exercise mechanisms or activities under stated conditions and compare actual with expected behavior. Assessment depth and coverage should match needed assurance. Assessments continue during operation and include disposal, because correct initial implementation does not establish continuing effectiveness.

  23. NIST SP 800-63-4: Digital Identity Guidelines

    A digital identity distinguishes someone within an online-service context without necessarily establishing their real-world identity; one person can have several digital identities. NIST permits anonymous or pseudonymous accounts when real-world identity assurance is unnecessary. Identity proofing distinguishes the applicant and validates identity evidence and attributes. Authentication instead verifies possession or control of authenticators bound to an active subscriber account. These are different functions with separately selected assurance levels.

  24. OWASP Access Control

    Authentication establishes identity; authorization decides which actions that identity may perform on particular resources. A user allowed to initiate a transfer must still be authorized for the source account. Least privilege limits the authority of running code and service accounts, while centralized checks reduce inconsistent enforcement. In an AI application, tool availability and a model-produced argument are therefore insufficient grounds to execute a business operation; the application must apply resource- and action-level policy.

  25. RFC 8693: OAuth 2.0 Token Exchange

    Delegation preserves the distinction between the party represented and the actor exercising delegated rights. Impersonation instead makes the actor appear as the represented party within the authorized context. RFC 8693 supports subject and actor tokens and a JWT actor claim for expressing delegation. Token issuance and downstream scope depend on authorization-server policy; token exchange does not itself prescribe the deployment’s trust model.

  26. NIST SP 800-162: Guide to Attribute Based Access Control

    Attribute-based access control evaluates characteristics of the requester, protected resource and environment against policy to allow or deny an operation. Requesters can be humans or non-person entities. Protected resources include records and systems receiving information. Read, write, edit, delete and copy are distinct operations. Authorization evaluates current attribute values rather than merely recognizing an identity. This supplies a vocabulary for expressing different handling permissions for a user, service, record and requested action.

  27. Identity for AI Agents

    Authentication to the agent and permission to access upstream resources are separate steps, even when both applications use the same credentials.

  28. Regulation (EU) 2016/679: notices and conditional individual rights

    Articles 12–15 require understandable notices and provide access to personal data and handling information. Additional identity information is permitted when reasonable doubts exist and must be necessary to confirm identity; identity documents are not universally required. Article 18 permits restriction during accuracy or objection verification, for unlawful processing where restriction replaces erasure, or for data needed by the person for legal claims. Storage may continue; other processing has limited exceptions. Article 21 distinguishes situation-based objections to public-task or legitimate-interest processing, subject to overriding grounds or legal claims, from direct-marketing objections requiring that use to stop.

  29. Directive (EU) 2016/943: lawful and unlawful handling of trade secrets

    Article 4 treats use or disclosure without the holder’s consent as unlawful when the person acquired the secret unlawfully, breaches a confidentiality duty, or breaches a duty limiting use. Acquisition includes unauthorized access or copying and conduct contrary to honest commercial practices. Downstream acquisition, use or disclosure can also be unlawful when the recipient knew or should have known of the source’s unlawful handling. Article 3 permits independent discovery and specified observation or testing where no legally valid acquisition restriction applies, and handling required or allowed by law.

  30. EDPB Guidelines 05/2020 on consent

    Controllers must demonstrate valid consent, including when and how it was obtained and what information the person received. The guidance illustrates retaining evidence of the consent session and the contemporaneous workflow. Withdrawal must be as easy as giving consent and possible without detriment. Previously lawful processing does not become unlawful retrospectively upon withdrawal. Processing for another independently established purpose, such as performing a contract, does not necessarily require erasure when consent for a different purpose is withdrawn. Purposes and their legal bases should therefore be distinguished from the outset.

  31. PROV-DM: The PROV Data Model

    PROV represents entities, activities and responsible agents, including people, organizations and software. Derivation connects a resulting entity to a source that affected it; merely participating in the same activity does not establish derivation. Attribution connects an entity to an agent, association records responsibility for an activity, and delegation represents acting on another agent’s behalf while that agent retains responsibility. Identifiers and attributes describe these relationships. This supports lineage records connecting source artifacts, transformations, outputs and responsible actors.

  32. Operationalizing Data Minimization for Privacy-Preserving LLM Prompting

    The authors search combinations of retaining, abstracting and redacting detected sensitive spans, testing whether the resulting prompt preserves task utility. Their experiments cover conversation prompts and medical and legal multiple-choice questions. Acceptable minimization varies across models and tasks; direct model predictions of what to remove often differ from the search results. Separate recovery tests find that some transformed information remains recoverable, demonstrating why preserved usefulness and reduced disclosure require distinct checks.

  33. ICO: What is special category data?

    UK GDPR special categories include health, genetic information, political opinions, religious beliefs and biometrics processed for unique identification. The categories receive additional protection because processing can threaten fundamental rights or enable discrimination. Other information, including financial information, can be sensitive without belonging to these categories. Intentionally inferring a special-category attribute, or treating someone differently using such an inference, can trigger special-category requirements regardless of confidence in its correctness. Merely holding a name from which someone could guess religion does not automatically have that effect.

  34. NIST SP 800-188: De-Identifying Government Datasets—Techniques and Governance

    Redaction removes information; pseudonymization replaces direct associations with pseudonyms that can preserve linkage across observations. Quasi-identifiers are attributes that can identify someone when associated with other information. Aggregation produces summaries rather than individual records, but repeated releases can disclose more than an isolated release. NIST's teaching example removes patient names and medical identifiers while retaining room numbers and visit times: another dataset linking rooms and times to names can restore identification. Transformations can also change analytical usefulness or introduce bias, so privacy protection and task usefulness require separate evaluation.

  35. Re-identification risk in released recommendation histories

    Removing direct identifiers does not necessarily anonymize sparse behavioral records. Narayanan and Shmatikov show how auxiliary knowledge of a few movie ratings and approximate dates can help link a person to a released Netflix rating record. Sparse combinations can be distinctive even when individual movies are common. A successful linkage can expose additional ratings that were not public in the auxiliary source. The paper includes experiments with imperfect auxiliary information and a small IMDb-based proof of concept, demonstrating a concrete risk from publishing detailed recommendation histories.

  36. OpenLineage: Column Level Lineage Dataset Facet

    OpenLineage records which input columns influence output columns and how. Its delivery-time example derives a duration from order and delivery timestamps. The specification distinguishes direct value transformations from indirect influences such as filtering, joining and sorting. This matters because a field can affect which records appear without appearing in the output. The documentation also shows how representing indirect dependencies repeatedly for every output field can inflate lineage metadata.

  37. Citation Needed: Provenance for LLM-Built Knowledge Graphs

    A synthesized fact can hide both its original wording and the authority of its actual source, so retain verbatim inputs and explicit links to derived artifacts.

  38. Citation Needed: Provenance for LLM-Built Knowledge Graphs

    Lineage must survive graph mutation: entity merges retain both source sets, and invalidation records the new evidence responsible for the change.

  39. The Protection of Information in Computer Systems: Basic Principles

    Least privilege limits each user and program to permissions needed for its job. Complete mediation requires authority checks on every access to every object, including initialization, recovery, shutdown, and maintenance. It requires reliable identification of request sources and care with cached authorization when permissions change. Fail-safe defaults base access on explicit permission. Applied to a harness, these principles imply that protected operations must pass through an enforcement mechanism that the requesting program cannot bypass or modify; a prompt instructing the model to behave is not that mechanism.

  40. LLM Safeguards: Security, Privacy, Compliance, Anti-Hallucination

    Query data sources using the requesting user's proper role; organizing documents does not solve authorization.

  41. RFC 9396: OAuth 2.0 Rich Authorization Requests

    Rich Authorization Requests represent permissions as structured authorization details. Published examples distinguish reading account information from initiating a payment and identify payment amount, currency and recipient. Another example grants different read and write permissions to different file paths. The authorization server must make approved details available to the resource server so it can enforce them; audience-specific filtering limits which details each resource server receives.

  42. RFC 9110: HTTP Semantics

    If-Match makes a request conditional on the current representation matching a supplied entity tag using strong comparison. It is commonly used for state-changing requests to prevent concurrent clients from accidentally overwriting each other’s changes. The origin evaluates the precondition before performing the method and must not perform the requested method when the condition is false. This provides a concrete mechanism for rejecting a proposed record update whose reviewed version has become stale.

  43. Zanzibar: Google’s Consistent, Global Authorization System

    Zanzibar illustrates why permission checks must account for changes over time. Its published example removes Bob’s access before new content is added; evaluating an old access-control list against the new content could disclose information to Bob. The system coordinates authorization and content versions through consistency tokens, ensuring checks are sufficiently fresh. This permits many checks to use replicated data while respecting relevant permission changes.

  44. Zep: Episode metadata projection

    Zep associates derived facts, entities, observations and summaries with source episodes—the ingested messages, text or JSON. An artifact's effective metadata combines distinct values from its associated episodes, and source-based access policies evaluate that effective metadata. Search filtering has different semantics: a result matches when at least one associated episode satisfies the filter, with all AND conditions satisfied by that same episode. The published fixture combines CRM and support-ticket provenance on one edge.

  45. Myers and Liskov: A Decentralized Model for Information Flow Control

    Myers and Liskov's decentralized model attaches source owners and permitted readers to information. Combining values preserves every source's restrictions rather than choosing whichever source grants broader access. In the paper's example, one owner permits readers r1 and r2 while another permits r2 and r3; their common permitted reader is r2. An output channel may receive information only when its readers satisfy the information's restrictions. Declassification means relaxing a restriction and requires authority for the owner whose policy changes.

  46. Wearing the Agent: Engineering a Family-and-Friends Personal Agent, from Group Chats to Glasses

    Choose the delivery channel according to who should receive the information.

  47. ICO: Right to rectification

    The guidance distinguishes incorrect or misleading factual information from a record clearly identifying an opinion and, where appropriate, its author. A challenge requires reasonable accuracy checks considering the person’s evidence and the consequences of use. The ICO recommends restricting processing while checking, even without a separate restriction request. If the controller maintains that the record is accurate, it should explain its decision and complaint and judicial-remedy routes; recording the dispute and reasons is good practice. A historical mistake may remain accurately recorded alongside its correction.

  48. NARA: Guide to Inventorying, Scheduling and Disposition of Federal Records

    A records schedule can distinguish the end of active use from the start of a retention or transfer period and eventual destruction or transfer. Cutoff instructions may use a specific event, such as case closure, or an age measured from creation or receipt. NARA recommends clear, machine-implementable instructions and cautions that vague disposal instructions require someone to decide when records are no longer needed. Different record groupings need meaningful triggers for the records they contain.

  49. OWASP: Logging Cheat Sheet

    Avoid directly logging passwords, access tokens, session identifiers, encryption keys, database connection strings, payment details, sensitive personal data and commercially sensitive content. Remove or appropriately transform sensitive fields before recording events. Restrict and periodically review log access, monitor access, protect integrity and secure transmission. Retention rules must cover debug logs, backups, copies and exports as well as primary storage. Engineering application: prompts, retrieved passages, tool arguments and model outputs require the same classification and redaction controls as ordinary application data.

  50. ICO: Right to erasure

    For a valid erasure request without an applicable exemption, the ICO says organizations must address backups as well as live systems. Immediate live-system erasure may coexist with backup copies awaiting scheduled overwrite. Such backup information must be placed beyond use and not used for another purpose while awaiting replacement. Organizations must explain what will happen to the information, including backups. The guidance identifies exceptions including legal obligations and establishing, exercising or defending legal claims.

  51. One Login to Rule Them All: Cross-App Access for MCP

    Separately issued MCP tokens and API keys can leave access paths that survive SSO revocation and require their own inventory and revocation.

  52. Changed and Deleted Blobs — Azure AI Search

    Blob indexers detect changes through LastModified, but physical source deletion alone does not remove indexed documents. Configure deletion detection from the first run. Soft deletion leaves an observable marker so the indexer can remove the corresponding search document before permanent source removal. Retention must substantially exceed the indexing interval and allow recovery from failures. Stable document keys and paths are essential to tracking. Restoring a blob may not advance LastModified, so resaving metadata can trigger reindexing. Application implication: verify successful deletion processing before purging markers and retain parent-to-chunk identities for derived cleanup.

  53. Azure AI Search: Changed and Deleted Blobs

    Azure Storage indexers detect updates using source timestamps on subsequent runs. Source deletion requires a configured detection policy; deleting a blob does not automatically remove its search document. Native soft deletion works only if the indexer processes the blob while its deletion marker remains available. Retention therefore needs substantial margin beyond the indexing interval and possible outages. Stable document keys support tracking. Adding a deletion policy after documents were already deleted does not recover those missed deletions, even after an indexer reset.

  54. Zep: Deleting Data from the Graph

    Deleting a Zep episode removes associated edges and nodes only when no other episode associations remain. Shared node names and summaries are not regenerated, so information from the deleted episode may remain in them. Deleting an episode that invalidated a fact does not reverse that invalidation. The automatically created user entity also survives episode deletion. By contrast, deleting a node removes its connected edges, while deleting an edge preserves its nodes.

  55. Elasticsearch: Delete a document

    Deletion can be conditional on sequence number and primary term, preventing deletion of a document changed since it was read. Custom routing must match the routing used to index the document. Deleted versions remain available only for the interval controlled by index.gc_deletes. Search visibility is separate: refresh=wait_for waits for a refresh exposing the deletion. Application inference: bound delayed retries or keep durable source tombstones/version checks beyond the search engine's deletion-retention window to prevent obsolete events from recreating deleted evidence.

  56. Verification of Machine Unlearning is Fragile

    Machine unlearning aims to make a trained model forget selected training data. This paper studies whether a dishonest provider can pass unlearning verification while preserving information associated with the supposedly removed data. It constructs adversarial methods targeting verification through reproduced training evidence and backdoor tests, and evaluates them on image-classification datasets. The results demonstrate that passing the studied checks need not establish removal of training influence.

  57. EDPB Opinion 28/2024 on personal data in AI models

    An AI model trained with personal data is not automatically anonymous. Assessment must consider extraction and identification through queries, reasonably available means, release context and auxiliary information. The opinion requires evidence supporting insignificant likelihood of obtaining training-related personal data. For legitimate interests, controllers must establish an interest, necessity and a balance against affected people’s rights; public availability is only one contextual consideration. Roles and responsibilities should be assessed before processing. Development and deployment can involve separate purposes, and the consequences of unlawful development processing require case-specific assessment.

  58. OpenAI: Data controls in the OpenAI platform

    OpenAI distinguishes model-training use, abuse-monitoring logs and feature-specific application state. API content is not used for model improvement by default, but this does not imply no storage. Monitoring logs normally have a retention period of up to 30 days, with legal and harm-prevention exceptions. Zero Data Retention has endpoint and capability limitations; the documentation also describes notified model-specific exceptions affecting retention and human review. Third-party services apply their own retention policies. Regional storage and regional processing are separate capabilities, with exclusions for system data and third-party services.

  59. Claude API and data retention

    Anthropic documents different storage needs and retention arrangements across API features. Features requiring storage can fall outside zero-data-retention eligibility, while retained data is not used for training without express permission. The documentation distinguishes Anthropic-operated processing from integrations where a cloud provider is the processor. It also identifies separate retention models for other organizational features. These distinctions make training use, storage requirements, feature eligibility and processing relationships separate vendor-review questions.

  60. AWS: Shared Responsibility Model

    Operational responsibility depends on the service abstraction. AWS documents that customers operating virtual machines manage guest operating systems, patches and installed applications, while abstracted services transfer more infrastructure and platform operation to the provider. Customers still manage their data classification and permissions. AI deployment inference: self-hosting assigns the operator more responsibility for inference software, capacity, patching and availability; managed inference transfers some of that work under service-specific terms without transferring responsibility for application authorization or appropriate data use.

  61. Apple: Private Cloud Compute—A new frontier for AI privacy in the cloud

    Apple's June 10, 2024 technical introduction connects cloud inference capability to explicit handling requirements: use personal inputs only to fulfill the request, retain none after returning the response, and prevent privileged operators from bypassing those limits. The described design replaces general-purpose administration and inspection tools with restricted operational metrics. Requests are encrypted directly to validated compute nodes; the inference process deletes request data on completion, and process address spaces are periodically recycled.

  62. Apple: Expanding Private Cloud Compute

    On June 8, 2026, Apple announced extending PCC to Google Cloud infrastructure with NVIDIA GPUs. It retained the stated requirements for stateless processing, constrained privileged access and verifiable transparency while changing the infrastructure implementation. Apple said it would retain control of PCC software and that devices would trust only software cryptographically approved by Apple. The announcement described a summer preview gradually reaching the complete set of protections, with additional research tooling and documentation to follow.

  63. OpenTelemetry: Handling sensitive data

    OpenTelemetry cannot determine what is sensitive in an application's context; implementers must review emitted telemetry and protect it. The guidance favors collecting only data needed for observability and avoiding unnecessary personal information. Collector processors can delete or modify attributes, filter entire records, enforce attribute allowlists, and transform values. Credentials and session tokens are among the explicitly identified sensitive categories. Hashing predictable identifiers does not reliably anonymize them because candidate values can be enumerated.

  64. NIST SP 800-61r3: incident response and verified recovery

    Triage validates an incident report and estimates severity and urgency; response priority considers impact, scope, and available resources. Containment limits expansion, while eradication removes persistence mechanisms and entry points. Investigators preserve the integrity and provenance of evidence and action records, with restricted access and defined retention. Recovery can begin during response under explicit criteria. Verify restoration assets before use, check restored systems for compromise, remediate root causes, and verify restoration before production use. Confirm service restoration with owners and monitor its adequacy. For an AI deployment-state example, specify affected components, containment, preserved evidence, authorized recovery actions, trusted restoration inputs, verification criteria, and who confirms resumed service; these are application choices implementing the guidance.

  65. OpenLLMetry is all you need

    A self-deployed OpenTelemetry collector can preprocess telemetry before it reaches an observability provider.

  66. NIST AI RMF 1.0: accountability, appeals and override

    NIST calls for documented responsibilities and communication, defined human oversight, feedback channels that let affected people report problems and appeal outcomes, and monitoring that includes appeal and override. It also calls for documenting responses to errors; its human-AI discussion identifies override frequency and rationale as useful evidence. Engineering application: attach a dispute to its decision ID and original input/model/policy versions; route it to an accountable reviewer empowered to inspect evidence and authorize correction or override. Record the reviewer, evidence, rationale, revised disposition and downstream correction status, and communicate the result to the affected person. Feed recurring errors into evaluation and remediation. A trace alone does not provide this correction path.

  67. GPU-less, Trust-less, Limit-less: Reimagining the Confidential AI Cloud

    The n8n demo separates patient identifiers from diagnostic inputs before invoking the model, then recombines them for reporting.

  68. LLM Safeguards: Security, Privacy, Compliance, Anti-Hallucination

    Retrieved internal text can expose personal information through generated responses; filter sensitive content before it reaches the LLM.

  69. LLM Safeguards: Security, Privacy, Compliance, Anti-Hallucination

    Surface prompt-injection flags and patterns of sensitive-data submission while minimizing prompt and completion retention.

  70. Identity for AI Agents

    The workshop adds capabilities in stages: a public stock-price tool, authorized portfolio reads, and only later order creation.