Contents
  1. Purpose and foundations
    1. Adoption changes the operating model
    2. What earlier automation taught
  2. Choosing and redesigning work
    1. Agree on the change boundary
    2. Improve the whole flow
  3. Knowledge and integration
    1. Make knowledge usable and authoritative
      1. Knowledge needs continuing work
    2. Connect systems through agreed obligations
      1. Where the assistance lives
  4. People, authority and adoption
    1. Assign consequential decisions
    2. Provision the remaining human work
    3. Align incentives and participation
    4. Make the practice workable
  5. Organizational value
    1. Turn task gains into usable benefits
    2. Evaluate the adopted arrangement
  6. Expansion and continuing ownership
    1. Transfer capability, reassess fit
    2. Maintain, restrict or retire
  7. Check understanding
  8. Open questions
  9. Selected talks
  10. References
  11. Talk library
← All topics

Enterprise AI

Enterprise AI puts artificial intelligence inside an established organization’s work. The central challenge is making a capability useful across people, procedures and systems that already carry obligations. A successful adoption changes how work gets completed—and leaves the organization able to understand, support and revise that arrangement.

Purpose and foundations

Adoption changes the operating model

Enterprise AI includes predictive applications, such as identifying suspicious transactions, and assistance that drafts or interprets information. An agent can also choose actions and tools within a delegated task; Agent Engineering explains that mechanism. Enterprise AI predates generative assistants: the OECD’s workplace surveys, conducted mainly in early 2022, examined applications including fraud detection, visual inspection and predictive maintenance. These capabilities change different parts of a job, but do not determine how the surrounding organization should work.

Adoption means sustained incorporation into intended work. Providing accounts establishes availability; occasional activity establishes some use. Neither establishes that people complete the intended work effectively. Useful adoption also requires appropriate reliance: recognizing unsuitable tasks, checking consequential outputs and obtaining help when necessary. The UK government’s human-centred adoption guidance makes these distinctions explicit.

An operating model is the arrangement through which an organization delivers work: its people, processes, information systems, suppliers and management decisions. The Operating Model Canvas makes those arrangements visible together. An assistant that prepares a response changes only part of this model if another department still controls approval, maintains the governing policy and handles complaints.

Making that assistant useful requires more than better drafts: staff need the governing information, time to review and authority to resolve exceptions. These supporting skills, procedures, information and authority are organizational complements. Together, people’s working arrangements and the technology form a sociotechnical system. Joint optimization means designing both together so that an improvement in one does not impair the whole. Trist’s account of sociotechnical design also shows why this can be contentious: changing how work is performed can redistribute discretion and responsibility.

In this example, software prepares a draft within a larger responsibility for Case C. Maintained policy, staffed review, exception authority and the receiving team remain part of completing the outcome. Review arrangements depend on the use case.

This makes enterprise adoption different from finding and validating a new product under small-team constraints. Existing services must keep working while their arrangements change. A useful warning comes from Build Dynamic Products, and Stop the AI Sideshow: a separate technology agenda can produce features disconnected from customer needs. Central capabilities can help, but their purpose must remain connected to the outcome the operating teams deliver.

What earlier automation taught

Enterprise AI inherits several enduring problems: organizing work around new equipment, acquiring specialist knowledge, removing unnecessary activity and paying for changes whose benefits arrive later. These contributions developed in different settings. They explain continuing responsibilities, not successive stages that every organization must pass through.

ContributionDateOrganizational lesson
Tavistock mining investigations — work designBeginning in 1949Trist’s 1981 retrospective describes different arrangements for mechanized work, including interchangeable roles and group responsibility. Equipment did not dictate a single organization.
Knowledge engineering — specialist knowledge1977Edward Feigenbaum’s account of expert systems made acquiring and revising domain knowledge central to useful computation.
Business process redesign — remove work1990Michael Hammer’s Ford account distinguished eliminating reconciliation from making existing clerical steps faster.
The Productivity J-Curve — complementary investmentOctober 2018Brynjolfsson, Rock and Syverson’s analysis explained how investment in processes, training and other intangible assets can precede measurable output gains.

The recurring issue is the relationship between a technical capability and its operating conditions. Contemporary workflow design still distinguishes prescribed paths from agents that choose their next actions dynamically. More discretion can add flexibility, but also cost and opportunities for error. Building effective agents recommends choosing that discretion for the task, rather than treating autonomy as the destination of every deployment.

Choosing and redesigning work

Agree on the change boundary

Start with a completed outcome and the difficulty preventing it. A process owner coordinates the end-to-end result, with authority to negotiate changes or an explicit route to obtain that authority. Ownership of a drafting tool is narrower than ownership of successful case resolution. A small technical change may therefore require agreements with teams outside the implementation group.

Discovery supplies the facts for that agreement. Observe actual handoffs and exceptions, not only the documented normal path. Vasuman Moza’s field-engineering account emphasizes asking process leads what happens when work goes wrong. The methods belong in Learning from work as it happens and Change the process before automating it; here their output becomes a negotiated boundary.

A baseline records how the work currently performs. Acceptance criteria specify the outcomes and constraints the change must satisfy. A value hypothesis connects the proposed intervention to an expected improvement: for example, assistance might reduce preparation effort without increasing specialist correction. Define this before comparing models. Domain-expert examples and acceptable outcomes then make model comparisons relevant to the actual use.

A compact adoption agreement should settle the following commitments.
CommitmentAgreement needed
Outcome and scopeCompleted result, eligible work and explicit exclusions.
DependenciesContributing teams, required changes and unresolved authority.
AcceptanceBaseline, quality conditions and operational-user testing.
OperationReceiving owner, support capacity and contingency arrangements.

Assess frequency, mistake consequences, knowledge availability and whether outcomes can be observed. A disputed policy may need clarification before automation; a fixed transformation may need ordinary software. Retaining the current process is also a legitimate decision when expected gains do not justify the burden or risk. NIST’s risk-management core explicitly includes non-AI alternatives and decisions not to proceed.

Improve the whole flow

A value stream includes the actions and information needed to deliver an outcome, including work that adds no customer value. Rother and Shook’s Learning to See distinguishes improving this complete flow from optimizing individual activities. This is a process-level lens, not a claim that every strategic use of “value chain” means the same thing.

A bottleneck constrains the rate of completed work. Faster upstream production can accumulate work in front of it rather than improve completion. Measure hands-on effort separately from waiting and total elapsed time. Rother’s work-release analysis recommends pacing released work to the limiting activity’s capacity; removing that constraint can make another activity determine the pace.

Redesign therefore requires negotiation, not just faster execution. Decide which checks serve a continuing requirement, which handoffs can change and which duplicate steps can disappear. Allocate work and authority separately explains why moving execution to software need not move the right to decide. Domain specialists must participate: engineers may understand the tools without understanding why an apparently redundant control exists.

Hammer’s Ford example makes the distinction concrete. A purchase order records a purchase request; accounts payable handles amounts owed to suppliers. Shared order information and checks when goods arrived replaced matching orders, receiving documents and invoices. Suppliers stopped sending invoices. This was coordinated process redesign, not an AI result.

Ford: remove reconciliation, retain receiving checks

Before: reconcile three information streamsPurchasing sends purchase-order information, receiving sends receiving documentation, and the supplier sends invoice information to accounts-payable reconciliation. Exactly three incoming information streams.Before · reconciliation at accounts payablePurchasingPurchase-order informationReceivingReceiving documentationSupplierInvoice informationAccounts payableMatches order, receipt and invoicePurchase orderReceiving documentInvoiceArrows: information, not elapsed time, physical goods or money.After: check at receipt using shared order informationPurchasing records shared order information, receiving consults it when goods arrive, and verified receipt supports payment. Suppliers no longer send invoices. Roles occupy the same positions as before. Shared information is a record, not a department.After · checking moves to receiptPurchasingRecords the purchase orderReceivingChecks goods against shared orderSupplierInvoice stream removedPaymentVerified receipt supports paymentShared purchase-order recordInformation, not a departmentRecordsConsults at receiptVerified receiptNo invoice to reconcileArrows: shared information and a payment-enabling dependency; no automatic-payment guarantee.
In Hammer’s account, checking moved to receipt against shared purchase-order information and invoice matching disappeared. Purchasing, receiving and payment procedures changed together. This was process redesign, not an AI result.

Faster generation can create a similar problem when review capacity stays fixed. In Moving away from Agile, Martin Harrysson and Natasha Maniar propose that manual review and unchanged coordination practices can limit the benefit of producing more code. Investigate the complete flow: does the changed activity remove work, move it to another team or create additional checking and correction?

Standardize the requirement before standardizing the procedure. Two units may share a completion standard while needing different local knowledge, approval roles or working arrangements. Treat a proposed common procedure as something the receiving unit must understand and reproduce, not as a document whose distribution establishes adoption.

Knowledge and integration

Make knowledge usable and authoritative

Organizational knowledge comprises the facts, policies, routines and practical judgment used to perform work. Explicit knowledge can be expressed in documents or other formal representations. Tacit knowledge rests in experience, skills and mental models that may be difficult to articulate. Ikujiro Nonaka’s 1994 theory of organizational knowledge creation explains how interaction develops shared understanding; organizational knowledge is more than a collection of stored information. Read the original paper.

A system of record is the designated authority for particular business facts. As Name the authoritative records explains, different systems can own different facts. Policy authority, current transaction state and experienced advice must therefore remain distinguishable. The following examples describe different claims, not a universal ranking of sources.

KnowledgeWhat it establishesMaintenance and disagreement
Official policyApproved rules within a stated scope and effective period.Policy owner decides interpretation and authorized exceptions.
Business recordRecorded state of the identified transaction or account.Data owner governs meaning; stewards investigate errors.
Experienced adviceA practitioner’s account of how unusual cases are handled.Preserve attribution; seek authorization before treating advice as policy.

Stewardship is the continuing work of managing knowledge and investigating quality problems; it need not confer authority to change policy. Preserve source versions, applicability and effective dates, and record who resolved a conflict and on what basis. Publication time, retrieval time and the date a rule takes effect answer different questions. A more recent message does not automatically supersede an approved rule. The W3C provenance model provides vocabulary for sources, revisions and derivations; the organization still supplies the authority rules.

The Knowledge-Centered Service practices guide illustrates managed readiness: an article can be unresolved or complete but unvalidated, and publishing privileges depend on demonstrated competence. Reusable guidance is separated from customer-specific incident information. That distinction is useful when collecting worker corrections: recording an observation is not the same as approving guidance for everyone. KCS practices make the difference explicit.

Knowledge needs continuing work

An expert system applies encoded specialist knowledge to reach conclusions about a case. In Feigenbaum’s 1977 account, PUFF, developed through Stanford’s collaboration with Pacific Medical Center, reused the machinery for applying rules from an earlier system, MYCIN. But specialists still had to supply the rules for interpreting lung-function results. Running additional cases exposed gaps and inconsistencies that required revision. Reusing the software did not eliminate the work of acquiring and testing domain knowledge.

XCON, which configured Digital Equipment Corporation computers in production from January 1980, exposed the maintenance side. Soloway, Bachant and Jensen’s 1987 study reported approximately 6,200 rules, about half changing annually. Interactions and missing rationale made revisions difficult, sometimes requiring original authors or institutional memory. The proposed RIME organization made domain structure and control relationships more explicit. Productive operation and difficult maintenance coexisted.

Retrieval-augmented generation supplies retrieved material to a model when it prepares an answer. It can make selected sources inspectable, but cannot confer authority on them. Resolve ownership and applicability before expecting answer synthesis to handle disagreement; Applicable sources and unresolved conflicts develops that boundary.

Connect systems through agreed obligations

An integration contract states what information and operations cross a boundary, what they mean and who supports them. A schema describes structure, but cannot settle all these obligations. The Open Data Contract Standard includes quality, support, roles and service expectations as well as schema. Agreement between producers and consumers is broader than successful data transport.

Authentication establishes identity; authorization determines permitted actions on resources. Logging into an assistant does not authorize access to every upstream account. Delegation distinguishes a user from the agent acting for them; a service identity represents an application exercising its own granted authority. Keep these relationships explicit, as developed in Distinguish people and actors.

Separate permission to read from permission to update. Unauthorized source material must be excluded before it reaches answer generation, including when a document has been split into indexed passages. A generated proposal must then pass an independent action-level check. Enforce current authority explains why neither a tool description nor the model’s promise supplies that enforcement.

The business agreement also needs record identity, field meanings, freshness requirements, permitted updates and a definition of confirmation. An accepted request may still be pending; an unavailable response may leave its outcome unknown. Use the authoritative application’s state to establish completion, rather than treating the assistant’s explanation as a receipt. Preserve meaning across applications covers these interface obligations, and recovery from observed effects covers uncertainty.

Read, propose, authorize, confirm

Example

Read access does not grant update authority.

An example of an allowed, successfully confirmed update and the permission-denial paths. Information edges carry data; control edges enforce permission. A missing response leaves the outcome unknown. Acceptance of a request alone does not confirm its recorded effect; confirmation comes from the authoritative application.
Read the diagram as text
  • Employee request. Identified actor and task.
  • Source access check. Source owner’s permissions.
  • Permitted information. Selected content, not the original record.
  • AI proposal. Application team prepares an update request.
  • Update authorization. Independent system-owner policy check.
  • Denied operation. No protected operation permitted.
  • Authoritative application. Applies an authorized update.
  • Confirmed outcome. Application evidence of the effect.
  • Employee requestSource access check: Information: identity and request.
  • Source access checkPermitted information: Control: read allowed.
  • Source access checkDenied operation: Control: read denied.
  • Permitted informationAI proposal: Information: permitted content.
  • AI proposalUpdate authorization: Information: target and change.
  • Update authorizationDenied operation: Control: update denied.
  • Update authorizationAuthoritative application: Control: update authorized.
  • Authoritative applicationConfirmed outcome: Information: recorded result.

Where the assistance lives

Choose the integration arrangement with its ownership costs visible. Embedded assistance can keep work near existing records and review procedures. A separate integrated service needs an agreed boundary with each source owner. Exports and manual copying create additional artifacts whose permissions, freshness and disposal must be managed. Treat shadow IT—unofficial systems used to perform organizational work—as a potential second operating path, not merely an unapproved application.

Workday Help provides a concrete embedded example. Its advertised capabilities combine AI-assisted article drafting and translation with author review, version control, approval workflows and case management. Those features connect content preparation to maintained guidance and receiving-team procedures. They do not establish how a particular customer configured the product or whether that customer realized a benefit.

Legacy browser interfaces do not remove these obligations: an agent that can click still needs approved access and action authority. Supplier approval likewise concerns the actual service and data path, including secondary use, incident notification and responsibility for changes. Running a model internally does not remove dependencies on acquired software, weights or external integrations.

People, authority and adoption

Assign consequential decisions

Responsibility identifies who performs work. Accountability identifies who answers for a decision or outcome. Decision rights specify who may approve, change or stop something. RACI distinguishes Responsible, Accountable, Consulted and Informed roles; the data ownership model supplies a concrete application. A chart records an arrangement—it cannot grant a missing mandate.

Assign decisions, not just components. A technical operator can repair an integration without being authorized to reinterpret a policy. A reviewer can reject a proposal without being empowered to approve a new organizational use. The following agreement is an example to adapt, not a universal organization chart. One person may hold several roles, but the distinctions still matter.

DecisionRequired authority
Approve the useProcess owner and relevant control functions agree scope and accepted risk.
Authorize an actionApprover has authority over that operation and resource.
Change policyKnowledge or policy owner settles meaning and applicability.
Resolve an exceptionNamed business owner decides; conflicts have an escalation route.
Stop or restartOperator can contain harm; designated owner accepts resumption conditions.

The implementation team should not become the default destination for every unresolved business judgment. Owners need time, information, resources and a route for conflicting mandates. Assign accountable decisions applies this to information use; AI Engineering Leadership covers wider portfolio and staffing choices. At deployment level, the essential agreement is who can make each consequential decision and who receives unfinished work.

Delegation can move investigation, implementation and testing to agents while retaining accountable ownership of the result. Addy Osmani’s account of engineering responsibility makes this boundary explicit: agents return work-appropriate evidence; owners judge its sufficiency and accept or redirect the outcome. This does not require manual execution of every action. It requires someone able to defend the decision.

Provision the remaining human work

Human oversight is work that inspects, challenges or redirects system behavior. It requires expertise, time, relevant information and authority to intervene. The exception workload is the work outside normal handling, including unresolved cases and correction. Meaningful review and exception operations explain the mechanics; enterprise adoption must supply the people and capacity to perform them.

Do not estimate this burden from case counts alone. If routine cases disappear, the remaining cases may be harder. Greater automated output can also create more checking. Measure handling effort and case mix, identify who accepts unresolved work, and provide cover when a specialist is unavailable. Requiring sign-off everywhere can create a queue that people cannot inspect meaningfully; removing review everywhere simply discards the quality obligation.

Fewer cases can still require more specialist time

Hypothetical weekly trial: the existing process remains authoritative for every case. Draft assessment adds work. Available hours are already net of ordinary duties and continuity cover. Generalists assess routine drafts; only the specialist pool assesses exceptions. Spare hours do not transfer automatically between expertise pools.

At least one trial-review pool exceeds its stated hours.
Generalist routine review: 6 h required / 8 h available; 2 h remaining.
Specialist exception review: 9 h required / 6 h available; 3 h shortfall.
Expertise poolTrial cases / weekMinutes / caseRequired hours / weekAvailable hours / week
Generalist routine review1203120 × 3 ÷ 60 = 68
Specialist exception review124512 × 45 ÷ 60 = 96
Review workload and capacity are separate for each poolGeneralist routine review: 6 hours required, 8 hours available. Specialist exception review: 9 hours required, 6 hours available.0 h3 h6 h9 h12 hGeneralistRequired: 6 hAvailable: 8 hSpecialistRequired: 9 hAvailable: 6 hHours per week · identical scale for both pools; availability is not interchangeable

0 specialist cases excluded from the trial. They retain their existing authoritative path and its workload; they are not marked completed. Trial inclusion is 12 of 12 specialist cases. Exclusion avoids 0 h of additional trial assessment. The existing process’s handling time is not estimated here.

Required hours = included cases × minutes per case ÷ 60. This tests a weekly workload budget, not arrival timing, queue delay, review quality, skills retained, case resolution or permission.

This calculator tests trial-review workload feasibility, not review quality or permission to handle a case. Excluded cases retain their existing path and work. A weekly hours comparison does not predict a queue or measure skill loss.

Lisanne Bainbridge’s 1983 Ironies of Automation identified a related difficulty: automation can remove routine practice while leaving people responsible for abnormal situations requiring operating and diagnostic skill. Applied to AI-supported work, this argues for preserving practical learning and intervention experience, not assuming a training presentation maintains competence. It is a design lesson from industrial control and aviation, not a measured AI deskilling rate. Read Bainbridge’s paper.

Automation bias is inappropriate reliance on automated advice. In Duolingo researchers Belzak, Niu and Ortmann Lee’s 2025 When Machines Mislead, proctors retained decision authority yet accepted some fabricated cheating alerts inserted into historical, previously certified sessions. Revised guidelines emphasizing independent video evidence were associated with estimated rejection rising from 50% to 71%. Different sessions and periods were compared; this was not randomized guideline assignment or a production false-accusation rate. The result demonstrates why observed reviewer behavior matters alongside formal authority. Original study.

Existing quality-assurance and customer-experience teams can contribute where their expertise matches the task. They may recognize difficult interactions, label outputs and define acceptable behavior without building model pipelines. The Build-Operate Divide describes this contribution in contact-center work. It does not make customer-service experience a substitute for credentials required in another domain. Complaints and contested outcomes also need a receiving owner rather than an unattended feedback button.

Align incentives and participation

An incentive is a reward, cost or expected consequence that influences behavior. It includes pay, workload, recognition and professional standing. Organizational and individual benefits can diverge: a change may save one team time while adding checking to another. Treat these consequences as part of the design, not as objections to overcome after installation.

Atkin and colleagues’ study of soccer-ball producers makes the mechanism concrete. A material-saving cutting technology distributed in 2012 had low adoption after 15 months. Owners benefited from material savings, while piece-rate workers faced initially slower output and lower earnings. A later intervention combined payments for demonstrated competence with owner observation and increased adoption. This supports examining conflicting incentives, not prescribing bonuses or usage quotas for AI.

Participation should examine who gains time, who contributes expertise, who performs new review and what happens when savings are reported. Worker concerns can involve job security, work intensity and employer monitoring. The OECD’s 2023 workplace report found such concerns alongside reported benefits. Training and consultation were associated with more favorable experiences, but the surveys did not establish causation.

Psychological safety concerns whether people can take interpersonal risks such as admitting a mistake or criticizing current practice. Amy Edmondson’s organizational-learning account explains why threats to perceived competence or standing can suppress those exchanges. An AI rollout needs candid reports of bad assistance; rewarding apparent success while penalizing correction makes that feedback harder to obtain.

Set goals around useful outcomes and use activity counts diagnostically, as the KCS guidance recommends. An employee who declines unsuitable assistance may be exercising good judgment. Before prescribing more training for bypasses, examine relevance, available support and whether the official path makes the work harder. Appropriate reliance is not maximized use.

Make the practice workable

Change management prepares, equips and supports people whose everyday work changes. It coordinates procedures, roles, skills, support and expectations alongside technical delivery. This people-side meaning, described in Prosci’s definition, differs from software version control. A tested release and a training attendance list do not establish that the new arrangement can be performed routinely.

Normalization Process Theory, developed by May and colleagues in 2009, explains embedding a practice through continuing work: making sense of it, sustaining participation, performing it and appraising its effects. These are interacting concerns, not implementation stages. The original paper helps explain why installation does not finish adoption. A coherent purpose cannot compensate for missing time or access; practical execution cannot compensate indefinitely for a practice people find unhelpful.

Build on Keep the workflow usable and owned with role-specific practice. Users should complete representative tasks, recognize limits and escalate appropriately. Reviewers should practise rejecting wrong proposals; operators should practise interrupted work and service failures. Google’s SRE engagement model illustrates responsibility transfer supported by documentation, instruction, hands-on exercises and continuing help from developers.

Choose a transition arrangement deliberately. These options are not a mandatory sequence.
ArrangementAuthority and exit
Limited trialName the eligible work, official result and owner of exceptions; decide what evidence ends the trial.
Parallel operationSpecify which procedure governs; account for duplicate effort and set a review point.
Committed useReceiving team accepts operation; retain only justified alternative paths and contingency capacity.

Parallel execution needs particular care for agents. A shadow test evaluates a candidate without using its response in the live service. But ignoring its answer does not suppress its tool effects. Route candidate actions to read-only access, mocks or isolated state; do not let two comparison paths independently modify the same business record. Shadow evaluation can still consume resources and process sensitive inputs. Shadow-test documentation establishes the response distinction; action isolation is an additional application responsibility.

Organizational value

Turn task gains into usable benefits

Benefits realization converts improvement into a usable organizational outcome. Released time reduces effort on an activity; usable capacity makes that time available for other work. Realized savings reduce actual spending. The Government Efficiency Framework distinguishes greater output with unchanged spending from spending reductions. Both can matter, but they are different claims.

The conversion depends on what happens after the faster task. Checking and correction may consume the released effort. Another department may constrain completion. Additional capacity produces more completed work only when there is demand, downstream capacity and a decision to put the released time to use. Reduced spending requires a separate change in expenditure while preserving the required outcomes.

Count integration, training, transition, knowledge maintenance, review and support alongside service charges. Avoid crediting one team’s saving while omitting costs transferred elsewhere, and do not count the same benefit twice. A benefit owner should work with finance and analysts to preserve the baseline and assumptions. Separate savings from allocation develops the accounting boundary.

Conditions for usable benefit

Example

Capacity, completed work and savings differ.

Review and operating burden consume released effort. More completed work requires demand, downstream capacity and redeployment; reduced spending requires an expenditure change with outcomes preserved. These are qualitative conditions, not measured amounts. The same released time cannot be fully credited to both uses.
Read the diagram as text
  • Task effort reduced.
  • Review and operating burden.
  • Net usable capacity.
  • Additional completed work.
  • Reduced spending.
  • Task effort reducedNet usable capacity: Time is available for reassignment.
  • Review and operating burdenNet usable capacity: Consumes released capacity.
  • Net usable capacityAdditional completed work: Demand, downstream capacity, redeployment.
  • Net usable capacityReduced spending: Spending falls; outcomes preserved.

Keep service quality, employee experience and economic outcomes visible separately. A useful measurement arrangement distinguishes utilization from impact and cost: who used assistance, whether completed work improved, and what resources it consumed. The AI-assisted engineering measurement discussion uses these dimensions to avoid treating more activity as proof of greater value.

Complementary investment also takes time. The Productivity J-Curve analysis explains how resources spent building processes, managerial experience and skills can initially reduce measured output before the accumulated assets contribute. This is a possible accounting pattern, not a promise that an unsuccessful deployment will pay back. Delayed benefits still need an owner, a testable mechanism and a decision about continued investment.

Humlum and Vestergaard’s March 2026 Danish study, Still Waters, Rapid Currents, linked chatbot-adoption surveys with employment records. It reported changed tasks, including oversight and integration work, alongside estimates excluding changes larger than 2% in earnings and recorded hours over the two years after ChatGPT’s launch. Adoption was not randomly assigned, so interpreting the estimates as effects of AI depends on assumptions used to separate adoption’s effects from other changes. Earnings and recorded hours also do not capture all organizational value. Changed work and unchanged paid hours can coexist.

Evaluate the adopted arrangement

A counterfactual is what would plausibly happen under an alternative arrangement. Evaluating adoption requires a credible comparison with that alternative—not merely observing improvement after installation. Choose the live experiment develops experimental designs; Measure the complete process develops the outcome boundary.

Specify the arrangement being compared. If one group receives software, training and revised procedures, the comparison concerns that package, not the model alone. Define eligible work, observation periods and task mix; record nonuse and bypasses. Shared practices can also cross group boundaries when coworkers exchange advice. Such spillovers change the comparison rather than disappearing because assignment was recorded in a spreadsheet.

Selection bias arises when the people or cases observed differ systematically from the population of interest. Volunteers may already be unusually interested or proficient. A survey discussed in AI Consulting in Practice recruited an engaged podcast audience and relied on voluntary reports. Its findings describe those respondents; they do not establish representative enterprise returns.

Three studies illustrate different evidence boundaries.
Study and arrangementFindingInterpretation
UK cross-government Copilot experiment, September–December 2024: 20,000 licenses; 7,115 survey responses; usage data for 14,500 users. Report.Time savings were participant estimates. Active use meant at least one interaction in 30 days.The study could not identify how saved time was spent. Uneven rollout and training constraints complicate interpretation; missing telemetry is not nonuse.
Generative AI at Work, Brynjolfsson, Li and Raymond: staggered adoption among 5,172 support workers, with discretion to edit or ignore suggestions. Study.The preferred analysis estimated approximately 15% more resolved issues per hour, with effects differing by experience and skill.Longitudinal comparisons and controls address selection under assumptions. Resolution-based measurement covered workers with consistently recorded quality outcomes. This is not whole-firm profit or net staffing savings.
Navigating the Jagged Technological Frontier, Dell’Acqua and colleagues: preregistered experiment with 758 BCG consultants assigned no AI, GPT-4, or GPT-4 with prompting guidance. Journal version, March 2026.Assistance improved product-development task performance but reduced correctness on a separately designed business-analysis task.The task sets were deliberately chosen for contrasting capability conditions. Results establish task-dependent effects, not the share of suitable work in every organization.

Measure sustained incorporation into eligible work alongside quality, exceptions, downstream effort and realized benefits. Continue observation long enough to distinguish initial learning from routine operation; report the period rather than assuming a universal duration. Domain-specific success criteria make failures actionable, while production traces and expert annotation can reveal why apparently successful outputs did not complete the task.

Use the findings to decide whether to continue, change, restrict or expand the arrangement. Aggregate improvement does not override a consequential failure in an affected group. A rollout decision should identify unresolved risks and the person accepting them; a positive average is an input to that decision, not its substitute.

Expansion and continuing ownership

Transfer capability, reassess fit

Organizational replication reproduces a working practice in a receiving unit. Gabriel Szulanski’s 1996 study of internal knowledge transfer, covering 122 transfers in eight companies, identified difficulties involving recipients’ absorptive capacity—their ability to understand and apply incoming knowledge—uncertainty about why a practice works, and source–recipient relationships. The study explains why distributing information is not the same as reproducing coordinated activity.

Separate reusable capability from organizational fit. An AI platform supplies shared software capabilities through supported service boundaries. Common deployment, authentication and observability can reduce repeated implementation work, while local teams still establish what work the service should perform. AI Platform Engineering develops that architecture; AI Engineering Leadership covers organization-wide investment and staffing.

For example, two business units might use the same service but differ in the policies it must apply and the specialist capacity available to review its work. The service can be reused while those conditions are reassessed. The following comparison is hypothetical; it illustrates acceptance obligations, not a measured rollout.

RequirementUnit AReceiving unit B
Service interfaceSupported common interface.Reuse after compatibility checks.
Applicable knowledgeLocally approved policy and sources.Different owner confirms local meanings and scope.
PermissionsApproved actors, records and operations.Obtain grants for B; A’s access is not inherited.
Human capacityReview workload fits available specialists.Limited capacity supports only a bounded initial subset.
AcceptanceExisting outcome evidence.Local operational testing and renewed acceptance.

Shared ownership should follow actual common needs. Bloomberg’s agent-scaling account describes integrated teams while product boundaries are uncertain, with horizontal capabilities introduced as recurring needs become clearer. Common guardrails avoid independent interpretations of the same policy. This is a practitioner option, not a required reorganization or proof that centralization always improves delivery.

Document local adaptations as supported differences with owners and acceptance conditions. An unsupported fork is different: it creates another behavior and maintenance path without an agreement to operate it. Expansion should make justified variation explicit while preserving the shared service’s contract. More licenses alone settle neither local suitability nor ongoing support.

Maintain, restrict or retire

A handoff establishes a starting arrangement, not permanent readiness. Demonstrating operating ownership covers practiced transfer. Continuing operation needs owners for business outcomes, knowledge, technical service, support and exceptions. Plan cover and succession so those responsibilities survive staff changes: the next owner needs the knowledge, access and practice to perform the work, not merely their name on an ownership list.

Knowledge maintenance must remain ordinary work. A connected repository or business application is useful only if someone reviews and updates its content; connectivity does not establish freshness. When prompts change, preserve the failure that motivated the revision and the behavior it should correct. Production findings should become reviewed cases for evaluating subsequent releases, rather than disappearing into an incident archive.

Business continuity means being able to continue necessary work during disruption. Restoring manual work requires available people and retained skill, not only a documented fallback. Rehearse essential operating tasks and check what workload the alternative arrangement can handle. Technical recovery and organizational continuity are related but distinct: a functioning interface does not supply missing reviewers.

Use material changes to reopen the relevant operating decision.
ChangeDeciding rolesResponse and continuation evidence
Policy or source meaning changesKnowledge owner with process owner.Restrict affected advice; approve revised guidance and assess dependent behavior.
Supplier or service changesService owner with relevant control functions.Recheck obligations, data paths and continuity before adopting the replacement.
Review demand exceeds available expertiseProcess owner with operations lead.Narrow supported work or supply capacity; verify that unresolved work remains owned.
Harm, persistent failure or lost usefulnessDesignated accountable owner.Contain use, investigate consequences and decide whether repair, restriction or retirement is justified.

A use-case registry records which applications depend on particular models, tools and services. The AmplifAI registry demonstration connects these dependencies so teams can trace an affected asset back to business uses. Such a registry can aid response, but only maintained records can support a current impact assessment; the demonstration does not establish automatic discovery or freshness.

Stopping future use and repairing past consequences remain separate responsibilities. Complaints need investigation; incorrect authoritative records may need correction; completed external effects may require a business remedy rather than rollback. Recover from the effects that occurred develops that distinction. Continue the deployment only while its usefulness, accepted risks and operating burden remain defensible. Sustainable adoption includes the ability to narrow or retire it.

Open questions

  1. Transfer across units remains difficult to predict because knowledge, authority and support can change while software stays identical. Longitudinal studies tracking receiving units, their adaptations and sustained outcomes would help distinguish reusable capability from genuinely transferable practice.

  2. Long-term oversight must preserve expertise while reducing routine work. Progress would mean showing that practical training and work allocation maintain effective intervention, including during unfamiliar failures and staff turnover—not merely documenting a fallback.

  3. Organizational value remains hard to attribute when task gains, changed responsibilities and operating costs emerge at different times. Stronger evidence would follow complete processes, resource redeployment and net benefits together instead of combining activity telemetry with estimated time savings.

Follow the curated reading path through the speakers and demonstrations behind this entry.

Explore more talks

The rest of the library, beyond the curated path. Cited talks support this entry; reviewed transcripts were processed in full. Metadata candidates have not been reviewed as sources or verified as topic members.

200 matching talks

Every catalogued talk on this subject: Enterprise

TalkSpeakerEventYear
Raza HabibAI Engineer World's Fair 20242024
Christopher Lovejoy, Saul HowardAI Engineer World's Fair 20262026
Ishita DagaAI Engineer World's Fair 20262026
Amir HaghighatAI Engineer World's Fair 20252025
Shirsha ChaudhuriAI Engineer Summit 20252025
Sunny RekhiAI Engineer World's Fair 20262026
Hamed Firooz, Maziar SanjabiAI Engineer World's Fair 20252025
Jesse HuAI Engineer Code 20252025
Evaling Video Slop

Transcript reviewed

Maor BrilAI Engineer World's Fair 20262026
Charles FryeAI Engineer Summit 20232023
Dex HorthyAI Engineer World's Fair 20252025
Samuel ColvinAI Engineer World's Fair 20252025
Omri Bruchim, Tomer AstAI Engineer World's Fair 20262026
Jerry LiuAI Engineer Summit 20232023
Pablo CastroAI Engineer World's Fair 20242024
Ofer MendelevitchAI Engineer Summit 20252025
Roy DerksAI Engineer Summit 20252025
Vinoth GovindarajanAI Engineer World's Fair 20262026
Idan GazitAI Engineer World's Fair 20262026
Adam TerlsonAI Engineer Summit 20252025
LLM Evals That Work IRL

Transcript reviewed

Aparna Dhinkaran, Aparna DhinakaranAI Engineer World's Fair 20242024
Nick Ung, Akshay SharmaAI Engineer World's Fair 20262026
Mahmoud MabroukAI Engineer Europe 20262026
Jared JoselowitzAI Engineer World's Fair 20262026
Simon WillisonAI Engineer World's Fair 20242024
Security Firewall for Agents

Transcript reviewed

Ryan DahlAI Engineer World's Fair 20262026
Harshil AgrawalAI Engineer Europe 20262026
Rene BrandelAI Engineer World's Fair 20252025
Angel Ortmann LeeAI Engineer World's Fair 20262026
Liam McGarrigleAI Engineer Europe 20262026
Abi AryanAI Engineer Summit 20232023
Adrian BertagnoliAI Engineer Europe 20262026
Cormac BrickAI Engineer World's Fair 20262026
Dan BjornnAI Engineer World's Fair 20262026
Nishant GuptaAI Engineer World's Fair 20262026
Rafal Wilinski, Vitor BaloccoAI Engineer World's Fair 20252025
Anju KambadurAI Engineer Summit 20252025
Steven WillmottAI Engineer Europe 20262026
Waseem AlshikhAI Engineer Summit 20252025
Sachin KumarAI Engineer World's Fair 20262026
Martin Harrysson, Natasha ManiarAI Engineer Code 20252025
Dan MasonAI Engineer World's Fair 20252025
Addy OsmaniAI Engineer World's Fair 20262026
Justin ReockAI Engineer Code 20252025
Sachin GuptaAI Engineer World's Fair 20262026
Gateways are All You Need

Transcript reviewed

Karan SampathAI Engineer Europe 20262026
Lovina DmelloAI Engineer World's Fair 20262026
Skills are the New SDKs

Transcript reviewed

Elvin AghammadzadaAI Engineer World's Fair 20262026
Samir ModyAI Engineer Code 20252025
Ben HylakAI Engineer World's Fair 20262026
Juan Herreros ElorzaAI Engineer Europe 20262026
Sandipan BhaumikAI Engineer Europe 20262026
Sanja GrbicAI Engineer World's Fair 20262026
Darius EmraniAI Engineer World's Fair 20252025
Rossella Blatt Vital, Deepsha MenghaniAI Engineer World's Fair 20252025
Vincent KocAI Engineer Europe 20262026
Anushrut GuptaAI Engineer World's Fair 20252025
Itamar FriedmanAI Engineer World's Fair 20262026
Jeff NgAI Engineer World's Fair 20262026
Jared HansonAI Engineer World's Fair 20252025
Identity for AI Agents

Cited in this entry

AI Engineer Code 20252025
Paul Klein IVAI Engineer World's Fair 20262026
DottaAI Engineer World's Fair 20262026
Apoorva JoshiAI Engineer World's Fair 20262026
How to Kill the Code Review

Transcript reviewed

Ankit JainAI Engineer World's Fair 20262026
Nathaniel Whittemore (NLW)AI Engineer Code 20252025
The New Lean Startup

Transcript reviewed

Sid BendreAI Engineer World's Fair 20252025
Harrison ChaseAI Engineer World's Fair 20252025
Damien MurphyAI Engineer World's Fair 20252025
Hubert MisztelaAI Engineer World's Fair 20252025
Varsha ShahAI Engineer World's Fair 20262026
Stephen Chin, Jonathan LoweAI Engineer Summit 20252025
Samuel DentonAI Engineer World's Fair 20262026
Varun Badrinath Krishna, Petro Junior Milan, Rachelle MatternAI Engineer World's Fair 20242024
Bruno Passos, Beyang LiuAI Engineer Summit 20252025
Shaan DesaiAI Engineer Summit 20252025
Prasenjit SarkarAI Engineer Europe 20262026
Satya NittaAI Engineer World's Fair 20242024
Ofer MendelevitchAI Engineer Code 20252025
Chau TranAI Engineer World's Fair 20252025
Jess Grogan-Avignon, Jack WangAI Engineer Europe 20262026
Kwindla Hultman KramerAI Engineer World's Fair 20252025
Randall HuntAI Engineer World's Fair 20252025
Steven MoonAI Engineer Summit 20252025
Douwe KielaAI Engineer Summit 20252025
Calvin Qi, Chang SheAI Engineer World's Fair 20252025
Peter BarAI Engineer World's Fair 20252025
Harald KirschnerAI Engineer World's Fair 20252025
Harald KirschnerAI Engineer World's Fair 20252025
Tobin SouthAI Engineer World's Fair 20252025
Arjun Bansal, Trey DoigAI Engineer World's Fair 20242024
Sam JulienAI Engineer World's Fair 20252025
John DickersonAI Engineer World's Fair 20252025
Shelby HeineckeAI Engineer World's Fair 20242024
Sharmila Chokalingam, ShubhiAI Engineer World's Fair 20242024
Stephen ChinAI Engineer World's Fair 20252025
Rajat ShahAI Engineer World's Fair 20262026
Boris Bogatin, Toufic BoubezAI Engineer Code 20252025
Brendan RappazzoAI Engineer World's Fair 20262026
Justin SmithAI Engineer World's Fair 20262026
Anthropic for VPs of AI

Metadata candidate

Alexander Bricken, Joe BayleyAI Engineer Summit 20252025
Don Bosco DuraiAI Engineer Summit 20252025
Sunny MadraAI Engineer World's Fair 20242024
Raj NavakotiAI Engineer Europe 20262026
Rita KozlovAI Engineer World's Fair 20252025
Jerry LiuAI Engineer World's Fair 20252025
Ben KusAI Engineer World's Fair 20252025
Lou BichardAI Engineer World's Fair 20252025
Building Self-Coding Agents

Metadata candidate

Colin FlahertyAI Engineer Summit 20252025
Sandra KublikAI Engineer World's Fair 20242024
Eric ZakariassonAI Engineer Europe 20262026
Morgante PellAI Engineer World's Fair 20242024
Cohere for VPs of AI

Metadata candidate

Vivek MuppallaAI Engineer World's Fair 20242024
Jon Peck, Christopher HarrisonAI Engineer World's Fair 20252025
Dylan PatelAI Engineer World's Fair 20242024
Stephen ChinAI Engineer Code 20252025
Dominik KundelAI Engineer World's Fair 20242024
Hanchi WangAI Engineer World's Fair 20242024
Sahil Yadav, Hariharan GanesanAI Engineer World's Fair 20252025
Mahesh SathiamoorthyAI Engineer World's Fair 20262026
Mani KhanujaAI Engineer World's Fair 20252025
Phil HetzelAI Engineer Europe 20262026
Kevin MaduraAI Engineer Code 20252025
Sheila Gulati, Nischal NadhamuniAI Engineer World's Fair 20242024
Rhythm Garg, Linden LiAI Engineer Code 20252025
Benjamin FletcherAI Engineer World's Fair 20242024
Kevin BaiAI Engineer World's Fair 20262026
Pauline BrunetAI Engineer World's Fair 20262026
Brooke HopkinsAI Engineer World's Fair 20252025
Jason LopateckiAI Engineer World's Fair 20262026
Paola Estefanía de CamposAI Engineer World's Fair 20262026
Jerry LiuAI Engineer World's Fair 20242024
The Future of MCP

Metadata candidate

David Soria ParraAI Engineer Europe 20262026
Fuzzing in the GenAI Era

Metadata candidate

Leonard TangAI Engineer World's Fair 20252025
Dave BurnisonAI Engineer World's Fair 20242024
Dave Burnison, Alex Malebranche, Dimitrios Philliou, Christina Warren, HaraldAI Engineer World's Fair 20242024
Giving a Voice to AI Agents

Metadata candidate

Scott StephensonAI Engineer World's Fair 20242024
Mark MyshatynAI Engineer World's Fair 20252025
Vasant KearneyAI Engineer World's Fair 20262026
Donald HruskaAI Engineer World's Fair 20252025
Jia WuAI Engineer World's Fair 20262026
Eno ReyesAI Engineer World's Fair 20262026
Leo MehrAI Engineer World's Fair 20262026
Vinoo GaneshAI Engineer World's Fair 20262026
Patrick DoughertyAI Engineer Summit 20252025
Hamel Husain, Greg CeccarelliAI Engineer Summit 20252025
Paul GilbertAI Engineer Summit 20252025
Yegor Denisov-BlanchAI Engineer Code 20252025
Mustafa Ali, Kyle CorbittAI Engineer Summit 20252025
Tariq ShaukatAI Engineer World's Fair 20262026
Lachlan Ainley, Humza IqbalAI Engineer World's Fair 20242024
Sarthak AggarwalAI Engineer World's Fair 20262026
Raymond FengAI Engineer World's Fair 20262026
Rukma SenAI Engineer World's Fair 20242024
Rachelle Mattern, Petro Milan, Varun KrishnaAI Engineer World's Fair 20242024
Daniel WhitenackAI Engineer World's Fair 20242024
Kwindla Kramer, Shrestha Basu MallickAI Engineer World's Fair 20252025
Vikhyat KorrapatiAI Engineer World's Fair 20242024
Ahmed MenshawyAI Engineer World's Fair 20242024
On AI and Knowledge

Metadata candidate

Pablo CastroAI Engineer World's Fair 20262026
Garrett GalowAI Engineer Europe 20262026
OpenAI for VPs of AI

Metadata candidate

Prashant Mital, Toki SherbakovAI Engineer Summit 20252025
Michael Hunger, Stephen Chin, Jesús BarrasaAI Engineer World's Fair 20252025
RAG for VPs of AI

Metadata candidate

Jerry LiuAI Engineer World's Fair 20242024
Tengyu MaAI Engineer World's Fair 20252025
Kshitij GroverAI Engineer World's Fair 20252025
Onur SolmazAI Engineer Europe 20262026
Alessandro CappelliAI Engineer Europe 20262026
Arjun Desai, Rohit TalluriAI Engineer World's Fair 20252025
Eno ReyesAI Engineer World's Fair 20252025
Shreya Rajpal, Aman GuptaAI Engineer World's Fair 20262026
Yogendra MirajeAI Engineer World's Fair 20262026
Asaf BordAI Engineer Code 20252025
Louis Knight-WebbAI Engineer Europe 20262026
State of Data

Metadata candidate

Sean CaiAI Engineer World's Fair 20262026
Thiyagarajan MaruthavananAI Engineer World's Fair 20262026
Taylor Jordan SmithAI Engineer World's Fair 20252025
Cedric ClyburnAI Engineer World's Fair 20262026
Barr YaronAI Engineer World's Fair 20252025
Christopher Harrison, John PeckAI Engineer World's Fair 20252025
Kevin Madura, Mo BhasinAI Engineer World's Fair 20252025
Corey GallonAI Engineer World's Fair 20262026
Ahmad OsmanAI Engineer World's Fair 20262026
Natalie MeurerAI Engineer World's Fair 20262026
Justin SchroederAI Engineer World's Fair 20262026
Diego Rodriguez, Eugene, Jonas Bauer, Shijia Liao, David Vorick, Alex AtallahAI Engineer World's Fair 20252025
The Pipeline Is Dead

Metadata candidate

Iris ten TeijeAI Engineer World's Fair 20262026
Kshitij GroverAI Engineer Summit 20252025
Beyang LiuAI Engineer World's Fair 20242024
Maxime Rivest, Isaac MillerAI Engineer World's Fair 20262026
Paul Klein IVAI Engineer World's Fair 20252025
Emil EifremAI Engineer World's Fair 20262026
Forrest Brazeal, Matt BallAI Engineer World's Fair 20252025
Philip RathleAI Engineer World's Fair 20242024
Itamar FriedmanAI Engineer World's Fair 20252025
Andy TriedmanAI Engineer Summit 20252025
Eugene CheahAI Engineer Summit 20252025
Ramana Siddanth EmaniAI Engineer World's Fair 20262026
Tun Shwe, Jeremy FrenayAI Engineer Europe 20262026
Mike PhippsAI Engineer World's Fair 20262026

References

Coverage and source review
Processed transcripts
72 processed in full · 5 in the curated path
Automated source review
Passed
Metadata candidates
133 unreviewed; not verified topic membership
Corpus version
1bd8e407b26a07b33815594e1b2db5f41827119a2b3cb6fbf240f9fc571fc767

Automated review checks source support; it is not publication approval.

A synthesis of selected conference talks and technical references. Citations link to the source material; they do not imply that every talk on this subject is included.

  1. OECD: The Impact of AI on the Workplace—Main Findings from the OECD AI Surveys of Employers and Workers

    The OECD’s 2023 report describes surveys conducted mainly in January–February 2022, before ChatGPT’s release. Workers reported benefits alongside concerns about job security, work intensity and employer collection of performance data. Training and consultation were associated with more favorable reported outcomes. The survey encompassed established applications such as fraud detection, visual quality inspection and predictive maintenance, illustrating that enterprise AI adoption predates generative assistants and changes both tasks and working conditions.

  2. Anthropic: Building effective agents

    Anthropic distinguishes workflows with predefined code paths from agents that dynamically choose their processes and tools. Prompt chains can include programmatic checks between steps; routing and parallel work address different task structures. More autonomy can increase cost, latency, and opportunities for error, so the appropriate architecture depends on task predictability and the value of flexibility. The engineering implication is to start with a bounded workflow and introduce dynamic decisions only where evaluation shows they help.

  3. UK Government: The People Factor—A Human-Centred Approach to Scaling AI Tools

    The guidance defines successful implementation around sustained, high-quality use by intended users. It recommends investigating perceived relevance, competence, attitudes, manager support and available assistance rather than assuming nonuse reflects lack of awareness. It distinguishes routine use from effective and safe use, including recognizing unsuitable tasks and having time to check consequential outputs.

  4. Operating Model Canvas

    The authors describe an operating model through the work needed to deliver a service, the people performing it, locations and assets, supporting information systems, suppliers, and management processes. These arrangements translate strategy into operating choices. Their tools include decision grids and process-owner grids, and support describing both current and intended operations.

  5. Eric Trist: The Evolution of Socio-Technical Systems

    Trist’s retrospective traces Tavistock’s mining investigations to 1949. Mechanization did not dictate one work organization: miners developed arrangements with interchangeable roles, group responsibility and less external supervision. A sociotechnical system couples people and their working arrangements with the equipment and processes used to produce an outcome. Trist describes joint optimization as designing the social and technical components together; optimizing either independently can impair the whole. He also recounts management resistance to greater group autonomy, showing that technically feasible changes can redistribute authority.

  6. Build Dynamic Products, and Stop the AI Sideshow

    The speakers' 'AI sideshow' describes AI strategy operating separately from core product strategy, with separate initiatives or teams encouraging bolt-on functionality.

  7. Edward A. Feigenbaum: The Art of Artificial Intelligence—Themes and Case Studies of Knowledge Engineering

    Feigenbaum’s 1977 account presents knowledge engineering as acquiring specialist knowledge, representing it and applying it to explain domain conclusions. Stanford’s PUFF collaboration with Pacific Medical Center elicited pulmonary interpretation rules through intensive work with an expert. Running additional cases exposed gaps and inconsistencies, prompting revisions. PUFF reused MYCIN’s inference machinery with different domain rules. The account illustrates both reusable technical capabilities and irreducibly domain-specific knowledge work; the operational knowledge was not simply available in a textbook.

  8. Michael Hammer: Reengineering Work—Don’t Automate, Obliterate

    Hammer distinguishes redesigning a business process from accelerating its existing steps. His Ford account describes replacing accounts-payable reconciliation of purchase orders, receiving documents and invoices with shared purchase-order information checked when goods arrive. Purchasing, receiving and payment procedures changed together, including asking suppliers to stop sending invoices. The mechanism removed reconciliation work rather than merely helping clerks perform it faster.

  9. Brynjolfsson, Rock and Syverson: The Productivity J-Curve

    The authors model complementary investments in processes, managerial experience, worker training and other intangible assets alongside general-purpose technologies. Resources used to build these assets can initially reduce measured output without being recognized as investment. Later output can benefit from the accumulated assets. This explains a possible measurement pattern and why technology expenditure alone omits important organizational work.

  10. AI tools for Forward Deployed Engineering

    Interview process leads about exception handling and actual handoffs before designing automation.

  11. The Production AI Playbook: Deploying Agents at Enterprise Scale

    Define business success and build a representative evaluation dataset before comparing models; reuse that dataset to assess provider upgrades.

  12. APM Body of Knowledge, Seventh Edition: Transition into Use

    APM treats business readiness as work throughout delivery, including skill gaps, operating impacts and legitimate dissent. Transition involves agreed acceptance criteria, testing with operational users, documentation and transfer of responsibility. Higher-risk transitions need contingency arrangements. Adoption requires continuing support, and benefits tracking remains accountable after handover. The guidance warns against claiming savings by increasing operating costs elsewhere.

  13. NIST AI RMF Core

    NIST connects measurement to deciding whether a system achieves its intended purpose and whether development or deployment should proceed. Risk responses include mitigation, avoidance and acceptance; remaining risks should be documented. The framework includes considering viable non-AI alternatives and assigning responsibility for superseding, disengaging or deactivating systems whose outcomes conflict with intended use. It also calls for evaluating measurement processes themselves and maintaining post-deployment monitoring, feedback, incident response, recovery and change management.

  14. Rother and Shook: Learning to See, Part I

    A value stream includes the actions currently required to bring a product through production or development, including actions that do not add customer value. The authors distinguish improving the whole flow from optimizing individual processes. Material and information flows belong on the same map, and the complete flow can cross company boundaries.

  15. Mike Rother: Value-Stream Mapping in a Make-to-Order Environment

    Releasing work as differently sized customer orders can cause work to accumulate between stages, disrupt sequence and produce unpredictable delivery. Rother proposes regulating release in units of work based on bottleneck capacity. His illustrative painting process receives one hour of painting work per hour; removing that constraint would make another process determine the pace.

  16. Missing pieces of workflow automation

    AI practitioners should redesign workflows together with domain specialists.

  17. Moving away from Agile: What's Next?

    Automation can move the bottleneck into human collaboration and manual review while increasing code complexity.

  18. Gabriel Szulanski: Exploring Internal Stickiness—Impediments to the Transfer of Best Practice Within the Firm

    Szulanski’s 1996 study examined 122 best-practice transfers within eight companies. Important transfer difficulties concerned recipients’ absorptive capacity—the ability to understand and apply incoming knowledge—uncertainty about why a practice works, and difficult source–recipient relationships. Transferring a practice involves reproducing coordinated activity in a receiving unit, not merely distributing information. Adaptation, initial operating problems and establishing routine use can each require additional work after the transfer begins.

  19. Ikujiro Nonaka: A Dynamic Theory of Organizational Knowledge Creation

    Nonaka’s February 1994 theory distinguishes explicit knowledge, expressible in formal language, from tacit knowledge rooted in experience, action and context. Tacit knowledge includes practical skills and mental models that can be difficult to articulate. Individuals create knowledge, while organizational interaction develops and amplifies it across groups. This account treats organizational knowledge as more than stored information: interpreting experience and developing shared understanding are part of its creation.

  20. UK Government: Data Ownership Model

    The model separates accountable data owners, who authorize major changes and answer for them, from stewards responsible for everyday management. Owners oversee meaning, quality, use and access; stewards facilitate access processes and investigate, triage and remediate quality problems. Common definitions and authoritative sources support sharing. Its RACI legend distinguishes Responsible, doing the work; Accountable, owning the outcome; Consulted, providing input; and Informed, receiving updates.

  21. W3C PROV-DM: Evidence Entities and Derivations

    PROV represents entities, activities and responsible agents, with relations for usage, generation, derivation, revision and attribution. Application design inference: represent each source revision and extracted passage as separately identifiable entities; record which passages an answer-generation activity used and which answer it produced. Store source URI, version or content hash, passage locator, retrieval time and domain-specific effective dates as attributes. Keep publication, retrieval and business-effective times distinct. Preserve conflicting assertions as separate attributed evidence, recording the policy and evidence used to resolve or report the conflict.

  22. Consortium for Service Innovation: KCS v6 Practices Guide

    KCS distinguishes reusable learning from customer-specific incident information. Articles record the issue, applicable environment and resolution, with metadata for versions and contributors. Article state separates confidence, audience and governance: an unresolved article or a complete but unvalidated answer can exist without being treated as validated guidance. Publishing privileges depend on demonstrated competence. Restricted resolution instructions can remain separate from information visible to requestors.

  23. Soloway, Bachant and Jensen: Assessing the Maintainability of XCON-in-RIME

    The 1987 Yale–Digital Equipment Corporation paper reports that XCON had configured DEC computers in production since January 1980. Its approximately 6,200 rules required continual revision for new products and computing concepts, with about half changing annually. Productive operation coexisted with growing maintenance difficulty: rule interactions and undocumented rationale made changes hazardous. Maintainers sometimes needed the original authors or institutional memory to understand existing behavior. These experiences motivated RIME, which made domain structure and control relationships more explicit.

  24. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

    RAG combines knowledge represented in model parameters with an external document index. A retriever selects passages relevant to a query and a generator conditions its output on the selected evidence. The original paper demonstrates that changing the index can change answers without retraining the generator, separating knowledge maintenance from parameter updates. Retrieval also makes selected evidence inspectable. In an enterprise application, this creates separate failure points for source ingestion, retrieval, and answer generation.

  25. Open Data Contract Standard v3.0.0

    A data contract records an agreement between a producer and consumers. ODCS includes sections for schema, data quality, support and communication channels, teams, roles and service-level agreements, alongside infrastructure and pricing. This makes the agreement broader than a structural data schema.

  26. OWASP Access Control

    Authentication establishes identity; authorization decides which actions that identity may perform on particular resources. A user allowed to initiate a transfer must still be authorized for the source account. Least privilege limits the authority of running code and service accounts, while centralized checks reduce inconsistent enforcement. In an AI application, tool availability and a model-produced argument are therefore insufficient grounds to execute a business operation; the application must apply resource- and action-level policy.

  27. Identity for AI Agents

    Authentication to the agent and permission to access upstream resources are separate steps, even when both applications use the same credentials.

  28. How to Secure Agents using OAuth

    Choose the OAuth flow according to whose authority the agent is exercising: authorization code for end-user delegation, client credentials for its own behalf.

  29. Azure AI Search: Document-level access control

    Enterprise retrieval needs an access decision at document level as well as permission to call the search service. Azure’s guidance distinguishes application-supplied security filters from native permission-aware filtering. The filter pattern attaches user or group identifiers to indexed documents and restricts query results using the caller’s identity. Native integrations additionally interpret supported permission metadata and identity tokens. Chunking must preserve permission metadata in the indexed projections. The security requirement is to exclude unauthorized content before it enters the answer-generation context.

  30. AWS Well-Architected: Set Client Timeouts

    Set connection and request timeouts on remote dependencies. Excessively long timeouts retain resources; excessively short ones can create retries and overload. A client timeout does not necessarily release server resources or establish that the server did nothing. Engineering budget rule: total attempt durations, retry delays and local overhead must fit the end-to-end deadline; each new attempt must fit the remaining budget. Server-side limits are also needed for expensive work.

  31. NIST Privacy Framework 1.0: lifecycle and minimized audit evidence

    The framework inventories data elements, processing purposes, actions, owners and flows. Policies define permitted uses and retention periods; the data lifecycle aligns with system development and operations. Authorizations must be maintained and revocable, access limited by least privilege, and deletion and destruction performed under policy. Audit records themselves must incorporate data minimization. Engineering application: define the decision evidence needed for review, its purpose, authorized readers, retention trigger and disposal method before logging. Retain the necessary decision, model and policy versions and relevant evidence without indiscriminately copying personal data into logs, prompts or backups. Where review requires sensitive evidence, constrain fields, access and retention rather than treating auditability as permission to keep everything. Assess removal and disclosure across downstream copies and service providers.

  32. Workday Help Datasheet

    Workday describes HR assistance combining knowledge articles and case management. Documented capabilities include AI-assisted drafting and translation, author review before publication, article version control, approval workflows, contextual employee information for case solvers, restricted case access and configurable service-level agreements. This provides a concrete product example connecting answer preparation with maintained guidance and receiving-team procedures.

  33. Bringing agents onto the world wide web

    Secure login, permission management, and human approval remain separate barriers to enterprise browser automation.

  34. NIST Generative AI Profile: Third-Party Risk

    NIST recommends inventorying third parties with access to organizational content, assessing suppliers and specifying security, ownership, usage and provenance expectations in contracts. Examine secondary data use, incident notification, service continuity and responsibility for system changes. These concerns apply to proprietary and open-source components, fine-tuned models and embedded tools. Hosting inference internally does not remove risks from acquired weights, training data, libraries or external integrations. Evaluation, access governance, monitoring and incident ownership remain organizational responsibilities.

  35. The engineer of the future is the person who is able to choose what is worth doing — Addy Osmani

    Let agents investigate, implement, test, and report in the inner loop while accountable owners decide, verify, approve, and own production outcomes in the outer loop.

  36. NIST AI Risk Management Framework 1.0

    NIST organizes lifecycle risk work into Govern, Map, Measure and Manage. Identify affected populations and deployment context, consult relevant communities, evaluate harmful bias and document results rather than relying only on aggregate performance. Assign clear responsibilities, executive accountability and human-oversight roles. Evaluate under conditions resembling deployment, document limits and unmeasurable risks, and monitor after release. Engineering implication: material subgroup harms or ineffective oversight should affect deployment scope, mitigations and whether to proceed, with explicit ownership of acceptance and incident decisions.

  37. What Does Done Even Mean? Agents and Paperclip's Liveness Model - Dotta, Paperclip

    Define a clear chain of custody so each agent knows who receives the work after its step finishes.

  38. The Build-Operate Divide: Bridging Product Vision and AI Operational Reality

    Automated evaluations do not eliminate the human review capacity bottleneck identified by the speakers.

  39. What Does Done Even Mean? Agents and Paperclip's Liveness Model - Dotta, Paperclip

    Exhaustive human review can become a queue bottleneck and verification theater when agents produce work faster than people can inspect it.

  40. Lisanne Bainbridge: Ironies of Automation

    Automating what designers can automate can leave people with an incoherent collection of difficult residual tasks. Monitoring and abnormal-condition recovery still require operational and diagnostic expertise. Bainbridge explains the tension between expecting skilled intervention and removing the routine practice through which those skills develop and remain available. Classroom instruction without practical exercises may not preserve usable operating knowledge.

  41. Belzak, Niu and Ortmann Lee: When Machines Mislead—Human Review of Erroneous AI Cheating Signals

    Duolingo researchers inserted fabricated copy-typing alerts into reviews of previously certified test sessions without affecting test-taker results. Proctors retained decision authority. Guidelines revised on March 28, 2025 removed irregular typing as a criterion and emphasized independent video evidence. Model-estimated rejection of fake alerts increased from 50% in the January–February study to 71% in July. Reviewers nevertheless continued accepting some fake alerts, and rejection patterns differed across nationality groups. The case demonstrates why review instructions and observed reviewer behavior must be examined alongside model performance.

  42. The Build-Operate Divide: Bridging Product Vision and AI Operational Reality

    Existing QA and customer-experience operations teams can contribute interaction evaluation, edge-case discovery, prompt testing, and output tagging.

  43. Atkin and colleagues: Organizational Barriers to Technology Adoption—Evidence from Soccer-Ball Producers in Pakistan

    Researchers distributed a material-saving cutting technology to randomly selected soccer-ball producers in May 2012, but adoption remained low after 15 months. Cutters and printers were commonly paid per piece: material savings benefited owners while initially slower work threatened employees’ earnings. A second experiment offered workers payments conditional on demonstrating competence with the technology and increased adoption. The case makes incentive concrete: a reward tied to an existing output measure can discourage a change that benefits the organization.

  44. Amy Edmondson: Managing the Risk of Learning—Psychological Safety in Work Teams

    Edmondson explains how asking questions, admitting mistakes, seeking help and criticizing current performance can threaten a worker’s perceived competence or standing. Psychological safety concerns whether the work environment permits these interpersonal risks. Avoiding such risks can suppress the exchanges through which teams learn.

  45. KCS v6 Practices Guide: Summary

    The KCS authors recommend setting goals for outcomes while using activity counts to understand trends. They describe knowledge management as organizational change involving values, interactions and processes, with executive funding, sustained communication and supported coaching. Performance assessment should consider value created by individuals and teams through both qualitative and quantitative evidence.

  46. Prosci: Definition of Change Management

    Prosci defines change management as structured work supporting the people affected by a change so they can adopt and use it. It distinguishes delivering a technical solution from preparing, equipping and supporting people whose everyday work changes. The extent of support depends on disruption to work and the organization’s circumstances.

  47. May and colleagues: Development of a Theory of Implementation and Integration—Normalization Process Theory

    The May 2009 paper explains routine adoption through continuing individual and collective work. Coherence concerns making sense of the practice; cognitive participation concerns enrolling and sustaining participants; collective action concerns doing the work; reflexive monitoring concerns appraising how it works. Normalization Process Theory extends an earlier healthcare implementation model beyond operational activity alone to include meaning, commitment and appraisal. Sustaining a practice requires continuing investment rather than a completed installation.

  48. The Evolving SRE Engagement Model — Google SRE

    Google describes service onboarding as a progressive transfer of production responsibilities, including operations, change management, and access rights. Before transfer, the receiving SRE team receives documentation, design and request-flow instruction, production setup information, and hands-on operating exercises. The development team remains available during the transition. Production experience subsequently informs proposed service improvements.

  49. Amazon SageMaker AI: Shadow Tests

    Shadow testing sends a copy of production inference requests to a candidate model while returning only the production model's response to the application. Candidate outputs can be discarded or logged for offline comparison. Engineering inference for agents: suppressing the returned answer does not suppress tool effects. Route shadow tools to read-only access, mocks or isolated state, and prevent the shadow path from issuing real payments, messages or other mutations.

  50. HM Treasury and Government Finance Function: The Government Efficiency Framework

    The framework distinguishes direct spending reductions from monetizable benefits that leave spending unchanged, such as handling more queries with the same staff. Efficiency claims must preserve outcomes, subtract delivery costs, avoid consequential costs elsewhere and avoid double counting. Benefits methods require a baseline, documented assumptions and evidence. A benefit owner works with finance and analysts, and monitoring continues into normal operations because benefits may arise after project delivery.

  51. Leadership in AI-Assisted Engineering

    Apply Eli Goldratt's Theory of Constraints to find the workflow bottleneck; the speaker gives legacy-code reverse engineering as a concrete target.

  52. Leadership in AI-Assisted Engineering

    The DX AI Measurement Framework separates utilization, impact, and cost, and treats speed and quality as joint outcome concerns.

  53. Humlum and Vestergaard: Still Waters, Rapid Currents—Early Labor Market Transformation under Generative AI

    Humlum and Vestergaard link Danish chatbot-adoption surveys to administrative employment records. Their March 13, 2026 paper reports substantial changes in work, including content generation, AI oversight and integration tasks, alongside precise null estimates for earnings and recorded hours at worker and workplace levels. The authors report excluding effects larger than 2% over the two years following ChatGPT’s launch. Changes in tasks and reported productivity benefits therefore need not immediately appear as changes in paid hours or earnings.

  54. Hernán and Robins: Causal Inference—What If

    A causal effect compares outcomes under alternative interventions. A counterfactual outcome describes what would occur under a specified action. Shared causes of action and outcome create confounding: their observed association includes a path other than the action's effect.

  55. AI Consulting in Practice — Nathaniel Whittemore (NLW), Superintelligent

    The reported ROI findings describe an engaged, self-selected AI audience with substantial industry concentration, rather than a representative enterprise population.

  56. Microsoft 365 Copilot Experiment: Cross-Government Findings Report

    The three-month trial provided 20,000 employees with licenses, obtained 7,115 survey responses and collected usage data for 14,500 users. Active use meant at least one interaction in 30 days. Reported daily time savings were participants’ estimates, and the study could not identify how saved time was spent. Departments supplied user support; existing workloads limited some participants’ training. Temporary access, holiday timing and uneven rollout complicated interpretation.

  57. Brynjolfsson, Li and Raymond: Generative AI at Work

    The study follows 5,172 support agents during staggered AI-assistant adoption. Agents retained discretion over suggested messages and received contextual documentation links. The preferred analysis estimates approximately 15% more resolved issues per hour, with heterogeneous effects across experience and skill. Training capacity and budgets constrained rollout. The authors address initial selection through longitudinal comparisons and controls; resolution-based productivity is available only for the subset with consistently recorded quality outcomes.

  58. Dell’Acqua and colleagues: Navigating the Jagged Technological Frontier

    In a preregistered experiment with 758 BCG consultants, participants received no AI, GPT-4, or GPT-4 with a prompting overview. AI improved completion, speed and assessed quality on product-development tasks, but reduced correctness on a separately designed business-analysis task. A jagged frontier means that tasks appearing similarly difficult to people can differ sharply in whether AI assistance helps. The relevant adoption decision therefore concerns particular human–AI task arrangements, not an occupation-wide assumption that assistance is beneficial.

  59. Build Evals That Actually Matter - Nick Ung & Akshay Sharma, Lyft

    Use domain-specific task success criteria as core metrics; generic quality scores can remain baselines.

  60. Build Evals That Actually Matter - Nick Ung & Akshay Sharma, Lyft

    Continuously inspect execution traces and use annotation queues to turn domain-expert feedback into labeled evaluation datasets.

  61. One Registry to Rule them All - Sonny Merla, Mauro Luchetti, & Mattia Redaelli, Quantyca

    The MCP and A2A template repositories standardize operational concerns while the A2A blueprint leaves agent implementation behind shared interfaces and ports.

  62. Challenges to Scaling Agents for Generative AI Products

    Use an integrated team while product boundaries are uncertain, then introduce horizontal capabilities as agent responsibilities become clearer.

  63. Enterprise Agents Have a Structure Problem - Ishita Daga, Tesla

    Prefer sources with an active review and update process, rather than assuming connected documents remain current.

  64. The Production AI Playbook: Deploying Agents at Enterprise Scale

    Prompt change management should record the failure that motivated each change and the behavior the change is intended to correct.

  65. Production Evals For Agentic AI Systems

    Build a continuous evaluation loop that turns telemetry and human review into datasets used to validate updates offline.

  66. One Registry to Rule them All - Sonny Merla, Mauro Luchetti, & Mattia Redaelli, Quantyca

    A use-case registry connects business applications to agents, tools, models, and deployment systems so teams can trace affected applications when a dependency fails or changes.

  67. Azure Architecture Center: Compensating Transaction

    A multi-step operation may commit some steps before a later step fails. Compensation performs business-specific actions that offset completed work, using durably recorded progress and undo information. It differs from database rollback: prior commits and concurrent changes cannot simply be erased, and compensation need not restore the original state or run in exact reverse order. Compensation can also fail; record its progress, resume safely with idempotent commands and alert operators when manual recovery is required. Identify irreversible steps and validate before crossing them.

  68. What Does Done Even Mean? Agents and Paperclip's Liveness Model - Dotta, Paperclip

    Separate producer claims, independent review, verification against a standard, authorized approval, accountability, and survival under real conditions.

  69. Building agents is trivial now, context is the next frontier

    Removing the human from the loop also removes a source of missing facts and error correction.

  70. Build Dynamic Products, and Stop the AI Sideshow

    The Workday Help example integrates policy-document transformation, translation, and version management into the authoring workflow.

  71. One Registry to Rule them All - Sonny Merla, Mauro Luchetti, & Mattia Redaelli, Quantyca

    AmplifAI separates central guideline setting from country and corporate execution, with governance, platform, and factory as distinct program responsibilities.