Contents
  1. Financial work and its development
    1. Four kinds of financial work
    2. Scoring, rules, and financial language
  2. Financial records and their use
    1. Preserve what a financial fact means
    2. Separate reporting time from known time
    3. Check permission for the actual use
  3. Applying AI to financial workflows
    1. Build checked financial research
      1. Calculation and interpretation
    2. Reconcile records and resolve exceptions
    3. Resolve the customer's financial problem
    4. Keep scores separate from decisions
    5. Identify the exposure and scenario
  4. Authority and authoritative effects
    1. Authorize the actual financial action
    2. Connect terms, entitlement, and receipt
    3. Resolve uncertain execution
  5. Evidence of useful performance
    1. Measure the financial workflow
    2. Respect the historical information boundary
    3. Keep missing and delayed outcomes visible
  6. Institutional responsibility and intervention
    1. Assign ownership and independent challenge
    2. Make review capable of changing the outcome
  7. Deployment and continued control
    1. Choose a bounded operating mode
    2. Reconstruct, monitor, and reassess
  8. Check understanding
  9. Open questions
  10. Selected talks
  11. References
  12. Talk library
← All topics

AI in Finance

Learn how teams apply AI to financial research, document extraction, reconciliation, and customer assistance. This guide connects lessons from AI Engineer talks with the controls needed to evaluate and operate these systems.

From previous AI Engineer events

For an in-person event on this theme, explore AI Engineer New York’s financial-services conference (October 12–14, 2026).

Financial work and its development

Four kinds of financial work

Financial institutions and finance teams work with rights and obligations. A financial instrument is a contract that creates a financial asset for one party and a financial liability or equity instrument for another. A loan, for example, connects a lender's right to receive payments with a borrower's obligation to make them. This contractual meaning matters: describing an obligation, recording it, and fulfilling it are different activities. AASB 132 supplies the formal definition.

Financial operations maintain financial records and carry transactions through their required stages. Decision support prepares information for a consequential choice. Neither automatically grants decision authority: permission and responsibility to approve or execute that choice. Research, operations, customer service, and decision support can share document-reading capabilities while requiring different completion checks.

Treat these as workflow families, not mutually exclusive departments.
WorkInputs and useful outputResponsibility and possible effect
ResearchDisclosures and records → checked analysisAn analyst reviews the conclusion; a separate decision may commit capital.
OperationsStatements and internal records → resolved discrepanciesOperations staff control corrections and completion; errors can misstate books or misdirect payments.
Customer serviceCustomer request, policy, and account facts → resolution or escalationService staff act within account permissions; answers can affect access to help and financial choices.
Decision supportApplicant or transaction information → assessment and proposed dispositionAuthorized decision-makers determine credit or payment treatment; affected parties include borrowers and legitimate customers.

This breadth is visible in the Bank of England and FCA's 2024 survey of 118 firms. Respondents described operational, fraud, risk, and other applications; the survey separately classified automation and materiality. Adoption therefore did not mean autonomous authority. The reported benefits were firms' perceptions, not controlled measurements of productivity.

Scoring, rules, and financial language

Financial AI draws on several continuing traditions. Credit scoring estimates credit-related outcomes from applicant or account information. An expert system applies explicitly represented domain rules. Financial language processing interprets text whose meaning depends on accounting and business context. Their histories explain why a language assistant can extend an existing workflow without replacing its numerical models or controls.

Contributions that still coexist

  1. 1941Credit-Rating FormulaeCombines borrower attributes statistically to support credit investigation.Sources & context

    Contributors: David Durand; 1941 NBER chapter.

    What changed: Examined statistically derived weights as an alternative to intuitive weighting. Durand treated the formulae as supplements to judgment and warned that previously approved loans did not represent the full applicant population.

  2. 1988 deploymentAuthorizer’s AssistantCombines account records with credit and fraud policies for authorization.Sources & context

    Contributors: American Express and Inference Corporation; reported in 1989 by Dzierzanowski, Chrisman, MacKinnon, and Klahr.

    What changed: Handled selected U.S. Personal and Gold card transactions automatically and advised human authorizers on others. Integration, acceptance testing, and transfer of business control to operations were part of deployment.

  3. 1992FalconApplies neural-network modeling to payment-fraud detection.Sources & context

    Contributors: FICO; date attributed to its retrospective corporate history.

    What changed: Addresses suspicious payment patterns, distinct from estimating repayment risk or processing credit applications. FICO’s retrospective dates Falcon to 1992.

  4. February 2011Loughran–McDonaldMeasures financial text with domain-appropriate word categories.Sources & context

    Contributors: Tim Loughran and Bill McDonald; When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks.

    What changed: General negative-word lists mischaracterized financial filings. The contribution was better measurement of financial meaning, not simply a larger vocabulary.

  5. March 2023BloombergGPTUses mixed financial and general text for broad financial-language tasks.Sources & context

    Contributors: Shijie Wu, Ozan Irsoy, and colleagues; March 2023 introduction.

    What changed: The 50-billion-parameter model supports tasks including entity recognition, entity linking, and question answering. Its benchmark findings concern language capabilities, not autonomous investment decisions or completed transactions.

Statistical scoring, explicit policies, fraud models, and financial-language processing support different responsibilities rather than successively replacing one another. Spacing is not to scale.

These developments did not eliminate one another. A financial application can use language processing to interpret documents, a predictive model to prioritize cases, explicit rules to enforce policy, and people to investigate exceptions. The useful architectural question is which responsibility each component can support.

Financial records and their use

Preserve what a financial fact means

An issuer creates an instrument; an account records a financial relationship and activity; a holding, or position, gives the instrument quantity held there. A transaction records activity; a balance gives an amount at a time. Keep these identities distinct when joining records: an issuer does not identify an instrument, holding, or payment.

Different records answer different questions. Reference data supplies identifying and contractual attributes; a security master is an institution's maintained collection of such instrument records. Transaction data records activity. Financial statements summarize position or performance. A balance sheet reports assets, liabilities, and equity at an instant: resources, obligations, and the owners' residual interest. An income statement reports revenue and expenses over a period; a cash-flow statement reports cash movements. Profit therefore differs from cash received. Before comparing extracted amounts, preserve the entity, measure, period, currency, scale, and accounting context. The U.S. Securities and Exchange Commission's financial-statements guide explains these distinctions.

Standards preserve different parts of this meaning. A Legal Entity Identifier (LEI) identifies a legal entity; an International Securities Identification Number (ISIN) identifies an instrument. Their issuer mapping does not identify a customer's holding or payment, and missing coverage is not proof of nonexistence. eXtensible Business Reporting Language (XBRL) represents reporting facts with context rather than bare values.

The xBRL-JSON tutorial provides an illustrative assets fact, not an actual company's report.
FieldMeaning to preserve
Entity and conceptWhose assets the fact describes, and which reporting concept it uses.
Reporting instant2020-01-01 at midnight represents the end of December 31, 2019.
Value and unitEUR 1,230,000; numerical strings avoid representation-related precision loss.
Precision and qualificationsDeclared precision, applicable dimensions, and footnotes qualify interpretation; they do not certify truth.

Extraction must retain these relationships even when they appear in a table heading or footnote rather than beside the number. See Recover table meaning. A standardized record is easier to process, but still needs semantic checking against its source.

Separate reporting time from known time

Provenance records information's origin and history. Distinguish reporting period, publication, application receipt, and correction. As-of information is eligible at a cutoff. A restatement revises earlier reported amounts; the IAS 8 overview describes retrospective correction of material prior-period errors, subject to its conditions.

FRED's real-time periods retrieve historical information; its current view includes revisions. Date-level vintages establish neither intraday publication nor ingestion. Application replay must respect later receipt.

Aggregation can obscure this boundary. EDGAR frames select the last-filed fact fitting a calendar period; that historical period is not a historical availability guarantee. Its aggregate XBRL APIs also exclude some custom and segment disclosures. Preserve the selected source version rather than assuming an API's convenient view is the required information set.

In a hypothetical example, both versions describe the same company’s quarterly revenue in USD millions. The application receives the original value of 100 before its decision cutoff. A correction to 96 is published before the cutoff but reaches the application afterward. Historical replay retains 100; the later corrected view uses 96. See Origins, times and permitted use for provenance and Applicable sources and unresolved conflicts for alignment before synthesis.

Published does not mean received

Both versions describe Company C’s quarter Q revenue, in USD millions. Event order runs left to right; spacing does not measure elapsed time.

Publication and receipt define different boundariesOriginal 100 is published and received before cutoff. Revision 96 is published before cutoff but received after it. Historical application replay uses 100; a later corrected view uses 96.Earlier eventsLater eventsDecision cutoffOriginal: 100PublishedReceivedRevision: 96PublishedReceivedReplay uses 100Corrected view uses 96Thin horizontal lines align version events. Arrowed branches identify selected versions, not transfers of money.

At cutoff: USD 100 million
The original was received; the published correction had not reached the application.

After revision receipt: USD 96 million
Corrected reporting uses the revision. It does not rewrite the historical input.

The reporting period, entity, measure, currency and scale stay fixed. Historical replay uses the version actually received by its cutoff; the later corrected view uses the revision.

Check permission for the actual use

Governance determines and enforces appropriate information use. Access is only one part of permission: a source may be readable internally but restricted from external processing or redistribution. Source entitlements specify permitted access and uses; redistribution passes information to another recipient. The general distinction among legal, contractual, organizational, and technical permission is developed in Establish permitted uses.

Public visibility does not remove contractual restrictions. CME's inspected website market-data terms prohibit specified AI uses of covered data and metadata, including training and generating outputs. That example does not describe every exchange or a separately negotiated license. It shows why a programmer must check the actual agreement before putting a visible price into an AI pipeline.

Some information requires restrictions because of its significance to investors, independently of a data license. In U.S. securities terminology, material nonpublic information is information important to a reasonable investor that has not been disseminated so investors generally can access it. The SEC's adopting release explains these concepts; confidentiality alone does not establish materiality. Information barriers restrict flows between functions, including flows to investment decision-makers. Putting restricted records into a broadly searchable internal index can defeat that separation even if the records never leave the institution.

Review each proposed path separately: internal analysis, processing by a model provider, and disclosure to a customer. Name the purpose, recipient, fields, permitted retention, and output use. Combining eligible inputs does not settle whether the combined output may be disclosed. Provider approval must cover the actual service path, not merely a familiar company name; see Approve actual service paths.

Applying AI to financial workflows

Build checked financial research

Financial research turns eligible information into an analysis someone can inspect. A disclosure communicates financial or business information, such as a company filing. An earnings call is a discussion of reported results and business conditions, often including management commentary and questions. A research workflow begins with a specific question, locates relevant sources, aligns comparable facts, performs necessary calculations, and presents a conclusion for analyst review.

Keep the kinds of statement visible. Reported revenue is a source fact; management's expectation is an attributed statement; a ratio is a derived quantity; next year's estimate is a forecast; an assessment of business quality is a judgment. Grounding connects a claim to applicable supporting material. It does not make a forecast true or prove an analyst's interpretation. Check support, not just references explains the general checking task.

Financial vocabulary also changes what counts as support. Loughran and McDonald's 2011 study found that 73.8% of general-dictionary negative-word occurrences in its 10-K corpus came from words typically not negative in financial usage. A liability can be an ordinary accounting category rather than evidence of deteriorating conditions. The lesson is to validate the meaning being measured, not just recognize financial-looking words.

Calculation and interpretation

For numerical analysis, separate deciding what to compute from executing the calculation. The model can identify the needed facts and propose operations; tools retrieve the values and perform the arithmetic. Preserve the selected inputs and operations so the result can be checked. Exact execution still cannot establish that the chosen inputs or formula answer the question. FinQA, introduced in 2021, made this separation explicit by pairing financial questions with executable reasoning programs over report text and tables. Kepler's financial-services approach assigns planning to the model and extraction and arithmetic to tools, retaining each number's derivation.

For example, suppose compatible records report quarterly net income of USD 8 million and revenue of USD 100 million. Under the selected definition, net margin is 8 ÷ 100 = 8%. The calculation service can reproduce that result. The analyst must still establish that both figures concern the same entity and period and that the selected definition answers the question. Concluding that this margin is sustainable introduces a further judgment the division cannot verify.

Comparisons need equal care. Non-GAAP measures use adjustments outside the relevant generally accepted accounting principles. The SEC's interpretations describe how changed adjustments and misleading labels undermine comparison. Similarly named measures need not be equivalent across firms. Preserve definitions and adjustment histories alongside values. A useful research assistant reduces total inspection and correction effort while leaving these decisions visible.

Reconcile records and resolve exceptions

Financial operations must distinguish recording an obligation from fulfilling it. A ledger is an accounting record; posting enters an accounting transaction into it. Settlement completes the agreed transfer of cash or assets. In double-entry bookkeeping, an entry has debit and credit sides whose totals must match. A balanced entry need not move cash: providing a service on credit records revenue and a receivable, an amount the customer owes. Collecting payment later increases cash and reduces the receivable without recording revenue again. The entries balance in both cases, but only collection brings in cash. Balance alone does not prove correct accounts, amounts, or dates.

Reconciliation compares independently maintained records and investigates differences. An exception is an item requiring handling outside the routine path: an unmatched payment, an ambiguous correspondence, or a discrepancy needing explanation. AI can help interpret payment descriptions and assemble likely supporting records. The proposed match must still satisfy the financial correspondence, not merely resemble another description.

Consider a statement line for USD 500 and two internal records for USD 500. Amount equality does not establish which record corresponds to the payment. A transaction reference, counterparty, date, or further investigation must resolve the ambiguity. Dynamics 365's matching documentation makes this concrete: default rules can take the first qualifying transaction, while configuration can require manual matching when multiple documents match on amount. A successful rule execution is not evidence that its selection was correct.

Keep completion states equally precise. In Dynamics' reconciliation workflow, unmatched items can carry forward after a statement is marked reconciled, and completion can trigger correction postings. Separate a proposed match, an approved correction, a confirmed posting, and an unresolved item. Otherwise, an automation-rate dashboard can conceal both open discrepancies and unintended accounting changes.

Resolve the customer's financial problem

Account servicing helps customers understand and manage an existing financial relationship. Agent assist supplies information or drafts to a human service representative. DBS's July 2024 announcement described an assistant combining call transcription, knowledge-base search, summaries, and prefilled service-request fields. Its pilots began in October 2023. This is a concrete assistance workflow; the announcement's projected handling-time savings were not demonstrated end-to-end results.

General product information and account-specific information require different access. Authentication establishes control of an account identity; authorization determines permitted operations. Neither a recognized customer nor a retrieved policy automatically authorizes an account change. See Distinguish people and actors. The service design should identify which record supplies the balance, transaction status, applicable fee, and effective policy rather than letting the model blend them.

A pending transaction has not finished processing or posting. Its amount can change, as with a restaurant tip; it is not interchangeable with a posted entry. Product and channel also matter. Chase's published dispute process requires a credit-card charge to post before opening a dispute. It allows a pending debit-card transaction to be disputed by telephone, while online debit disputes require posting. Applying one rule to every pending transaction gives incorrect instructions.

Dispute handling addresses a contested transaction, not merely a request to explain its status. For covered U.S. electronic fund transfers, the Regulation E interpretation distinguishes checking whether a transfer occurred from alleging an error. Reporting a lost access device together with possible unauthorized use changes the servicing path. These are scoped examples, not universal rules for every payment product.

The assistant should say what is established, avoid promising an unconfirmed refund or completion date, and transfer unresolved facts or out-of-authority requests to a reachable owner. The CFPB's chatbot report describes generic answers and difficult human offramps leaving financial problems unresolved. Count verified resolution, repeat contact, and successful escalation—not just conversations that ended without a person.

Keep scores separate from decisions

Credit underwriting assesses a proposed loan and its terms. Default means failure to meet the relevant contractual obligation. Fraud detection identifies activity that may be deceptive or unauthorized. Both can use a predictive model—behavior fitted from examples, as introduced in Machine Learning Fundamentals—but neither task reduces to producing a score.

An additive credit scorecard assigns points to applicable borrower attributes and sums them. In the SAS implementation, grouped attributes feed a fitted statistical model that is scaled into points. Grouping, fitting, scaling, and the subsequent approval policy are separate choices. A convenient score direction or point total does not itself establish calibration or an appropriate lending threshold.

A decision policy maps information to actions under objectives and constraints. Ranking cases orders attention; a calibrated probability estimates how often a defined outcome occurs among similarly scored cases. Even a meaningful probability does not choose the action. Changing the cost of blocking a legitimate payment relative to missing fraud can change a threshold without changing the prediction. From probabilities to actions develops this distinction.

The Worldline-informed fraud study separates authorization checks from later investigation using rules, learned scores, records, and cardholder contact. An alert is a reason to investigate, not a finding of fraud. In credit review, document synthesis can prepare an assessment, while policy and authorized judgment determine the disposition. Missed losses and unjustified denial or blocking must remain separate consequences in both workflows.

Preserve the actual decision path when explaining an outcome. For covered adverse-action statements, Regulation B requires specific principal reasons reflecting factors actually considered or scored. A plausible explanation generated afterward cannot substitute for those reasons.

Identify the exposure and scenario

Risk exposure is a position or obligation through which an adverse event can cause loss. A counterparty is another party to the financial arrangement. Before choosing a model or explanation, identify the loss mechanism and the time horizon. Several mechanisms can affect the same transaction.

RiskMechanismRelevant evidence
CreditA borrower or counterparty fails to meet obligations.Obligation, due time, outstanding exposure, and recoverable value.
MarketMarket-price movements reduce a position's value.Positions, price sensitivities, and adverse market assumptions.
LiquidityCash or collateral is unavailable when needed, or selling a position materially moves its price.Cash timing, funding access, market depth, and exit horizon.
OperationalA failed process, person, system, or external event causes loss.Routing, approvals, execution records, and failed controls.

Expected credit loss depends on the likelihood of default, the amount exposed at default, and the portion lost after recovery. A ranking of borrowers addresses only part of that assessment. Funding liquidity concerns meeting cash and collateral needs; market liquidity concerns trading without unacceptable price effects. An institution can have assets exceeding liabilities yet lack cash at the required time.

A scenario asks what follows if specified conditions hold. It might assume delayed receipts, reduced recoveries, or difficulty selling assets. Its output is conditional analysis, not a guaranteed forecast. Expected loss also differs from extreme-loss severity: a typical outcome or percentile cutoff can conceal worse losses beyond it. Keep scenario assumptions and the exposure they act on visible so reviewers can judge whether the analysis covers the decision.

Authority and authoritative effects

Authorize the actual financial action

Reading a record, drafting a recommendation, approving it, and submitting an instruction are different permissions. Segregation of duties separates responsibilities that should not be exercised unchecked by one actor. Maker-checker control separates preparation from independent approval; calling a second model does not create that institutional independence. Basel Principle 26 addresses delegation, approval limits, reconciliation, and separation among committing the bank, paying funds, and accounting for assets and liabilities. These supervisory standards are not automatically local law.

Delegated authority should identify who may act for whom, on which accounts or instruments, for what amounts and recipients, and for how long. Enforce these restrictions outside generated content. The model may propose an action; a protected operation must determine whether that action is permitted. Authorization belongs at the protected operation explains the general interface boundary.

Approval must remain attached to the actual proposal through delays and retries. A useful financial precedent is Article 5 of EU Regulation 2018/389: within its strong-customer-authentication scope, the authentication code binds to the agreed amount and payee, and changing either invalidates it. As an engineering rule, changed material arguments, expired approval, or invalidated source conditions should stop submission and require the appropriate renewed decision.

Limits must also cover accumulated exposure. The SEC staff's market-access FAQ describes aggregate credit or capital thresholds and checks before orders enter the market for covered broker-dealers. A per-order limit alone cannot establish an aggregate bound. Test concurrent submissions against shared exposure, including relevant pending commitments; the required property is that individually acceptable requests cannot jointly bypass the limit.

Approval and shared capacity are separate conditions

Fictional instructions share a USD 100,000 limit, with USD 70,000 already committed. Each has its own approval for exactly USD 20,000 to its named recipient. Supporting facts and other permissions are unchanged.

Instruction A after approval
First to reach the shared gate

Instruction A

Approval binds
USD 20,000 · Recipient A
Current instruction
USD 20,000 · Recipient A
Approval lifetime
Current

Instruction B

Approval binds
USD 20,000 · Recipient B
Current instruction
USD 20,000 · Recipient B
Approval lifetime
Current

One atomic check and reservation per arrival. Each instruction sees the exposure left by the previous accepted instruction. Changing a choice recomputes this same two-instruction example.

ArrivalBeforeIf addedAfter gateDisposition
Instruction AUSD 70,000USD 90,000USD 90,000Eligible for submission: pending exposure reserved.
Instruction BUSD 90,000USD 110,000USD 90,000Shared limit exceeded: held without reservation.
1 of 2 instructions eligible for submission. Reserved exposure: USD 90,000 of USD 100,000. Held instructions reserve nothing; accepted pending commitments remain counted.

A lower amount is still a different action. Renewed review is necessary for changed or expired approvals; it would not remove the independent shared-limit check. This example ends at submission eligibility, with no payment or settlement result.

This proposed engineering control uses fictional values, not a universal legal threshold or a claim about a provider implementation. Exact-action approval and current aggregate capacity are independent requirements.

Customer communications deserve explicit authority too. Morgan Stanley's June 2024 Debrief announcement describes drafting an email that an advisor may edit and send at their discretion. It separately describes saving a note into Salesforce. A review boundary for one output does not establish the boundary for every write the application performs.

Connect terms, entitlement, and receipt

A system of record is the designated authority for a particular business fact. One source may own instrument terms, another accounting entries, another external transaction status, and another investigation status. An assistant's summary is a derived view of these records. Name the authoritative records explains the general ownership principle; a financial integration must also preserve identifiers, exact monetary values, units, relevant dates, and evidence of completed effects.

Consider bond-interest reconciliation as a teaching example. A bond is debt issued to investors. Principal, also called face value, is the amount repayable under its terms; interest is the contractual payment for borrowing. These are promised payments, not guaranteed receipts, and market value can differ from principal. The SEC's bond guide introduces this vocabulary.

A custodian holds or administers clients' assets. Entitlement is the payment due under event rules. Review identified, dated terms, eligible holdings, calculations, and external and internal records. Today's holding times a displayed rate is insufficient: eligibility and contractual conventions matter. Keep licensed terms and restricted holdings on permitted processing paths.

The Depository Trust Company's (DTC) Distributions Service Guide separates announcements, entitlements, and allocations of received funds. Payable dates do not prove receipt; position or rate corrections can generate credits or debits. Participant allocation does not prove bank receipt by the beneficial owner, the investor whose assets are held. Reconcile corresponding external allocations and internal postings, retaining unresolved differences.

This schematic separates expected entitlement from independently owned allocation and posting records. Reconciliation maps account identities for the same instrument and event; agreement does not establish source truth or confirm beneficial-owner cash receipt. Adjustments remain linked to original records.

Resolve uncertain execution

A lost response changes what the application knows, not necessarily what the provider did. Keep unknown outcome separate from confirmed failure without an effect and confirmed completion. Preserve the logical operation identity while consulting authoritative records. A fresh payment request can duplicate an effect that already occurred.

Idempotency is a receiver-defined contract for repeated requests. Stripe's contract reuses the first executed request's stored status and body when the same key and parameters recur, including stored failures. Parameter changes are rejected. Keys can be pruned once at least 24 hours old; reuse after pruning creates a new request. Validation failures and concurrent execution conflicts do not create saved results. This is bounded duplicate protection, not permanent exactly-once settlement.

Stripe's error guidance recommends retrying network failures with the same key and parameters using backoff. A server error can remain indeterminate despite a repeatable cached response. Provider reconciliation and subsequent events may reveal resulting objects; a local operation identifier in metadata helps correlate them. Preserve pending state until authoritative evidence resolves it rather than changing the key to escape uncertainty.

The effect and knowledge of it can diverge

One possible run of logical operation P. Time runs downward; spacing does not encode duration. The request arrives and creates an effect, but its response is lost.

Provider effect versus application knowledgeSubmit P with key K and unchanged parameters. Provider creates an effect; its response is lost. Application remains unknown. Same-key retry can return the stored response under the provider contract. A separately correlated authoritative record establishes the specific effect, not settlement.ApplicationProviderSubmit P · key K · unchanged parametersEffect occurred for PResponse lostOutcome unknownEffect is not undoneRetry P · same K · same parametersStored response under the provider contractA repeated response may still leave the outcome unresolved.Correlate authoritative record / event with PSpecific provider effect confirmedNo settlement claimAuthoritative record linked to P

Other possible resolutions: confirmed effect, confirmed no effect, or still unknown. These are alternatives, not three later events in this run.

The lost response travels back from the provider; it does not undo the effect. Retrying retains operation P, key K and parameters. A correlated authoritative record establishes only the specific effect it records.

Recovery can create new financial work. A compensating entry records a correction instead of erasing the original accounting event; Dynamics documents reversal through a new transaction rather than editing an already reconciled statement. Track the original effect and the remedy separately, including whether the remedy completed. See Recover from the effects that occurred for the wider recovery pattern.

Evidence of useful performance

Measure the financial workflow

An evaluation assesses specified behavior against an intended use. A baseline is the credible alternative: existing rules, software, models, and human work—not necessarily the newest competing model. Define the assessment unit before choosing a metric. A correct answer, a correct match, and a resolved case describe different units and support different claims. What an evaluation establishes and Define worthwhile improvement provide the general framework.

Use these as assessment contracts to specify locally, not as interchangeable quality scores.
Workflow and unitChecksComplete-work comparison
Research: claim and analyst taskSource support, numerical correctness, omitted material, and justified interpretation.Coverage and total analyst time, including checking and correction.
Operations: match and reconciliation caseCorrect correspondence, confirmed postings, unresolved amounts, and deadlines.Complete handling effort, remaining exceptions, and correction burden.
Service: customer problemApplicable information, authorized actions, resolution, and usable escalation.Repeat contact, waiting, access to help, and customer consequences.
Decision support: decision and affected populationPolicy adherence, decision-relevant errors, and outcomes after sufficient follow-up.Losses, unjustified restrictions, group differences, and investigation effort.

FinanceBench, introduced by Pranab Islam and colleagues in November 2023, paired financial questions with answers and supporting passages. Its experiments assessed 2,400 outputs across 16 configurations on 150 cases. Providing the correct evidence pages improved results but did not eliminate reasoning errors; qualitative review also found valid answers differing from references. It is useful evidence about the separation of retrieval, reasoning, and assessment, not certification for a new institution's workflow.

For an investigation queue, precision is the fraction of flagged cases confirmed to have the specified condition. The condition matters: an anomaly is not necessarily fraud. In her cross-document compliance presentation, Varsha Shah reported approximately 91% precision in an evaluation involving roughly three million records over five years and four jurisdictions. Confirmation concerned genuine anomalies, not uniformly established fraud. The report did not supply the labeling process or evaluation split details. This result concerns the quality of flagged cases; it does not establish how much fraud went unflagged, how long investigations took, or whether the workflow produced a net financial benefit.

Respect the historical information boundary

Backtesting assesses behavior on historical situations. Look-ahead bias occurs when later information enters a decision represented as historical. A chronological split helps, but only if source selection, preprocessing, and model selection respect each cutoff. Rolling-origin evaluation repeats this process as the decision date advances and scores the forecast horizon actually needed. See Validation without leakage.

Different historical distortions require different repairs.
DistortionWhat it changesEvidence to retain
Later source revisionsLater values enter historical decisions.Versions and availability cutoffs.
Later knowledge in the modelHistorical source restrictions do not restrict everything learned during training.Model lineage and tests for prohibited later information.
Survivorship biasToday's survivors replace the population eligible historically.Historical membership, identifier intervals, distributions, and exits.
Selection overfittingThe reported winner was chosen from many historical experiments.Alternatives tried and independent assessment of the selected configuration.

The model itself can cross the cutoff. Lookahead Bias in Pretrained Language Models found later pandemic information in risk descriptions generated from pre-pandemic earnings calls. Instructions to ignore later facts did not eliminate the demonstrated leakage. Restricting retrieved documents therefore supports only the retrieval boundary, not a complete historical-information guarantee.

Survivorship bias conditions inclusion on a later outcome. Removing securities that subsequently disappeared can omit investments available at the time, including failures and their losses; not every delisting is a failure, since mergers also cause exits. Separately, repeatedly selecting the strongest historical configuration can overfit the selection process. An attractive winning run does not disclose how many alternatives lost.

Keep representative later-period assessment separate from stress testing, which deliberately examines severe but plausible conditions. Stress scenarios reveal vulnerabilities; their frequency in a test set is not an estimate of how often they occur in ordinary work. Both are useful, but they answer different deployment questions.

Keep missing and delayed outcomes visible

A label is the specified outcome or judgment used for assessment. Selective labels arise when earlier decisions determine whose outcomes become observable. Repayment on an institution's loans is observed only after it grants those loans; rejected applicants do not become successful repayment examples. Evaluating solely on approved borrowers can misrepresent a replacement policy serving a different population. The selective-labels research formalized this problem in another decision domain; lending has the same observation structure.

This limitation predates modern AI. Durand's 1941 credit study explicitly noted that its records contained previously approved loans and omitted important information. More sophisticated modeling does not manufacture the missing outcomes. Account for incomplete feedback explains the general problem.

Selection and delay are separate. An outcome horizon is the follow-up period required by a claim. For default within twelve months, an account observed without default for only three months remains unresolved. It is right-censored: observation ended before the eventual event time became known. Treating it as a twelve-month negative silently changes the target.

Approval selects whose repayment is observed

Example

Historical rejection and insufficient follow-up create different gaps in outcome evidence.

For default within twelve months on loans granted by this institution, rejected applications lack the proposed loan’s outcome. An observed default within the horizon is assessable immediately; a negative label needs twelve event-free months. Three event-free months remain unresolved. Branch widths do not encode prevalence.
Read the diagram as text
  • Historical applications. The population encountered by the prior decision policy.
  • Granted loans. Credit was extended and repayment can subsequently be observed.
  • Rejected applications. No loan was extended by this institution.
  • Loan outcome unobserved. Not a repayment success or failure label for the proposed loan.
  • Outcome follow-up. Compare observed events and observation duration with the specified target.
  • Target outcome assessable. The target event occurred, or sufficient event-free follow-up completed.
  • Outcome still unresolved. No event observed, but follow-up ends before the target horizon.
  • Historical applicationsGranted loans: historical policy: grant.
  • Historical applicationsRejected applications: historical policy: reject.
  • Rejected applicationsLoan outcome unobserved: no corresponding loan outcome.
  • Granted loansOutcome follow-up: observe subsequent records.
  • Outcome follow-upTarget outcome assessable: event observed or horizon completed.
  • Outcome follow-upOutcome still unresolved: event-free observation ends early.

Payment outcomes require equally explicit definitions. Stripe's dispute lifecycle distinguishes payment time, later notification, evidence review, and changing case status. No observed dispute at a cutoff is not confirmed non-fraud. Its fraudulent dispute category records an allegation of unauthorized payment, which can include a legitimate charge the customer did not recognize. A reported fraud dispute, a won or lost case, and independently investigated fraud are different labels.

Investigation capacity also selects feedback. The Worldline-informed study assessed precision among the limited number of cards investigators could inspect, rather than treating multiple transactions on one card as independent investigations. Retain both the review-selection rule and outcome maturity. Better results on the selected queue do not establish performance on everything outside it.

Institutional responsibility and intervention

Assign ownership and independent challenge

Model risk concerns harm from an incorrect or misused model. Its intended use defines the decisions, population, and conditions for which it is accepted. Validation assesses suitability for that use; effective challenge requires expertise, objectivity, and enough influence to change the decision. Documentation without the power to require remediation is not equivalent to challenge.

The IIA's Three Lines Model distinguishes responsibilities, not mandatory department names.
ResponsibilityRole in deployment
Business managementOwn day-to-day risks and operate controls.
Risk and compliance specialistsSupport, challenge, and monitor the business's handling of risk.
Internal auditProvide independent assurance on controls, with functional reporting to the board.

Independent assurance assesses whether controls are appropriate and effective; it is not another execution stage inside the model's workflow. A payment team checking duplicates operates a control. Internal audit examining that control performs a different responsibility. Supplier involvement does not dissolve the institution's own decisions about use, monitoring, or response.

Scope each obligation before translating it into a release gate. The Federal Reserve's April 2026 SR 26-2 model-risk guidance is nonbinding, risk-based guidance primarily relevant to banks above its stated asset threshold, with exceptions. Its scope explicitly excludes generative and agentic AI. Applying its validation and monitoring practices to those systems is an engineering analogy, not a GenAI mandate; historical SR 11-7 should not be presented as the current guidance.

Other sources have different authority. FINRA Notice 24-09 reminds member firms that existing technology-neutral obligations apply to generative AI, including third-party tools; it creates no new requirements. Covered Regulation B notices must give actual principal decision reasons. Data licenses create contractual restrictions, while an institution can impose stricter internal approval policies. Record which category supports each requirement, its applicability, owner, and enforcement evidence. See Verify and revisit decisions.

Make review capable of changing the outcome

Human participation matters only if the person can make the needed intervention. Factual review checks evidence and calculations. Policy review determines whether the proposed treatment fits applicable rules. Authorization grants permission for an effect. Takeover assigns someone responsibility for unresolved work. A reviewer may be qualified for one role but not another.

Provide a review packet suited to that decision: applicable source versions, calculation inputs and definition, unresolved discrepancies, proposed effects, and approval limits. For bond reconciliation, distinguish the expected entitlement, external allocation evidence, and internal posting. A summary should help the reviewer reach those records, not replace them. Review before consequential commitment develops the interface choices.

Automation bias is inappropriate reliance on automated output. In a Duolingo false-alert experiment, skilled reviewers accepted half of fabricated cheating alerts inserted into legitimate historical sessions. Customers were not affected by the experiment. This is cross-domain evidence that approval is not a correctness measure, not an estimate of financial-review error. Test local reviewers with independently assessed correct and erroneous proposals, measuring whether they detect and correct consequential errors before commitment.

Review capacity constrains the permitted workload. Track required handling effort, qualified staffing, aging, and the time remaining before financial or customer deadlines. When demand exceeds capacity, invoking human review does not supply an answer: admission, prioritization, escalation, or the operating mode must change. Urgent work still needs an accountable owner. Operate the exception workload explains queue management.

Correction also needs a route after the initial decision. NIST's voluntary AI Risk Management Framework supports feedback, appeal, and override mechanisms. A practical design links a complaint to the decision and its versions, assigns a reviewer empowered to change the disposition, records the rationale, and tracks downstream correction and communication. A trace explains recorded events; it does not itself give an affected person a remedy.

Deployment and continued control

Choose a bounded operating mode

Deployment is a choice about permitted effects, not a race toward autonomy. Integration tests establish interface behavior. Historical assessment examines past cases under a defined information boundary. Shadow operation processes current inputs without applying candidate effects. Assisted use introduces the candidate into human work. Limited live action exposes a bounded set of real operations. Each answers a different remaining question.

Modes can remain separate products or operating choices; they need not be successive stages.
ModeEvidence it can addWhat remains unestablished
Historical assessmentBehavior on reconstructed past information and cases.Performance under today's work and consequences of applying outputs.
ShadowCurrent-input compatibility, proposed outputs, and resource demand.Effects on customers, reviewers, and financial outcomes when proposals are used.
Assisted useReviewer handling, corrected results, and actual use of suggestions.Safety or usefulness without that human intervention.
Bounded live actionAuthorized effects and recovery within the exposed scope.Suitability for broader populations, higher limits, or new activities.

Shadow execution must technically deny or isolate writes, notifications, and financial actions; discarding the final answer does not undo tool effects. The live-experiment chapter explains this boundary. Define eligible work, allowed sources and recipients, permitted effects, aggregate exposure, intervention capacity, acceptance conditions, and stopping rules before exposure. Read-only assistance can remain the appropriate final mode.

Compare the complete process with its incumbent: source licensing, integration, validation, model calls, review, correction, support, and waiting. Faster case preparation can be valuable while failing to reduce total handling effort. Price accepted outcomes develops that accounting. The historical Authorizer's Assistant report treated integration, acceptance testing, and transfer of business control to operations as deployment work—not as consequences automatically supplied by a working model.

Reconstruct, monitor, and reassess

An audit trail is attributable evidence connecting information, decisions, approvals, and observed effects. For financial AI, preserve the relevant source and instrument versions, as-of conditions, model and policy versions, checked calculations, reviewers, authority, execution attempts, and resulting external identifiers. Generated reasoning is not a substitute for records of what was read, approved, and done. Record meaning-changing boundaries explains the diagnostic design.

The SEC's 2022 electronic-recordkeeping amendments provide a scoped example: an audit-trail alternative preserves modifications, deletions, timestamps, applicable identities, and information needed to recreate original and intermediate records. It is not a universal requirement to retain every prompt. The NIST Privacy Framework also calls for minimizing audit data. Preserve necessary evidence with controlled access and defined lifetimes; do not indiscriminately copy customer payloads into logs. See Set artifact lifetimes.

Monitoring should identify which accepted deployment claim needs reconsideration.
Observed changeReassessment
Stale sources, corrections, or changed rightsWhether inputs remain applicable and permitted, and which outputs need review.
Growing unresolved amounts or older casesWhether reconciliation and intervention capacity still meet the operating contract.
Complaints, overrides, or changing outcomesWhether service and decision quality remain acceptable in the affected population.
New provider, product, policy, or authorityWhether previous tests and approvals cover the changed system.
Failed limits or shutdown activationWhat further work stopped, what already executed, and who must reconcile it.

Containment and recovery are separate. A runtime kill switch can stop future decisions or tool calls when active work next checks it; a flag read only at session creation misses ongoing work. Stopping does not reverse payments. Identify completed and uncertain effects, reconcile authoritative records, authorize corrections, test recovery, and obtain approval to restore the affected scope. Record who changed controls and whether mitigation actually worked.

Finally, examine dependencies beyond one application. The FSB's 2024 assessment identifies provider concentration, correlated behavior, cyber risk, and model risk as possible amplification channels. Local usefulness does not remove a shared failure dependency. Continued permission to operate rests on maintained evidence, workable intervention, and tested recovery—not the age of the launch approval.

Open questions

  1. End-to-end financial productivity remains difficult to establish because faster preparation can shift work into verification, corrections, and support. Useful progress would compare complete analyst or reconciliation tasks against the incumbent process, preserving quality and unresolved-work measures alongside total effort.

  2. Effective financial oversight needs evidence that qualified reviewers detect consequential errors under realistic workload and deadline pressure. Approval rates cannot supply that evidence. Progress would demonstrate correct intervention before commitment, including overload and unavailable-reviewer conditions.

  3. Historical language-model evaluation faces an information boundary that document filtering cannot fully enforce: later facts may already be encoded in the model. Progress would establish auditable historical-knowledge constraints or evaluation designs that do not depend on pretending those facts are absent.

  4. Outcome learning must handle decisions that hide alternatives and labels that mature late. Progress would make observation rules, unresolved cases, and deployment-population coverage explicit, rather than treating increasingly large operational datasets as automatically representative.

  5. Local controls do not resolve shared infrastructure risk. Institutions need ways to test substitution and recovery without silently changing data permissions or financial behavior. Progress would demonstrate continuity across actual dependencies, not merely configure an alternate provider name.

Follow the curated reading path through the speakers and demonstrations behind this entry.

23 min

AI Engineer World's Fair 2026 · 2026

How Kepler Built Verifiable AI for Financial Services

Vinoo Ganesh

Cited in this entry

Develops the separation between model-directed analysis, deterministic numerical execution, and replayable derivation histories. Read it for financial calculation architecture, not as a substitute for validating inputs and measure definitions.

Watch talk
18 min

AI Engineer World's Fair 2026 · 2026

Your Agent Didn’t Fail. Your Harness Did.

Vinoth Govindarajan

Cited in this entry

Connects scoped approvals, durable state ownership, execution attempts, and external completion evidence. These distinctions are especially useful when financial operations continue through retries or delayed callbacks.

Watch talk

Explore more talks

The rest of the library, beyond the curated path. Cited talks support this entry; reviewed transcripts were processed in full. Metadata candidates have not been reviewed as sources or verified as topic members.

70 matching talks

Every catalogued talk on this subject: Finance

TalkSpeakerEventYear
Varsha ShahAI Engineer World's Fair 20262026
Waseem AlshikhAI Engineer Summit 20252025
Leo PekelisAI Engineer World's Fair 20242024
Shreya Rajpal, Aman GuptaAI Engineer World's Fair 20262026
Ritvik PandyaAI Engineer World's Fair 20262026
Devendra Chaplot, Devendra Singh ChaplotAI Engineer World's Fair 20242024
Ahmed MenshawyAI Engineer World's Fair 20242024
Cedric ClyburnAI Engineer World's Fair 20262026
Roy DerksAI Engineer Summit 20252025
Daniel WhitenackAI Engineer World's Fair 20242024
Lawrence JonesAI Engineer Europe 20262026
Lance MartinAI Engineer World's Fair 20242024
Udi MenkesAI Engineer World's Fair 20262026
Jesse HuAI Engineer Code 20252025
Parth AsawaAI Engineer World's Fair 20262026
Sandipan BhaumikAI Engineer Europe 20262026
Agents Need Feature Flags

Cited in this entry

Sachin GuptaAI Engineer World's Fair 20262026
Christopher Lovejoy, Saul HowardAI Engineer World's Fair 20262026
Sumaiya ShrabonyAI Engineer World's Fair 20262026
AI’s Jurassic Park Period

Transcript reviewed

Aaron StanleyAI Engineer World's Fair 20262026
Angus J. McLeanAI Engineer Europe 20262026
Sarthak AggarwalAI Engineer World's Fair 20262026
Chaitanya AsawaAI Engineer World's Fair 20262026
Ofer MendelevitchAI Engineer World's Fair 20252025
Vaibhav Page, Infant VasanthAI Engineer World's Fair 20252025
State of Data

Transcript reviewed

Sean CaiAI Engineer World's Fair 20262026
Dan MasonAI Engineer World's Fair 20252025
Jeremy Silva, Chris HernandezAI Engineer World's Fair 20252025
Stephen ChinAI Engineer Europe 20262026
Nishant GuptaAI Engineer World's Fair 20262026
Sachin GuptaAI Engineer World's Fair 20262026
Giran Moodley, Mayan Soni, Oussama Hafferssas, Mayank SoniAI Engineer Europe 20262026
Frank CoyleAI Engineer World's Fair 20262026
Corey CooperAI Engineer World's Fair 20252025
Divakar KumarAI Engineer World's Fair 20262026
Christopher LovejoyAI Engineer Summit 20252025
Anant ShankhdharAI Engineer World's Fair 20262026
Martin Harrysson, Natasha ManiarAI Engineer Code 20252025
Balázs HorváthAI Engineer World's Fair 20262026
Ramana Siddanth EmaniAI Engineer World's Fair 20262026
Ayush BhardwajAI Engineer World's Fair 20262026
Vibhor KumarAI Engineer World's Fair 20242024
Nathan WanAI Engineer World's Fair 20252025
Vasuman MozaAI Engineer World's Fair 20262026
Shawn ChanAI Engineer World's Fair 20262026
Anju KambadurAI Engineer Summit 20252025
Rachna SrivastavaAI Engineer World's Fair 20252025
Sahil Yadav, Hariharan GanesanAI Engineer World's Fair 20252025
Sheila Gulati, Nischal NadhamuniAI Engineer World's Fair 20242024
Nina Lopatina, Rajiv ShahAI Engineer World's Fair 20252025
Fuzzing in the GenAI Era

Metadata candidate

Leonard TangAI Engineer World's Fair 20252025
Mustafa Ali, Kyle CorbittAI Engineer Summit 20252025
Mitesh PatelAI Engineer World's Fair 20252025
Identity for AI Agents

Metadata candidate

AI Engineer Code 20252025
Juan Herreros ElorzaAI Engineer Europe 20262026
Yuval Belfer, Niv GranotAI Engineer World's Fair 20252025
Kshitij GroverAI Engineer World's Fair 20252025
Scaffold Wisely

Metadata candidate

Rahul SengottuveluAI Engineer Summit 20252025
Laurie VossAI Engineer Europe 20262026
Yogendra MirajeAI Engineer World's Fair 20262026
Kobie CrawfordAI Engineer Europe 20262026
Stop Using RAG as Memory

Metadata candidate

Daniel ChalefAI Engineer World's Fair 20252025
Jim BennettAI Engineer World's Fair 20252025
Nuno CamposAI Engineer Europe 20262026
Sandipan BhaumikAI Engineer Europe 20262026
Emil EifremAI Engineer World's Fair 20262026
Lucas PalmaAI Engineer World's Fair 20262026
Peter GostevAI Engineer Europe 20262026
Soumith ChintalaAI Engineer Summit 20252025
Rustin BanksAI Engineer World's Fair 20252025

References

Coverage and source review
Processed transcripts
44 processed in full · 5 in the curated path
Automated source review
Passed
Metadata candidates
31 unreviewed; not verified topic membership
Corpus version
1bd8e407b26a07b33815594e1b2db5f41827119a2b3cb6fbf240f9fc571fc767

Automated review checks source support; it is not publication approval.

A synthesis of selected conference talks and technical references. Citations link to the source material; they do not imply that every talk on this subject is included.

  1. AASB 132 Financial Instruments: Presentation

    A financial instrument is a contract creating a financial asset for one entity and a financial liability or equity instrument for another. Financial assets include contractual rights to receive cash and equity instruments of another entity. The application guidance gives loans, bonds, notes and trade receivables/payables as examples of corresponding rights and obligations.

  2. Basel Core Principles: Principle 26, Internal control and audit

    Principle 26 separates committing a bank, paying funds and accounting for assets and liabilities. Its criteria cover explicit delegation, approval limits, reconciliation, segregation of duties, cross-checking and dual control. Control functions need sufficient expertise, authority and resources relative to business activity. Independent internal audit assesses whether controls remain appropriate and effective, with access to relevant records and authority to assess outsourced functions.

  3. Artificial Intelligence in UK Financial Services — 2024

    The Bank of England and FCA’s 2024 survey of 118 firms found AI uses across operations, retail banking, insurance, risk and other business areas. Internal-process optimization, cybersecurity and fraud detection were prominent applications. Respondents perceived current benefits especially in data analysis, anti-money-laundering and fraud work, and cybersecurity, while anticipating further operational-efficiency benefits. Their leading concerns included privacy, data quality and security. The survey separately classified application materiality and automation level: using AI did not necessarily mean granting autonomous decision authority.

  4. FINRA Regulatory Notice 24-09

    FINRA identifies potential assistance with locating policies, summarizing research and obtaining issuer information from filings and earnings calls. It reminds member firms that existing technology-neutral obligations apply to GenAI, including third-party tools. Supervisory systems must be reasonably designed for the business; GenAI used in supervision calls for attention to governance, privacy, integrity, reliability and accuracy. Firms should evaluate tools before deployment, and public-communication standards apply whether content is generated by people or technology.

  5. Microsoft Dynamics 365: Reconcile bank statements using advanced bank reconciliation

    The workflow compares bank-statement lines with internal bank transactions, maintaining matched and unmatched records. It supports grouped matches, date constraints and configured penny tolerances. Bank-originated fees or interest can be marked new and posted later; marking new is not itself posting. Crucially, a statement can be marked reconciled while unmatched items carry forward. Reconciliation can automatically post correction amounts, so its completion action can change accounting records. Documented reversal through a new transaction differs from editing an already reconciled statement.

  6. CFPB: Chatbots in consumer finance

    The CFPB documents risks from inaccurate chatbot responses, failure to understand customer requests and obstacles to timely human assistance. A chatbot offering only generic policies may leave an account-specific problem unresolved. The report describes consumers encountering repeated automated interactions and difficult human-service offramps. These observations support evaluating whether a financial problem is resolved and whether escalation is usable, rather than counting a generated answer as successful service.

  7. The Authorizer’s Assistant: A Knowledge-Based Credit Authorization System for American Express

    Dzierzanowski, Chrisman, MacKinnon and Klahr’s 1989 report describes American Express and Inference Corporation’s rule-based Authorizer’s Assistant, fully deployed for U.S. Personal and Gold cards in 1988. It addressed authorizers’ need to combine scattered account records with credit and fraud policies. The system both resolved selected transactions autonomously and advised human authorizers. Its screens combined account activity, recommendations, explanations and applicable authorization policy. Pilot evaluation, mainframe integration, acceptance testing and transfer of business control to operations were integral to deployment. Keeping much of its functionality outside the existing authorization system limited disruption to that critical system.

  8. Credit Card Fraud Detection: A Realistic Modeling and a Novel Learning Strategy

    Dal Pozzolo, Boracchi, Caelen, Alippi and Bontempi describe a Worldline-informed workflow combining transaction-blocking rules, scoring rules, a learned model and investigators. Authorization checks precede later fraud investigation; an alert is not itself a fraud determination. Investigators inspect case records and contact cardholders, creating recent but selectively observed feedback. Other labels arrive later through disputes or an operational convention treating sufficiently old undisputed transactions as genuine. The paper evaluates precision among the limited number of cards investigators can examine, avoiding counting several transactions on one card as independent investigations. Separately learning from recent feedback and delayed records improved alert precision in its experiments.

  9. David Durand: Credit-Rating Formulae

    In this 1941 NBER chapter, David Durand investigated statistically derived credit-rating formulae as an alternative to weights assembled through experience and intuition. Combining borrower attributes helped distinguish good and bad loans in the studied samples. Durand presented the formulae as supplements to investigation, not replacements for judgment. He explicitly warned that the data contained only previously approved loans and omitted important information such as payment history, limiting use on the broader applicant population.

  10. When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks

    Tim Loughran and Bill McDonald’s February 2011 paper examined whether general-purpose negative-word lists measured financial-document tone. Across 50,115 firm-year 10-Ks from 1994–2008, 73.8% of Harvard-list negative-word counts came from words typically not negative in financial usage. Terms such as liability and capital could describe ordinary accounting or an industry rather than adverse events. Their finance-specific negative list showed relationships with filing-period returns that simple proportional Harvard-list counts did not. The contribution was domain-appropriate measurement, not merely a larger dictionary.

  11. GLEIF and ANNA: ISIN Issuer to LEI Mapping Table Factsheet

    An ISIN identifies a financial or referential instrument; an LEI identifies a legal entity participating in financial transactions. The mapping connects an instrument’s ISIN to its issuer’s LEI, preserving the distinction between issuer and instrument. This 2021 specification describes daily full files containing eligible active ISINs with available mappings from participating numbering agencies. Changes to identity fields trigger review; inactive instruments and specified entity-status changes can remove or replace mappings. Missing correspondence therefore does not establish that an instrument or entity does not exist.

  12. DTC Distributions Service Guide

    DTC distinguishes announced distributions, calculated entitlements and actual allocations. Entitlement records include captured positions, rates, calculated amounts and subsequent adjustments. Interim accounting can transfer entitlement between sellers and buyers after the record date, including for many bond-interest payments. Participants must verify announcement information and report discrepancies. DTC allocates money after receiving funds from the paying agent, trustee or issuer; a scheduled payable date alone is not evidence of receipt. Later rate or position corrections can generate additional credits or debits. These distinctions support reconciling the instrument event, eligible position, expected amount and actual allocation separately.

  13. SEC Beginners’ Guide to Financial Statements

    A balance sheet records assets, liabilities and shareholders’ equity at a point in time, with assets equal to liabilities plus equity. An income statement summarizes revenues and expenses over a period; a cash-flow statement tracks cash movements through operating, investing and financing activities. Profit and cash are therefore not interchangeable quantities. For financial AI, extracting a number also requires its statement, entity, period, unit and accounting context before comparing it or using it in a calculation.

  14. XBRL International: xBRL-JSON tutorial and examples

    The published monetary fixture represents assets of EUR 1,230,000 with a fact identifier, entity identifier, concept, reporting instant and declared numerical precision. Its instant, 2020-01-01 at midnight, represents the end of December 31, 2019. The tutorial distinguishes instant from duration facts, supports additional dimensions and footnote links, and represents numerical values as strings to avoid precision loss. These fields preserve the meaning that a bare number cannot convey.

  15. FinQA: A Dataset of Numerical Reasoning over Financial Data

    FinQA asks numerical questions over financial-report text and tables and annotates answers with reasoning programs. Its baseline first retrieves supporting facts, then generates an executable sequence of operations. This separates selecting the right evidence from performing arithmetic. A structurally valid program can still select the wrong numbers or operations, so answer checking must examine inputs, periods, units, and calculation semantics. The dataset illustrates why fluent financial prose is not equivalent to auditable numerical reasoning.

  16. FRED real-time periods and historical information sets

    Economic observations have both the period they describe and a real-time period recording when the information was known before changing. FRED generally defaults to information available today, including revisions to historical observations. ALFRED-style queries change realtime_start and realtime_end to retrieve historically known information; both boundaries are inclusive. Setting both to a historical date requests that date's information set. Therefore, an observation describing an earlier quarter can still be unavailable at a decision date, and its later revised value must not replace its historical vintage in a replay.

  17. IFRS Foundation: IAS 8 Basis of Preparation of Financial Statements

    Prior-period errors arise from omitted or misstated information caused by failing to use, or misusing, reliable information that was available. The IAS 8 overview describes correcting material prior-period errors retrospectively through restated comparative amounts, unless determining the effects is impracticable. A later report can therefore change the reported value for an earlier period.

  18. SEC: EDGAR Application Programming Interfaces

    EDGAR identifies filers by CIK and exposes submissions and extracted financial facts. Company-concept responses distinguish taxonomy concepts and units, including different currencies. The aggregated XBRL APIs cover non-custom taxonomy facts applying to the whole filing entity. Frames select the last-filed fact best fitting a requested calendar period; company reporting calendars can differ. Thus a historical calendar frame is not inherently an information set available at that historical date, and these aggregates do not represent every custom or segment disclosure.

  19. CME Group: Market Data Explanation and Disclaimer

    CME's website terms restrict redistribution, systematic extraction, derivative uses and other processing of covered market data, with specified uses requiring written authorization. They expressly prohibit using covered data and metadata for machine learning or AI, including training and generating outputs. Public visibility of a price therefore does not itself establish permission to ingest it into an AI application.

  20. NIST Privacy Framework 1.0: lifecycle and minimized audit evidence

    The framework inventories data elements, processing purposes, actions, owners and flows. Policies define permitted uses and retention periods; the data lifecycle aligns with system development and operations. Authorizations must be maintained and revocable, access limited by least privilege, and deletion and destruction performed under policy. Audit records themselves must incorporate data minimization. Engineering application: define the decision evidence needed for review, its purpose, authorized readers, retention trigger and disposal method before logging. Retain the necessary decision, model and policy versions and relevant evidence without indiscriminately copying personal data into logs, prompts or backups. Where review requires sensitive evidence, constrain fields, access and retention rather than treating auditability as permission to keep everything. Assess removal and disclosure across downstream copies and service providers.

  21. SEC: Selective Disclosure and Insider Trading

    The SEC's adopting release explains materiality through substantial likelihood that a reasonable investor would consider information important or that it would significantly alter the available information mix. Information is nonpublic when it has not been disseminated so investors generally can access it. The release rejects an exhaustive materiality checklist and discusses information barriers that prevent investment decision makers from receiving material nonpublic information.

  22. How to Build Planning Agents Without Losing Control - Yogendra Miraje, FactSet

    The earnings-call preparation example separates natural-language tasks from executable function calls and passes task context through the workflow.

  23. Trust, but Verify: High-Fidelity Reasoning in Agentic Workflows

    Distill document findings, then verify individual findings in separate calls before synthesizing them.

  24. How Kepler Built Verifiable AI for Financial Services

    Use the model to decide what to compute and deterministic tools to extract and calculate the required values.

  25. How Kepler Built Verifiable AI for Financial Services

    Derived numbers need replayable derivation histories spanning source values, calculations, and internal information, not just links to filings.

  26. SEC: Non-GAAP Financial Measures Compliance and Disclosure Interpretations

    SEC staff explains that non-GAAP measures can mislead when adjustments are inconsistent between periods, when charges are excluded without comparable gains, or when labels conceal different calculations. A changed adjustment may require explanation and, depending on significance, recasting earlier measures. Similarly named non-GAAP measures are not necessarily comparable across companies. Research comparisons therefore need the measure's definition and adjustment history alongside its numerical value.

  27. Trust, but Verify: High-Fidelity Reasoning in Agentic Workflows

    Make individual findings interrogable and expose an audit trail beyond the final report, allowing users to request detail where their judgment identifies a concern.

  28. Double-entry bookkeeping and cash movement

    A journal entry posts amounts to accounts with total debits equal to total credits. Debits normally increase assets and expenses; credits normally increase liabilities, equity and revenue. Opposite entries decrease those balances. Revenue and expense balances ultimately affect equity, preserving assets = liabilities + equity. Borrowing $1,000 debits Cash and credits Notes Payable: assets and liabilities both increase. Providing a service on credit debits Accounts Receivable and credits Service Revenue, without receiving cash. Later collection debits Cash and credits Accounts Receivable; it exchanges one asset for another without recording revenue again. Thus a balanced posting records economic effects but need not represent a cash transfer.

  29. Basel Committee: credit risk and contractual obligations

    Credit risk is the possibility that a borrower or counterparty does not meet agreed obligations. Loans are one source, but commitments, guarantees and settlement also expose banks. A failed settlement can involve credit, liquidity, market and operational risks together. Engineering implication: retain obligation, due-time, counterparty and settlement-state records rather than treating every financial loss as an incorrect prediction.

  30. Microsoft Dynamics 365: Set up bank reconciliation matching rules

    Matching rules filter statement and internal transaction lines using specified criteria, and rule sets execute in sequence. By default, a rule matches the first qualifying bank transaction. A configuration option requires manual matching when multiple documents match on amount. This supplies a concrete rule-based baseline and shows why an apparently successful match can require ambiguity handling.

  31. AI-Driven Multi-Document Correlation for Enterprise Financial Compliance and Fraud Detection

    Deployment must connect existing enterprise data systems and fit prioritized risk cases into the investigator's audit workflow.

  32. DBS Empowers Its Customer Service Officers with a Gen AI-Powered Virtual Assistant

    DBS’s July 18, 2024 announcement describes an in-house assistant combining telephone speech recognition, real-time transcription and searches of the bank’s knowledge base. Customer-service officers receive query-specific information; the assistant also summarizes calls and prefills service-request fields. Pilots began in October 2023, with wider Singapore deployment planned before the end of 2024. The workflow targets searching and documentation around a human service interaction rather than replacing the entire customer-resolution process.

  33. Your Agent Didn’t Fail. Your Harness Did.

    Delivery alone is insufficient: a named system of record must persist the fact and support replay into future work.

  34. Chase: What are pending transactions and how long do they take?

    A pending credit-card transaction has not been fully processed or posted. Examples include restaurant tips, fuel purchases and merchants waiting for shipment. The amount can still change, and the account balance may not yet reflect it. Posting time depends on the merchant, issuer, network and transaction type.

  35. Chase: Disputing a Charge

    Chase's operational FAQ distinguishes dispute routes by product and status. A credit-card charge must post before a dispute can open. A pending debit-card transaction can be disputed by telephone, while online debit disputes require posting. An assistant that applies the credit-card rule to every transaction would give incorrect service instructions.

  36. CFPB Regulation E: § 1005.11 Procedures for resolving errors

    The official interpretation distinguishes checking whether an electronic transfer was credited or debited, without alleging an error, from communications that trigger error-resolution procedures. Reporting a lost access device triggers those procedures when the consumer also alleges possible unauthorized use. A properly asserted error still requires handling after account closure. Classifying the customer's request therefore affects the required servicing path.

  37. SAS credit scorecards: grouped attributes and additive points

    A scorecard assigns points to borrower attributes, such as an age interval within an age characteristic. The total adds the applicable attribute points. SAS first groups predictor values into bins, fits logistic regression to those grouped variables, then scales its fitted parameters into score points. This connects the familiar additive scorecard to a statistical model rather than an unrelated collection of hand-written rules. Under the guide's convention, higher totals indicate lower modeled default risk. Grouping, fitted coefficients and scaling are separate choices; a decision policy then determines what action follows a score.

  38. Conditional estimates versus decision thresholds

    predict_proba estimates P(Y=1|X=x); decision_function supplies scores that need not be probabilities. Ranking orders cases by score, while an action rule compares a score with a threshold. Changing the threshold leaves probabilities and ranking curves unchanged but changes predicted labels. The documented threshold tuner optimizes a chosen metric using cross-validation. Decision-theoretic derivation: with zero cost for correct decisions, false-positive cost C_FP and false-negative cost C_FN, positive action has expected cost C_FP(1-p), versus C_FN p for negative action. Choose positive when p > C_FP/(C_FP+C_FN), assuming positive total cost. Changing costs changes this threshold without changing p.

  39. Calibration, reliability diagrams and discrimination

    Binary calibration means P(Y=1|p_hat=p)=p: among cases assigned approximately 0.8, approximately 80% should be positive. Reliability diagrams bin predictions and compare each bin's mean probability with its observed positive fraction; sample counts reveal thinly supported bins. Brier loss, mean((p_hat-y)^2), and log loss assess probabilistic predictions but combine calibration with discrimination and outcome uncertainty, so a lower total score does not isolate better calibration. Discrimination concerns ordering: a strictly increasing transformation can preserve ranking while changing probability values and calibration. Calibrators must use predictions from data independent of fitting the underlying classifier.

  40. CFPB Regulation B: § 1002.9 Notifications

    For covered adverse-action statements, Regulation B requires specific principal reasons; merely citing internal policy or an insufficient qualifying score is inadequate. The official interpretation requires reasons to accurately describe factors actually considered or scored. For combined scoring and human judgment, reasons must come from the component responsible for the denial, or both components when both contributed through the described gray-band process. This makes the actual decision path essential: a plausible generated explanation cannot substitute for the reasons that produced the action.

  41. Basel Committee: funding and market liquidity

    Funding liquidity concerns meeting expected and unexpected cash-flow and collateral needs without harming operations or financial condition. Market liquidity concerns the ability to offset a position near the market price despite trading depth and disruptions. A bank that appears solvent can still face a liquidity shortage. Credit, market and operational problems can affect liquidity, so cash availability and timing must be examined alongside asset value and expected losses. These concepts complement operational-risk diagnosis rather than forming mutually exclusive incident labels.

  42. Basel Committee: sound management of operational risk

    Operational risk concerns losses caused by inadequate or failed internal processes, people or systems, or by external events. The Basel definition includes legal risk but excludes strategic and reputational risk, although management should consider those where appropriate. It is inherent across banking activities, rather than confined to a technology team. Technology failures, destructive cyber incidents and natural disasters can disrupt operations. Engineering illustration: an erroneous payment-routing process can create loss even when the intended borrower pays and market prices remain unchanged. The diagnostic question is which process or control failed, distinct from counterparty performance, price exposure or funding availability. Risk functions must coordinate because these loss channels can interact.

  43. Basel Committee: Explanatory Note on Minimum Capital Requirements for Market Risk

    Market risk concerns losses from movements in market prices of positions, such as trading-book instruments. Value at risk describes a loss cutoff at a chosen percentile; expected shortfall considers the average loss in the tail beyond that cutoff. Equal cutoffs can therefore hide different severities of extreme losses. The Basel note also connects market risk to liquidity horizons: exiting or hedging a less liquid position under stress may take longer and affect prices. Sparse observations make some risks difficult to model, motivating separate stress treatment rather than treating missing history as evidence of no risk.

  44. Federal Reserve: Credit loss-estimation methodologies

    Expected credit loss depends on probability of default, loss given default, and exposure at default. These components can have different drivers: borrower condition influences default, collateral affects recovery, and unused commitments can change exposure. The Federal Reserve’s historical discussion shows why a single default ranking is not a complete loss estimate. It also distinguishes scenario-conditioned estimates from long-run averages and explains why ordinary historical fit may fail to represent stressed conditions.

  45. IT Admin for the AI Workforce — Sarthak Aggarwal, Decawork

    Normalize authenticated intent into a typed, logged plan before exposing execution to untrusted evidence.

  46. IT Admin for the AI Workforce — Sarthak Aggarwal, Decawork

    Issue short-lived capabilities for approved actions rather than standing executor credentials, and record the delegation behind each action.

  47. Commission Delegated Regulation (EU) 2018/389, Article 5

    Article 5 specifies dynamic linking when payment providers apply strong customer authentication under PSD2 Article 97(2). The payer must see the amount and payee; the authentication code must bind to those agreed details. Changing the amount or payee invalidates the code. The provision also protects the integrity of transaction details throughout authentication.

  48. Your Agent Didn’t Fail. Your Harness Did.

    Approval must remain bound to one specific action and its scope, identity, arguments, and lifetime; expiration should terminate the approval path.

  49. SEC Staff FAQs Concerning Risk Management Controls for Brokers or Dealers with Market Access

    SEC staff’s market-access explanation distinguishes preventing an order from entering a market from monitoring execution afterward. It describes aggregate customer and broker credit or capital thresholds, erroneous-order checks, restrictions on unauthorized users and restricted securities, and immediate execution reports to surveillance personnel. These controls cover manually entered as well as computer-generated orders. Threshold changes after blocking require evaluation under supervisory procedures and retained reasons. Required controls generally remain under the broker-dealer’s direct and exclusive control, subject to specified exceptions.

  50. Morgan Stanley: Launch of AI @ Morgan Stanley Debrief

    Morgan Stanley describes a client-consented meeting workflow in which Debrief generates notes, identifies action items, summarizes discussion, creates an email for an advisor to edit and send at their discretion, and saves a note into Salesforce. This separates drafting a customer communication from the advisor's decision to send it while showing that another output can enter an operational record system.

  51. Your Agent Didn’t Fail. Your Harness Did.

    Trace one real run from trigger identity through inherited state, authority, execution attempts, and surviving external evidence.

  52. Investor.gov: Bonds — FAQs

    A bond is a debt security: its issuer borrows from investors and promises interest and repayment of principal under its terms. Principal is also called face or par value; maturity is when repayment comes due. Interest payments commonly follow a schedule. These promised payments are not guaranteed receipts: the issuer can fail to pay interest or principal on time. A bond’s market value can also differ from its face value.

  53. Your Agent Didn’t Fail. Your Harness Did.

    Internal acceptance does not prove the intended result appeared at the user-visible boundary.

  54. Resolving an ambiguous payment request

    A timeout can leave the client unable to tell whether Stripe received or executed a request. Stripe documents retrying with the same key and parameters until a server result is obtained, using backoff. An HTTP 500 remains indeterminate: side effects may exist even though the cached response stays unchanged. Stripe may reconcile partial mutations and emit webhook events for resulting objects. Supplying a local operation identifier in metadata lets the application correlate these objects with its own pending operation. Engineering consequence: preserve pending state until authoritative provider evidence resolves it; do not infer failure solely from a timeout.

  55. Stripe retry keys and retention boundaries

    For a mutation, send an idempotency key and reuse that key with identical parameters when retrying an ambiguous connection failure. Stripe stores the first executed request's status and response body, including failures such as HTTP 500, and returns that result for repeated requests. Parameter mismatches produce an error. Keys may be pruned after they are at least 24 hours old; reuse after pruning creates a new request. Results are saved only after endpoint execution begins, so validation failures and conflicts with concurrently executing requests do not create a saved result.

  56. Production Evals For Agentic AI Systems

    Evaluate failures across the workflow, including dependencies, planning, tool execution, and multi-agent coordination.

  57. Production Evals For Agentic AI Systems

    Apply an SRE or production-engineering lens: assess delivered value, operational reliability, human burden, risk, user experience, scalability, and resilience.

  58. FinanceBench: A New Benchmark for Financial Question Answering

    Pranab Islam and colleagues introduced FinanceBench in November 2023, pairing financial questions with reference answers and supporting passages. Their experiments manually assessed 2,400 outputs from 16 configurations on 150 cases, separately recording correct answers, incorrect answers and refusals. Supplying the correct evidence pages improved performance but did not eliminate reasoning errors. Qualitative review also found valid answers differing from the reference. The benchmark therefore separates information access, interpretation and answer assessment instead of treating successful retrieval or exact reference matching as sufficient.

  59. The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables

    Observed outcomes can depend on earlier human decisions, so the labeled sample need not represent the people on whom a replacement model would act. This paper studies bail decisions: a release outcome is observed only for defendants released. Evaluating on that selected subset can misstate performance for a new decision policy. The same structural concern applies to underwriting when repayment outcomes are observed only for granted loans; that financial example is an inference from the mechanism, not an experiment in this paper.

  60. AI-Driven Multi-Document Correlation for Enterprise Financial Compliance and Fraud Detection

    The speaker reports approximately 91% precision on an evaluation involving approximately three million financial records collected over five years across four jurisdictions.

  61. Rolling-origin forecast evaluation

    Time-series cross-validation moves the forecast origin forward. At each origin T, the training set contains only earlier observations, and forecasts are scored against subsequent observations. Repeating this produces an out-of-sample error series; multi-step evaluation scores the horizon actually needed rather than only one-step predictions. Engineering consequence: preprocessing, model fitting and model selection must respect each origin's information boundary. Using a future observation anywhere in constructing its forecast defeats the chronological split.

  62. Lookahead Bias in Pretrained Language Models

    The paper distinguishes historical prompt information from information induced by model pretraining. Its earnings-call experiment finds later pandemic information in risk descriptions generated from pre-pandemic calls. Instructions not to use later information do not eliminate the demonstrated leakage. Masking identifiers also does not guarantee de-identification: models can infer some firm identities and periods. Consequently, restricting retrieved documents to a historical cutoff does not by itself establish that the model's answer uses only historically available information.

  63. CRSP10 historical security, distribution and delisting records

    CRSP retains active and inactive securities. PERMNO identifies a security; PERMCO identifies its company. Name-history rows associate tickers and other attributes with effective date ranges, unlike header values describing the latest available state. Distribution records identify dividends, splits and adjustment factors; merger records can link to a replacement security. Delisting records retain dates, reasons and post-delisting values or returns. Reconstruction implication: select securities eligible at the historical date, join identifiers within their effective intervals, and account consistently for distributions and exits. Filtering that universe to today's survivors conditions inclusion on a later outcome. It removes investments that were available then, potentially omitting failed firms and their losses and inflating evaluated returns. Delisting can also follow a merger, so neither every exit nor the bias's magnitude has one universal interpretation.

  64. The Probability of Backtest Overfitting

    Testing many strategy configurations and choosing the strongest historical result makes selection itself a source of overfitting. Bailey and colleagues define the probability that an in-sample winner ranks below the median out of sample, then propose combinatorially symmetric cross-validation to estimate that quantity across partitions. The analysis concerns the strategy-selection process, not only parameter fitting inside one model. A single attractive backtest therefore omits evidence about how many alternatives were tried and how stable their rankings were.

  65. Basel Committee: Principles for Operational Resilience

    The principles call for mapping critical operations to people, technology, information, processes and external dependencies; testing severe but plausible disruptions; and defining continuity triggers, responsibilities and succession of authority. Third-party contingency plans should consider substitution or bringing services in-house. Incident handling includes severity classification, recovery procedures, communication and lessons learned. Controls should be reassessed after component changes and incidents, and recovery procedures periodically tested and updated.

  66. Right censoring and unresolved event outcomes

    Let T be event time and C the end of observation. A right-censored record stores U=min(T,C) and an indicator delta showing whether the event was observed. When delta=0, the record establishes only that the subject remained event-free through C; the later outcome is unknown. Survival models use this partial information rather than treating C as an event time. S(t)=P(T>t) describes survival beyond t. Financial application: for a default-within-H label, an account observed without default only until C<H is unresolved, not a negative example. A negative requires sufficient event-free follow-up through H.

  67. Stripe card-dispute timing and lifecycle

    A dispute becomes observable to a merchant when Stripe notifies it through configured channels or the API, after the account owner contests a payment. Cardholders usually have 120 days to initiate a dispute, with exceptions; future-service windows may start at the service date. Early fraud warnings and inquiries can precede formal disputes, but warnings can also arrive afterward. A case can await evidence or issuer review before its status becomes won or lost; rare late wins can revise a loss. An inquiry closed without escalation is not an explicit issuer win. Label-design implication: preserve payment time, observation time, reason and evolving status. At a chosen cutoff, an unresolved case remains unresolved, and no recorded dispute means only that none has been observed by then, not confirmed non-fraud.

  68. Stripe dispute categories and contested fraud claims

    Disputes include different reasons, such as duplicate processing, missing products and fraud. Stripe defines the fraudulent category as a cardholder's claim that the payment was unauthorized, and explicitly notes that the cardholder may instead have failed to recognize a legitimate charge. Thus a fraud-coded dispute is an allegation with a particular operational meaning, not infallible confirmation of fraud. For supervised learning, define whether the target is a reported fraud dispute, an adjudicated case outcome or separately investigated fraud. These targets require different evidence and should not be silently substituted for one another.

  69. Federal Reserve SR 26-2: Revised Guidance on Model Risk Management

    The guidance describes clear accountability across development, validation and monitoring, supported by policies, model inventories and documentation tracking recommendations, responses, exceptions and remediation. Effective challenge requires expertise, sufficient independence for objectivity and influence; validation quality depends on rigorous review rather than a prescribed organizational structure. Validation generally precedes first use, with controls and stakeholder awareness when urgent use precedes completion. Conceptual review and outcomes analysis assess suitability; change scope and materiality inform validation timing. Monitoring considers changing exposures, clients, data and markets, with adjustment, recalibration or redevelopment when warranted. Footnote 3 excludes generative and agentic AI while including traditional quantitative and non-generative, non-agentic AI models.

  70. The IIA’s Refreshed Three Lines Model

    The IIA distinguishes three responsibilities: first-line management owns day-to-day risks and operates controls; second-line specialists provide support, challenge and monitoring; internal audit supplies independent assurance and advice, reporting functionally to the board. An accounts-payable team checking duplicate payments exemplifies a first-line control, not independent audit. Coordination does not eliminate these distinctions, and internal audit remains responsible for its conclusions when relying on another provider’s work. An assurance map records which providers cover which risks, exposing duplication and omissions.

  71. The Build-Operate Divide: Bridging Product Vision and AI Operational Reality

    Prioritize human-in-the-loop review at consequential decision points in high-risk, high-trust workflows.

  72. Build AI Systems for Discernment, Not Approval - Angel Ortmann Lee, Duolingo

    The When Machines Mislead case study inserted fake copy-typing alerts into legitimate historical exam sessions and found that skilled proctors accepted half of those alerts.

  73. Mission-Critical Evals at Scale: Learnings from 100,000 Medical Decisions

    Combine evaluator confidence with contextual risk to prioritize cases for expert review.

  74. NIST AI RMF 1.0: accountability, appeals and override

    NIST calls for documented responsibilities and communication, defined human oversight, feedback channels that let affected people report problems and appeal outcomes, and monitoring that includes appeal and override. It also calls for documenting responses to errors; its human-AI discussion identifies override frequency and rationale as useful evidence. Engineering application: attach a dispute to its decision ID and original input/model/policy versions; route it to an accountable reviewer empowered to inspect evidence and authorize correction or override. Record the reviewer, evidence, rationale, revised disposition and downstream correction status, and communicate the result to the affected person. Feed recurring errors into evaluation and remediation. A trace alone does not provide this correction path.

  75. Production Evals For Agentic AI Systems

    Use simulated workflow scenarios and score both task completion and execution quality.

  76. IT Admin for the AI Workforce — Sarthak Aggarwal, Decawork

    Agents with authority and side effects need an operational lifecycle beyond model behavior testing.

  77. IT Admin for the AI Workforce — Sarthak Aggarwal, Decawork

    Separate planning from execution so that reasoning over content does not itself confer authority to invent and execute actions.

  78. Moving away from Agile: What's Next?

    Automation can move the bottleneck into human collaboration and manual review while increasing code complexity.

  79. The Build-Operate Divide: Bridging Product Vision and AI Operational Reality

    Treat the prototype-to-reliability transition as a recurring operational iteration loop, described here as crossing a quality chasm.

  80. SEC: Electronic Recordkeeping Requirements, Release 34-96034

    The 2022 amendments provide an audit-trail alternative to non-rewriteable, non-erasable storage. The alternative preserves timestamped modifications and deletions, action times, applicable individual identities and information needed to recreate original and intermediate records. The final text accommodates automated actions and permits individual identity through a unique identifier. Its purpose is reconstructable, authentic records, not merely a log declaring that an operation succeeded.

  81. Agents Need Feature Flags

    Track mitigation effectiveness and record flag changes with enough context to reconstruct an incident.

  82. Agents Need Feature Flags

    Ship agent-wide and per-tool kill switches first, and ensure in-flight work checks them at the next decision point.

  83. FSB: Financial stability implications of artificial intelligence

    The FSB’s November 2024 assessment identifies third-party dependencies, correlated market behavior, cyber risk, and model risk as channels through which AI adoption can amplify financial vulnerabilities. It distinguishes operational uses, such as document summarization and retrieval, from the broader consequences of common infrastructure and similar decisions across institutions. A system that is useful to one organization can still share failure dependencies with many others, so evaluation should include provider concentration and contingency planning alongside local model quality.

  84. Event time and actual availability require separate handling

    This first-party issue reports that created_timestamp was used for deduplication rather than a decision-time availability filter, allowing later backfills to replace historical values. Its proposed predicate requires created_timestamp <= entity_timestamp, independently of event-time TTL. Engineering inference: retain event time, actual availability time and immutable versions; at decision time T, first exclude versions unavailable at T, then select the appropriate event and version. A correction to yesterday's event published tomorrow must not enter today's replay. Availability should represent when the serving system could use the value, not merely the business event's timestamp.

  85. How to Build Planning Agents Without Losing Control - Yogendra Miraje, FactSet

    Insert a natural-language blueprint before low-level planning to provide a high-level task breakdown and restrict the planner's available tools.

  86. FICO Celebrates 70 Years of Innovation and Says “Hello, Future” to Applied Intelligence

    FICO’s corporate history connects several distinct developments: William Fair and Earl Isaac founded the company in 1956; commercial credit-risk models followed in the late 1950s; application-processing software launched in 1972 to address growing application volumes and slow, uneven manual reviews. The FICO Score, introduced in 1989, supplied a standardized cross-bureau credit-risk measure. The account dates Falcon’s neural-network payment-fraud system to 1992. These distinguish estimating repayment risk, processing applications and detecting suspicious payments rather than treating financial AI as one forecasting task.

  87. BloombergGPT: A Large Language Model for Finance

    Shijie Wu, Ozan Irsoy and colleagues introduced BloombergGPT in March 2023 as a 50-billion-parameter language model trained on mixed financial and general-purpose text. The aim extended beyond one sentiment classifier to financial language tasks including entity recognition, entity linking and question answering while retaining general capabilities. Its entity-linking evaluation required identifying company mentions and returning their stock tickers; performance varied by document domain. The paper reports financial and general benchmark results, rather than demonstrating an autonomous investment or transaction workflow.