{"id":1114,"date":"2026-11-03T14:49:45","date_gmt":"2026-11-03T14:49:45","guid":{"rendered":"https:\/\/perit.ai\/blogs\/?p=1114"},"modified":"2026-11-03T14:49:45","modified_gmt":"2026-11-03T14:49:45","slug":"banking-agent-procedure-final-state-check","status":"publish","type":"post","link":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/","title":{"rendered":"The Database Agreed. Nobody Told Him the Penalty."},"content":{"rendered":"\n<div class=\"bankproc-post\" style=\"max-width: 50rem;margin: 0 auto;font-family: Verdana, Geneva, Tahoma, sans-serif;font-size: 1rem;line-height: 1.72;color: #0b0b0b\">\n<div class=\"meta\" style=\"font-size: .92rem;color: #52514e;margin-bottom: 1.6rem;padding-bottom: .65rem;border-bottom: 1px solid #e6e5e0\">A bank&#8217;s AI assistant closes a fixed deposit and every record comes out right. The customer is still short-changed. A new Indian banking benchmark shows why grading the database misses the steps that change nothing, and what that does to every score built on it.<\/div>\n<div class=\"takeaways\" style=\"margin: 0 0 1.8rem;padding: .95rem 1.1rem .4rem;border: 1px solid #e6e5e0;border-left: 4px solid #2a78d6;border-radius: 0 10px 10px 0;background-color: #fcfcfb\"><p class=\"takeaways-head\" style=\"margin: 0 0 .45rem;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;text-transform: uppercase\">In short<\/p><ul style=\"padding: 0;margin: 0 0 .6rem 1.2rem\"> <li style=\"margin: 0 0 .45rem;padding-left: .15rem;font-size: .95rem;line-height: 1.55\">Many required banking steps are reads: a closure quote, a status check, a minimum-balance rule. They leave no trace in the records, so a check that compares only final records cannot see them skipped.<\/li> <li style=\"margin: 0 0 .45rem;padding-left: .15rem;font-size: .95rem;line-height: 1.55\">TauIndianBankBench scored the same 1,000 sessions per model twice. Checking only the final records raised every model&#8217;s pass rate by 6.5 to 12.0 points. In loan tasks, where no tool changes a record, 20.8% of sessions passed on records while breaking procedure.<\/li> <li style=\"margin: 0 0 .45rem;padding-left: .15rem;font-size: .95rem;line-height: 1.55\">The two checks catch different failures. The strongest models fail more often by doing too much: unrequested writes are 34.4% of one model&#8217;s failures. The weakest make every call and still leave the records wrong.<\/li> <li style=\"margin: 0 0 .45rem;padding-left: .15rem;font-size: .95rem;line-height: 1.55\">A second run moved each pass rate by at most 2.7 points while 14% to 26% of tasks flipped outcome. Stable averages can hide unstable customers.<\/li> <\/ul><\/div>\n<p class=\"lede\" style=\"margin: 0 0 1rem;font-size: 1.08rem\">It is 11:20 on a Thursday morning in Nagpur. Prakash Deshmukh, sixty-eight, a retired schoolteacher, opens his bank&#8217;s app and types slowly with one finger.<\/p>\n<p style=\"margin: 0 0 1rem\"><em>Please close my FD ending 4471 and put the money in savings. Granddaughter&#8217;s \u20b91,80,000 college fee is due Friday.<\/em><\/p>\n<p style=\"margin: 0 0 1rem\">The assistant is quick and polite. It finds the deposit: \u20b92,00,000, booked seven months ago for twelve months at 7.3%. It closes it. It checks his savings balance. \u201cDone! Your fixed deposit has been closed and \u20b92,05,833 has been credited to your savings account. Is there anything else I can help you with?\u201d<\/p>\n<p style=\"margin: 0 0 1rem\">Mr Deshmukh thanks it. That evening his son does the arithmetic on a napkin and asks why the interest is so low. The next morning, at the branch, the manager explains: a deposit broken early earns the rate for the period it actually ran, less a penalty. Then she asks the question that makes him sit back. Why didn&#8217;t he take an overdraft against the deposit for ten days, until his pension and a maturing recurring deposit came in?<\/p>\n<p style=\"margin: 0 0 1rem\">Because nobody told him there was anything to decide.<\/p>\n<p style=\"margin: 0 0 1rem\">Mr Deshmukh and this scene are fictional, and the numbers are a worked example, not any bank&#8217;s rates. Assume the penalty was disclosed when he booked the deposit; what the assistant omitted now was the closure quote and the chance to reconsider. Open the bank&#8217;s database after the chat and you will find nothing wrong. The deposit is closed. The savings account is credited with exactly the right amount. If an evaluator compared those records with the expected ones, the session would pass. Every record is correct. The customer was still short-changed by a sentence that was never said.<\/p>\n<div class=\"thesis\" style=\"margin: 1.6rem 0;padding: 1rem 1.15rem;border-left: 4px solid #2a78d6;background-color: #fcfcfb;font-family: Georgia, &apos;Times New Roman&apos;, serif;font-size: 1.18rem;line-height: 1.55\">A database remembers what an agent changed. A banking procedure is mostly made of things that change nothing: the look before the touch. An evaluation that reads only the final records can grade the touch. It can never grade the look.<\/div>\n<figure class=\"viz\" style=\"margin: 2.2rem 0\"><div class=\"viz-card\" style=\"border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: 14px 14px 8px;overflow: auto\"><a href=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1.webp\" rel=\"noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Two sessions close the same fixed deposit. Session A reads the deposit, reads the closure quote, tells the customer the penalty, closes the deposit and reads the balance. Session B skips the closure quote. Both leave identical records, so both pass the final-state check; only Session A passes the action check.\" class=\"wp-image-1109\" height=\"904\" loading=\"lazy\" src=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1.webp\" style=\"display:block;width:100%;height:auto\" width=\"1520\" srcset=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1.webp 1520w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1-300x178.webp 300w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1-1024x609.webp 1024w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-1-768x457.webp 768w\" sizes=\"auto, (max-width: 1520px) 100vw, 1520px\" \/><\/a><\/div><figcaption class=\"viz-caption\" style=\"margin-top: .65rem;font-size: .9rem;line-height: 1.55;color: #52514e\"><strong>Figure 1.<\/strong> One task, two sessions. Both close the deposit and leave identical records, so a final-state check passes both. Only an action check, which looks for every required call including reads, sees that Session B never obtained the closure quote.<\/figcaption><\/figure>\n<h2 id=\"grading-the-database-was-the-right-correction\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Grading the database was the right correction<\/h2>\n<p style=\"margin: 0 0 1rem\">Start with why evaluators look at the database at all, because it was a hard-won idea and it is still correct.<\/p>\n<p style=\"margin: 0 0 1rem\">A conversational agent can describe work it never did. The refund that was \u201con its way\u201d in <a href=\"https:\/\/perit.ai\/blogs\/the-model-got-8-10-for-what\/\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">our post on rubric grading<\/a> had never been submitted. The payment date that was \u201cnow the 15th\u201d in <a href=\"https:\/\/perit.ai\/blogs\/pass-k-ai-agent-reliability\/\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">our pass^k post<\/a> was still the 8th when someone opened the billing record. Prose is cheap. A grader that reads the transcript rewards fluent claims.<\/p>\n<p style=\"margin: 0 0 1rem\">So the \u03c4-bench family of benchmarks graded differently. After the conversation, replay the reference solution on a fresh copy of the world, then compare the agent&#8217;s final records with the expected ones. <a href=\"#ref-2\" style=\"color: #2a78d6;text-decoration: underline\">[2]<\/a> If they match, the work happened. If they do not, no amount of confident language helps. The pass^k post put it plainly: the check that grades an evaluation call is the same check that should gate a write in production.<\/p>\n<p style=\"margin: 0 0 1rem\">That advice survives this essay. In the benchmark at the centre of it, a scripted agent that simply announces, persuasively, that the work is complete passes no task at all. <a href=\"#ref-1\" style=\"color: #2a78d6;text-decoration: underline\">[1]<\/a> The database is a far better witness than the transcript.<\/p>\n<p style=\"margin: 0 0 1rem\">It is just not the only witness a bank needs.<\/p>\n<h2 id=\"most-of-a-procedure-changes-nothing\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Most of a procedure changes nothing<\/h2>\n<p style=\"margin: 0 0 1rem\">Write down what a careful human clerk does when Mr Deshmukh asks to close his deposit. The easiest way to see the problem is to list the steps and mark which ones touch a record.<\/p>\n<p style=\"margin: 0 0 1rem\">Look up the deposit. Read. Get the closure quote: the rate for the period run, the penalty, the amount payable. Read. Tell the customer and ask whether he still wants to go ahead. No tool call at all. Close the deposit. Write. Confirm the new balance. Read.<\/p>\n<p style=\"margin: 0 0 1rem\">Five steps. One changes a record. A final-state check observes the effects of that one write and is blind to the other four, one of which no tool call can show at all.<\/p>\n<p style=\"margin: 0 0 1rem\">Krishanu Adhikary and Prashant Devadiga of the National Payments Corporation of India built a benchmark around exactly this blindness. <a href=\"#ref-1\" style=\"color: #2a78d6;text-decoration: underline\">[1]<\/a> TauIndianBankBench is a synthetic Indian retail bank: 944 customers with accounts, cards, deposits, loans, mandates and KYC status; a written policy; 24 knowledge-base documents on things like deposit insurance and tax on interest; and 34 tools. Of the 33 servicing tools, 13 count as writes. The other 20 only read. Each of the 1,000 tasks comes with a gold chain, the reference sequence of calls that resolves it, averaging 3.54 calls.<\/p>\n<p style=\"margin: 0 0 1rem\">The bank&#8217;s policy turns into reads with remarkable regularity. 962 of the 1,000 tasks require at least one read-only call. 114 require no write at all. Before closing a deposit, the assistant must obtain a closure quote \u201cso that the customer knows the penalty.\u201d Before booking a deposit the balance may not support, it must look up the minimum-balance rule. Before blocking a card, it must check the card&#8217;s status.<\/p>\n<div class=\"table-wrap\" style=\"overflow: auto;margin: 1.8rem 0\"><table style=\"width: 100%;border-collapse: collapse;font-size: .92rem;line-height: 1.5\"> <thead><tr><th style=\"text-align: left;padding: .65rem .6rem;border-bottom: 2px solid #0b0b0b\">Request<\/th><th style=\"text-align: left;padding: .65rem .6rem;border-bottom: 2px solid #0b0b0b\">Required step the records never show<\/th><th style=\"text-align: left;padding: .65rem .6rem;border-bottom: 2px solid #0b0b0b\">What skipping it costs the customer<\/th><\/tr><\/thead> <tbody> <tr><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Close a deposit early<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Closure quote<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">The penalty, and the chance to choose otherwise<\/td><\/tr> <tr><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Book a deposit<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Minimum-balance rule<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">A savings account left below its floor<\/td><\/tr> <tr><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Block a card<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Card status<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">A block applied without checking whether it is needed or appropriate<\/td><\/tr> <tr><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Book a senior-citizen deposit<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Eligibility and rate card<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">A rate quoted that the customer cannot get<\/td><\/tr> <tr><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Foreclose a loan<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">Foreclosure quote<\/td><td style=\"padding: .65rem .6rem;border-bottom: 1px solid #e6e5e0;vertical-align: top\">The payoff amount, unseen before committing<\/td><\/tr> <\/tbody><\/table><\/div>\n<p style=\"margin: 0 0 1rem\">On a task that requires no change, the paper notes, any session that makes no change passes the final-state check. Doing nothing and doing everything correctly produce the same database.<\/p>\n<p style=\"margin: 0 0 1rem\">That matters most where a whole service area runs on reads. In this benchmark, no loan tool is a write: EMIs, rates, foreclosure quotes and gold-loan valuations are all lookups. Pooled across six models, 20.8% of sessions on loan tasks passed on records while violating procedure, against 7.9% to 10.5% in deposits, cards and everyday banking. Where the procedure is invisible, it is skipped most.<\/p>\n<figure class=\"viz\" style=\"margin: 2.2rem 0\"><div class=\"viz-card\" style=\"border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: 14px 14px 8px;overflow: auto\"><a href=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2.webp\" rel=\"noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Share of sessions that are procedural violations, pooled over six models, by service area: loans 20.8 percent, cards 10.5, everyday banking 8.6, deposits 7.9.\" class=\"wp-image-1110\" height=\"704\" loading=\"lazy\" src=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2.webp\" style=\"display:block;width:100%;height:auto\" width=\"1520\" srcset=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2.webp 1520w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2-300x139.webp 300w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2-1024x474.webp 1024w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-2-768x356.webp 768w\" sizes=\"auto, (max-width: 1520px) 100vw, 1520px\" \/><\/a><\/div><figcaption class=\"viz-caption\" style=\"margin-top: .65rem;font-size: .9rem;line-height: 1.55;color: #52514e\"><strong>Figure 2.<\/strong> Pooled over six models, a fifth of loan-task sessions ended with correct records while skipping a required step or making an unrequested change. Every loan tool in the benchmark is a read, so the final-state check cannot see an omitted loan step.<\/figcaption><\/figure>\n<h2 id=\"score-the-same-sessions-twice\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Score the same sessions twice<\/h2>\n<p style=\"margin: 0 0 1rem\">The benchmark&#8217;s central move is simple enough to do on any evaluation you already run. Keep the final-state check. Add an action check that looks through the session for every call in the gold chain, reads included, in any order. Then add one more rule, which the authors call write purity: any change the task did not request fails the session, even if the agent later undoes it.<\/p>\n<p style=\"margin: 0 0 1rem\">A session passes only if both checks pass. And because both checks run on the same recorded sessions, the difference between scoring rules is not noise from a new run. It is the scoring rule itself.<\/p>\n<p style=\"margin: 0 0 1rem\">Call <em>F<\/em> the pass rate under the final-state check alone and <em>P<\/em> the pass rate under both. Their difference counts the sessions that ended with exactly the right records and still broke the procedure:<\/p>\n<div class=\"eq\" style=\"margin: 1.2rem 0 1.3rem;padding: .85rem 1rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;font-family: Georgia, &apos;Times New Roman&apos;, serif;font-size: 1.08rem;text-align: center;overflow: auto\"><em>F<\/em> \u2212 <em>P<\/em> = <em>b<\/em> \/ <em>N<\/em>,\u00a0\u00a0 where <em>b<\/em> = sessions with correct records that fail the action check<\/div>\n<p style=\"margin: 0 0 1rem\">For Gemma 4 31B, <em>F<\/em> = 0.896 and <em>P<\/em> = 0.776. The difference is 0.120, and <em>b<\/em> is 120 sessions out of 1,000. One session in eight that a records-only evaluation would have called a success skipped a required step or touched something it should not have. Measured against the honest score, the records-only number overstates the model by 0.120 \/ 0.776, about 15%.<\/p>\n<figure class=\"viz\" style=\"margin: 2.2rem 0\"><div class=\"viz-card\" style=\"border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: 14px 14px 8px;overflow: auto\"><a href=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3.webp\" rel=\"noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Pass rates of six models on 1,000 tasks scored two ways on the same sessions. Final-state only: 92.0, 89.6, 82.1, 76.4, 72.5 and 59.8 percent. Both checks: 84.9, 77.6, 71.4, 69.9, 60.7 and 47.9 percent. The gap is 6.5 to 12.0 points.\" class=\"wp-image-1111\" height=\"988\" loading=\"lazy\" src=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3.webp\" style=\"display:block;width:100%;height:auto\" width=\"1520\" srcset=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3.webp 1520w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3-300x195.webp 300w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3-1024x666.webp 1024w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-3-768x499.webp 768w\" sizes=\"auto, (max-width: 1520px) 100vw, 1520px\" \/><\/a><\/div><figcaption class=\"viz-caption\" style=\"margin-top: .65rem;font-size: .9rem;line-height: 1.55;color: #52514e\"><strong>Figure 3.<\/strong> Pass rates for six models on TauIndianBankBench\u2019s 1,000-task base split, computed on the same recorded sessions with the final-state check alone and with both checks. The authors give a 95% interval of about \u00b13 points on each overall score.<\/figcaption><\/figure>\n<p style=\"margin: 0 0 1rem\">Across the six open-weight models tested, five from the Gemma 4 family and Qwen3.8-27B, checking only the final records raised the pass rate by between 6.5 and 12.0 points. Every model. No exceptions at the top or the bottom.<\/p>\n<p style=\"margin: 0 0 1rem\">Two details make the result sharper than a headline gap. First, the ranking survives. Order the models by either score and you get the same list. A team picking the best of six would pick the same one. Second, the distances do not survive. Under the final-state check, Qwen3.8-27B leads Gemma 4 31B by 2.4 points, inside the roughly \u00b13-point confidence interval the authors give for each score. Under both checks the lead is 7.3 points. Records-only grading did not reorder the leaderboard. It compressed it, and made two quite different procedural behaviours look almost the same.<\/p>\n<h2 id=\"neither-check-can-stand-in-for-the-other\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Neither check can stand in for the other<\/h2>\n<p style=\"margin: 0 0 1rem\">The tempting conclusion is that the final-state check is simply the weaker test and the action check should replace it. The data say otherwise.<\/p>\n<p style=\"margin: 0 0 1rem\">The two checks disagree on two kinds of session. Call them <em>b<\/em>, correct records but a broken procedure, and <em>c<\/em>, every required call made but incorrect records at the end. For the three strongest models, <em>b<\/em> dominates: Gemma 4 31B has 120 sessions of the first kind and 25 of the second. For the weakest, Gemma 4 E2B, the balance flips: 118 against 180. The authors test the asymmetry with McNemar&#8217;s test, which asks only whether <em>b<\/em> and <em>c<\/em> differ more than chance would allow. For the strong models the answer is overwhelmingly yes, with p below 10<sup>\u22128<\/sup>.<\/p>\n<p style=\"margin: 0 0 1rem\">The weak model goes through the motions. It calls the closure quote, closes the deposit, and gets the account or the amount wrong. Only the database notices. The strong model gets the outcome right and cuts a corner on the way. Only the procedure check notices. A team that keeps one check has chosen in advance which kind of failure it is willing not to see.<\/p>\n<p style=\"margin: 0 0 1rem\">This is also where an earlier Perit post needs a footnote. Writing about AppWorld, <a href=\"https:\/\/perit.ai\/blogs\/rl-environments-voice-agents\/\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">we noted<\/a> that different procedures can receive credit if they reach the right outcome. That is the right default for paths that are genuinely interchangeable. It is the wrong default for a step the regulator wrote down. A required disclosure is not a style choice on the way to the outcome. It is part of the outcome.<\/p>\n<h2 id=\"the-stronger-models-mistake-is-doing-more\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">The stronger model&#8217;s mistake is doing more<\/h2>\n<p style=\"margin: 0 0 1rem\">Look inside the failures and a second pattern appears. The authors sort each failed session into one of three types. The agent stopped short of the full procedure. It made an unrequested write. Or it made every call and finished with errors.<\/p>\n<p style=\"margin: 0 0 1rem\">Stopping short is the most common failure for every model, between 49.6% and 64.0% of failed sessions. The other two move in opposite directions with capability. Unrequested writes are 34.4% of failures for Qwen3.8-27B and 29.0% for Gemma 4 31B, but only 9.7% to 13.5% for the three weakest models. Finishing with errors runs the other way: 13.8% to 15.9% of failures for the three strongest, 28.2% to 36.9% for the three weakest.<\/p>\n<figure class=\"viz\" style=\"margin: 2.2rem 0\"><div class=\"viz-card\" style=\"border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: 14px 14px 8px;overflow: auto\"><a href=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4.webp\" rel=\"noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"How each model&apos;s failed sessions divide into three types. Unrequested writes are 34.4 percent of Qwen3.8-27B&apos;s failures and 29.0 percent of Gemma 4 31B&apos;s, but 9.7 to 13.5 percent for the three weakest models, whose failures more often finish with errors.\" class=\"wp-image-1112\" height=\"880\" loading=\"lazy\" src=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4.webp\" style=\"display:block;width:100%;height:auto\" width=\"1520\" srcset=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4.webp 1520w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4-300x174.webp 300w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4-1024x593.webp 1024w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-4-768x445.webp 768w\" sizes=\"auto, (max-width: 1520px) 100vw, 1520px\" \/><\/a><\/div><figcaption class=\"viz-caption\" style=\"margin-top: .65rem;font-size: .9rem;line-height: 1.55;color: #52514e\"><strong>Figure 4.<\/strong> Failed sessions by type. Stopping short is the most common failure for every model; unrequested writes make up a larger share for the strongest models, and finishing with errors a larger share for the weakest.<\/figcaption><\/figure>\n<p style=\"margin: 0 0 1rem\">The capable model&#8217;s characteristic error is initiative. It freezes the card the customer mentioned in passing. It changes a renewal instruction nobody asked about. It closes the wrong one of two similar deposits because it moved before it asked.<\/p>\n<p style=\"margin: 0 0 1rem\">Write purity is the rule that catches this, and its sharpest clause is the one about undoing. If the agent freezes a card and unfreezes it three turns later, the final records are identical to a session that never touched the card. The final-state check passes. Write purity fails the session anyway, \u201cbecause the customer was affected while the change was in place.\u201d A card that was frozen for four minutes is a card that was declined for four minutes at a petrol pump in Wardha. The database has forgotten. The customer has not.<\/p>\n<p style=\"margin: 0 0 1rem\">Write purity also blocks the obvious exploit of an action check. An agent that calls every tool in the catalogue would satisfy a list of required calls. In the benchmark, a scripted agent that makes every available change fails every task on purity.<\/p>\n<h2 id=\"the-average-held-still-the-tasks-did-not\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">The average held still. The tasks did not.<\/h2>\n<p style=\"margin: 0 0 1rem\">There is one more thing a single score hides, and it is the one a customer feels.<\/p>\n<p style=\"margin: 0 0 1rem\">The authors ran the full benchmark twice for the five Gemma models. Each model&#8217;s pass rate moved by at most 2.7 points. By the standards of a leaderboard, that is a stable result. But between the two runs, 14% to 26% of tasks changed outcome: passed once, failed once.<\/p>\n<figure class=\"viz\" style=\"margin: 2.2rem 0\"><div class=\"viz-card\" style=\"border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: 14px 14px 8px;overflow: auto\"><a href=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5.webp\" rel=\"noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Outcomes of two attempts per task for five Gemma 4 models. Pass both: 69.1, 61.1, 59.1, 46.5 and 36.9 percent. Mixed: 14.3, 20.3, 22.7, 26.0 and 23.1 percent. Fail both: 16.6, 18.6, 18.3, 27.5 and 39.9 percent.\" class=\"wp-image-1113\" height=\"792\" loading=\"lazy\" src=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5.webp\" style=\"display:block;width:100%;height:auto\" width=\"1520\" srcset=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5.webp 1520w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5-300x156.webp 300w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5-1024x534.webp 1024w, https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-figure-5-768x400.webp 768w\" sizes=\"auto, (max-width: 1520px) 100vw, 1520px\" \/><\/a><\/div><figcaption class=\"viz-caption\" style=\"margin-top: .65rem;font-size: .9rem;line-height: 1.55;color: #52514e\"><strong>Figure 5.<\/strong> Two attempts per task for the five Gemma 4 models. The share passing both attempts estimates pass^2 directly; the middle band is the share of tasks whose outcome flipped between runs.<\/figcaption><\/figure>\n<p style=\"margin: 0 0 1rem\">The pass^k post defined the quantity a customer actually experiences: the probability that an agent succeeds on every one of <em>k<\/em> attempts at the same task, averaged over tasks. If task <em>t<\/em> passes with probability <em>p<sub>t<\/sub><\/em>, then<\/p>\n<div class=\"eq\" style=\"margin: 1.2rem 0 1.3rem;padding: .85rem 1rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;font-family: Georgia, &apos;Times New Roman&apos;, serif;font-size: 1.08rem;text-align: center;overflow: auto\">pass^<em>k<\/em> = average over tasks of <em>p<sub>t<\/sub><\/em><sup><em>k<\/em><\/sup><\/div>\n<p style=\"margin: 0 0 1rem\">Two runs give a direct estimate of pass^2: the share of tasks that passed both times. For Gemma 4 31B that is 69.1%. Its average pass rate across the two runs is 69.1 + 14.3\/2 = 76.25%.<\/p>\n<p style=\"margin: 0 0 1rem\">A naive calculation would square the average: 0.7625\u00b2 = 58.1%. The observed share passing both is eleven points higher. Under independent attempts with a stable success probability for each task, Jensen&#8217;s inequality explains why: the average of squares is never smaller than the square of the average, and the population gap is exactly the variance of <em>p<sub>t<\/sub><\/em> across tasks. These two runs suggest a gap of about 0.691 \u2212 0.581 = 0.11; they do not measure each task&#8217;s probability exactly. Easier and harder tasks can produce a large gap, and the reliability of the agent lives task by task, not in the mean.<\/p>\n<p style=\"margin: 0 0 1rem\">The useful reading is the middle band. For Gemma 4 31B, one task in seven is a coin that came up differently on two throws. For the smaller models it is one in four. If those tasks are the closure quotes and the minimum-balance checks, then a customer&#8217;s experience depends on which day they called. The pass rate cannot tell you. The paper&#8217;s headline results use one attempt per task, and the authors are explicit that pass^k multiplies an already expensive evaluation by <em>k<\/em>.<\/p>\n<h2 id=\"the-tempting-fix-is-to-let-a-model-read-the-transcript\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">The tempting fix is to let a model read the transcript<\/h2>\n<p style=\"margin: 0 0 1rem\">If the records cannot see the look before the touch, why not have a judge model read the conversation and decide whether the customer was properly informed?<\/p>\n<p style=\"margin: 0 0 1rem\">Partly because the benchmark tried it. The \u03c4\u00b2-bench harness it runs in includes a judge that grades the conversation text. Against the deterministic scorer, the judge agreed on 87.5% of sessions and gave less credit in every disagreement. That is not bad. It is also one in eight sessions decided by a second model&#8217;s reading, with known biases toward position, verbosity and its own outputs. <a href=\"#ref-1\" style=\"color: #2a78d6;text-decoration: underline\">[1]<\/a> For a regulated step, a deterministic check on whether the quote tool was called is a stronger floor. Whether the quote was then explained clearly is a further question, and a fair one for a judge or a person.<\/p>\n<p style=\"margin: 0 0 1rem\">There is a subtler problem, and it sits in the gold chain itself. A deterministic check is only as good as the procedure it encodes. In this benchmark, a language model drafted the tasks against the live environment, and a task was admitted only after passing four filters, including that its own gold chain passes both checks. That is careful engineering. It still means somebody had to decide that a closure quote is required before closing a deposit and a card-status check before a block. Here those rules came from a written policy built for the benchmark. In a real bank, they live in circulars, branch manuals and the heads of people who have done the job for a decade.<\/p>\n<p style=\"margin: 0 0 1rem\">Some of those rules are regulation. The Reserve Bank of India&#8217;s current commercial-bank deposit directions require interest at the rate applicable to the amount and period the deposit actually ran, rather than the contracted rate. They also require a board-approved penalty policy and disclosure of the penalty components when the deposit is accepted; without that disclosure, no penalty may be levied. <a href=\"#ref-3\" style=\"color: #2a78d6;text-decoration: underline\">[3]<\/a> That is an opening-time disclosure rule. The quote before closure in this essay comes from the benchmark&#8217;s servicing policy, and makes the actual cost visible when the customer can still choose. Many more rules are practice. Some banks waive the penalty on small deposits. Some would offer an overdraft first. Which ones belong in the gold chain is an operator&#8217;s judgment, not a model&#8217;s.<\/p>\n<p style=\"margin: 0 0 1rem\">And there is the customer. In the benchmark, a language model plays the customer, and in graded tasks it \u201casks the assistant to return to a step it skipped.\u201d <a href=\"#ref-1\" style=\"color: #2a78d6;text-decoration: underline\">[1]<\/a> That is a reasonable design for measuring procedure. It is also a generous one. Mr Deshmukh did not know a closure quote existed. He could not have asked for it back. A cooperative simulated customer may catch an agent&#8217;s omissions that a real customer never would, which suggests real-world violation rates could be higher than these, though nobody has measured that.<\/p>\n<h2 id=\"somebody-has-to-write-down-the-look\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Somebody has to write down the look<\/h2>\n<p style=\"margin: 0 0 1rem\">Put the pieces together and an evaluation for a regulated service agent needs to record more than an outcome. It needs the procedure as data.<\/p>\n<div class=\"cards\" style=\"display: flex;flex-wrap: wrap;gap: 12px;margin: 1.6rem 0 2rem\"> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">01 \u00b7 REQUIRED READS<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">List the looks, not only the touches<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">For each request type, the reads a careful clerk makes before acting: quotes, status checks, eligibility, limits. Score their presence. In this benchmark, 962 of 1,000 tasks needed one.<\/p><\/div> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">02 \u00b7 PURITY<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Fail any change nobody asked for<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Including changes later undone. Report unrequested writes as their own failure type; they are where capable models go wrong.<\/p><\/div> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">03 \u00b7 BOTH CHECKS<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Report b and c, not one number<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Publish the final-state pass rate, the combined pass rate, and the two disagreement counts. The gap is a measurement of procedure, not an embarrassment to hide.<\/p><\/div> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">04 \u00b7 REPEATS<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Run each task more than once<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Report the share of tasks that flip. A stable average with a quarter of tasks changing outcome is not a stable agent.<\/p><\/div> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">05 \u00b7 AUTHORS<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Let operators write the gold chain<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">The required steps should come from people who have signed off on these calls at work, with the circular or manual they come from attached.<\/p><\/div> <div class=\"card\" style=\"flex: 1 1 15rem;min-width: 15rem;border: 1px solid #e6e5e0;border-radius: 10px;background-color: #fcfcfb;padding: .9rem 1rem .5rem\"><span class=\"step-no\" style=\"display: block;color: #2a78d6;font-size: .78rem;font-weight: 700;letter-spacing: .08em;margin-bottom: .3rem\">06 \u00b7 CUSTOMERS<\/span><p class=\"card-title\" style=\"font-weight: 700;color: #0b0b0b;margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Include customers who do not know the rules<\/p><p style=\"margin: 0 0 .5rem;font-size: .92rem;line-height: 1.58\">Simulated customers that remind the agent of skipped steps measure procedure under help. Real callers, in their own language, measure it without.<\/p><\/div> <\/div>\n<p style=\"margin: 0 0 1rem\">Readers of <a href=\"https:\/\/perit.ai\/blogs\/what-is-an-rl-environment\/\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">our essay on building an RL environment<\/a> have met this person already. Asha Kulkarni answered phones for a bank in Mumbai for eleven years. Her rule was that information can come from anyone on the line, but instructions only from someone verified, and its first criterion was an order check: an identity question or permission lookup had to come before the first record-changing call. That is a required read, written in her words. TauIndianBankBench is a thousand of those sentences, turned into calls a scorer can find.<\/p>\n<p style=\"margin: 0 0 1rem\">This is the part of the work Perit was built around: rubrics written by an operator from the sector, and voice environments where personas are played by trained speakers, \u201cincluding the ones who talk over your agent.\u201d Teams who want to test an agent against that kind of caller can start from <a href=\"https:\/\/perit.ai\/rl-environments\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">Perit&#8217;s RL environments<\/a>.<\/p>\n<h2 id=\"what-this-does-not-say\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">What this does not say<\/h2>\n<p style=\"margin: 0 0 1rem\">It does not say that final-state grading is wrong. It is necessary. The benchmark keeps it, and for the weakest model it catches more failures than the procedure check does.<\/p>\n<p style=\"margin: 0 0 1rem\">It does not say that 6.5 to 12 points is how often deployed banking agents skip steps. The customers are synthetic, the simulated customer is a single model whose own error rate the authors did not measure, and the frequency of each edge case reflects generated records, not real bank traffic. The benchmark is English only.<\/p>\n<p style=\"margin: 0 0 1rem\">It does not say these six models are unsafe for banks, or that others are safe. The authors are explicit that a pass shows only that, with their simulated customer, the assistant made the required calls, made no unrequested change and left the records correct. Deployment would need safety, privacy and regulatory review.<\/p>\n<p style=\"margin: 0 0 1rem\">And it does not say every path to an outcome must be identical. The action check does not score call order; order matters only where the task makes it matter, such as a step that needs a value an earlier one returns. It asks that required steps happen, not that agents follow a script.<\/p>\n<h2 id=\"back-to-nagpur\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Back to Nagpur<\/h2>\n<p style=\"margin: 0 0 1rem\">Open the database once more. The deposit ending 4471 is closed. \u20b92,05,833 sits in Mr Deshmukh&#8217;s savings account. Under the worked rates, that is the rate for seven months less the penalty, 5% simple, on \u20b92,00,000: \u20b95,833 of interest, \u20b92,683 less than seven months at the contracted 7.3% would have paid. Assuming eligibility, a sanctioned overdraft of \u20b91,80,000 for the college fee, repaid after ten days at an illustrative 8.3% with no fees, would cost about \u20b9409. That borrowing is 90% of the deposit, a limit offered on some FD-backed products; the bank would still need to check the actual product and terms. <a href=\"#ref-4\" style=\"color: #2a78d6;text-decoration: underline\">[4]<\/a><\/p>\n<p style=\"margin: 0 0 1rem\">None of that is in the records. The records are right. What is missing is a read that changes nothing, and a sentence the customer was owed before the write.<\/p>\n<p style=\"margin: 0 0 1rem\">The database records what was done. The procedure records what was owed.<\/p>\n<p style=\"margin: 0 0 1rem\"><strong>Grade the touch. Then grade the look.<\/strong><\/p>\n<h2 id=\"sources\" style=\"font-size: 1.28rem;line-height: 1.35;margin: 2.5rem 0 .7rem;font-weight: 700;color: #0b0b0b\">Sources<\/h2>\n<ol class=\"refs\" style=\"font-size: .9rem;color: #52514e\"> <li id=\"ref-1\" style=\"margin: 0 0 .55rem\">Krishanu Adhikary and Prashant Devadiga, <a href=\"https:\/\/arxiv.org\/abs\/2610.30161\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">\u201cTauIndianBankBench: Procedure-Aware, Action-Oriented Evaluation of Tool-Using Conversational Agents\u201d<\/a>, arXiv:2610.30161, 30 September 2026 (<a href=\"https:\/\/arxiv.org\/html\/2610.30161v1\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">full text<\/a>). Figures used here: Tables 1, 2, 10, 13 and 14; \u00a73.2 (scoring and write purity); \u00a74 (simulated customer); \u00a75.7 (trivial agents); Appendix F (judge agreement); Limitations. Code at github.com\/npci\/TauIndianBankBench.<\/li> <li id=\"ref-2\" style=\"margin: 0 0 .55rem\">Shunyu Yao, Noah Shinn, Pedram Razavi and Karthik Narasimhan, <a href=\"https:\/\/arxiv.org\/abs\/2406.12045\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">\u201c\u03c4-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains\u201d<\/a>, ICLR 2025; and Victor Barres, Honghua Dong, Soham Ray, Xujie Si and Karthik Narasimhan, <a href=\"https:\/\/arxiv.org\/abs\/2506.07982\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">\u201c\u03c4\u00b2-Bench: Evaluating Conversational Agents in a Dual-Control Environment\u201d<\/a>, ICML 2026.<\/li> <li id=\"ref-3\" style=\"margin: 0 0 .55rem\">Reserve Bank of India, <a href=\"https:\/\/www.rbi.org.in\/Scripts\/BS_ViewMasDirections.aspx?id=13157\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">Reserve Bank of India (Commercial Banks \u2013 Interest Rate on Deposits) Directions, 2025<\/a>, updated 1 October 2026, paragraphs 11 and 22\u201323 (premature-withdrawal interest, penalty policy and disclosure at acceptance).<\/li> <li id=\"ref-4\" style=\"margin: 0 0 .55rem\">State Bank of India, <a href=\"https:\/\/sbi.bank.in\/web\/yono\/loan-against-fixed-deposit\" rel=\"noopener\" style=\"color: #2a78d6;text-decoration: underline\" target=\"_blank\">Loan against Fixed Deposit<\/a>, maximum overdraft of 90% of FD value on YONO. This supports the illustrative borrowing limit, not the assumed interest rate or Mr Deshmukh&#8217;s eligibility.<\/li> <\/ol>\n<hr \/>\n<p class=\"refs\" style=\"margin: 0 0 1rem;font-size: .9rem;color: #52514e\"><em>Research checked 3 November 2026. Mr Deshmukh, the Nagpur scene, the deposit, the rates (7.3% contracted, 6.0% card rate for the period run, a one-point penalty, 8.3% overdraft) and the resulting amounts are illustrative and computed with simple interest for clarity; real banks&#8217; rates, penalties, waivers and compounding differ. Asha Kulkarni is a composite character from an earlier Perit essay. All benchmark results are author-reported on synthetic data with a simulated customer and were not reproduced by Perit. No Perit measurements are reported in this post.<\/em><\/p>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.<\/p>\n","protected":false},"author":2,"featured_media":1108,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22,19],"tags":[],"class_list":["post-1114","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-research"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Banking AI Agents Skip Required Steps. Final-State Checks Miss It<\/title>\n<meta name=\"description\" content=\"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Banking AI Agents Skip Required Steps. Final-State Checks Miss It\" \/>\n<meta property=\"og:description\" content=\"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/\" \/>\n<meta property=\"og:site_name\" content=\"Perit Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-03T14:49:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"2400\" \/>\n\t<meta property=\"og:image:height\" content=\"1260\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Pratyaksh@Perit\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@baldwin_IVth\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Pratyaksh@Perit\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"20 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/\"},\"author\":{\"name\":\"Pratyaksh@Perit\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/#\\\/schema\\\/person\\\/6b951f8ca802e00473088655d8a2a1bc\"},\"headline\":\"The Database Agreed. Nobody Told Him the Penalty.\",\"datePublished\":\"2026-11-03T14:49:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/\"},\"wordCount\":3999,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/banking-agent-procedure-final-state-check.webp\",\"articleSection\":[\"Artificial Intelligence\",\"Research\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/\",\"url\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/\",\"name\":\"Banking AI Agents Skip Required Steps. Final-State Checks Miss It\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/banking-agent-procedure-final-state-check.webp\",\"datePublished\":\"2026-11-03T14:49:45+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/#\\\/schema\\\/person\\\/6b951f8ca802e00473088655d8a2a1bc\"},\"description\":\"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#primaryimage\",\"url\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/banking-agent-procedure-final-state-check.webp\",\"contentUrl\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/banking-agent-procedure-final-state-check.webp\",\"width\":2400,\"height\":1260,\"caption\":\"A banking AI session log skips the closure quote but receives a green final-state check pass. The database agreed. Nobody told him.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/banking-agent-procedure-final-state-check\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Database Agreed. Nobody Told Him the Penalty.\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/#website\",\"url\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/\",\"name\":\"Perit Blog\",\"description\":\"Frontier training data, collected and graded by people who do the work.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/#\\\/schema\\\/person\\\/6b951f8ca802e00473088655d8a2a1bc\",\"name\":\"Pratyaksh@Perit\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/pfp-150x150.webp\",\"url\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/pfp-150x150.webp\",\"contentUrl\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/pfp-150x150.webp\",\"caption\":\"Pratyaksh@Perit\"},\"sameAs\":[\"http:\\\/\\\/perit.ai\\\/blogs\",\"https:\\\/\\\/x.com\\\/baldwin_IVth\"],\"url\":\"https:\\\/\\\/perit.ai\\\/blogs\\\/author\\\/pratyakshpatel\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Banking AI Agents Skip Required Steps. Final-State Checks Miss It","description":"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/","og_locale":"en_US","og_type":"article","og_title":"Banking AI Agents Skip Required Steps. Final-State Checks Miss It","og_description":"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.","og_url":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/","og_site_name":"Perit Blog","article_published_time":"2026-11-03T14:49:45+00:00","og_image":[{"width":2400,"height":1260,"url":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp","type":"image\/webp"}],"author":"Pratyaksh@Perit","twitter_card":"summary_large_image","twitter_creator":"@baldwin_IVth","twitter_misc":{"Written by":"Pratyaksh@Perit","Est. reading time":"20 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#article","isPartOf":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/"},"author":{"name":"Pratyaksh@Perit","@id":"https:\/\/perit.ai\/blogs\/#\/schema\/person\/6b951f8ca802e00473088655d8a2a1bc"},"headline":"The Database Agreed. Nobody Told Him the Penalty.","datePublished":"2026-11-03T14:49:45+00:00","mainEntityOfPage":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/"},"wordCount":3999,"commentCount":0,"image":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#primaryimage"},"thumbnailUrl":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp","articleSection":["Artificial Intelligence","Research"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/","url":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/","name":"Banking AI Agents Skip Required Steps. Final-State Checks Miss It","isPartOf":{"@id":"https:\/\/perit.ai\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#primaryimage"},"image":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#primaryimage"},"thumbnailUrl":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp","datePublished":"2026-11-03T14:49:45+00:00","author":{"@id":"https:\/\/perit.ai\/blogs\/#\/schema\/person\/6b951f8ca802e00473088655d8a2a1bc"},"description":"A banking AI closes a deposit correctly but never tells the customer the penalty. Why final-state grading misses required steps that change nothing.","breadcrumb":{"@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#primaryimage","url":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp","contentUrl":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/11\/banking-agent-procedure-final-state-check.webp","width":2400,"height":1260,"caption":"A banking AI session log skips the closure quote but receives a green final-state check pass. The database agreed. Nobody told him."},{"@type":"BreadcrumbList","@id":"https:\/\/perit.ai\/blogs\/banking-agent-procedure-final-state-check\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/perit.ai\/blogs\/"},{"@type":"ListItem","position":2,"name":"The Database Agreed. Nobody Told Him the Penalty."}]},{"@type":"WebSite","@id":"https:\/\/perit.ai\/blogs\/#website","url":"https:\/\/perit.ai\/blogs\/","name":"Perit Blog","description":"Frontier training data, collected and graded by people who do the work.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/perit.ai\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/perit.ai\/blogs\/#\/schema\/person\/6b951f8ca802e00473088655d8a2a1bc","name":"Pratyaksh@Perit","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/09\/pfp-150x150.webp","url":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/09\/pfp-150x150.webp","contentUrl":"https:\/\/perit.ai\/blogs\/wp-content\/uploads\/2026\/09\/pfp-150x150.webp","caption":"Pratyaksh@Perit"},"sameAs":["http:\/\/perit.ai\/blogs","https:\/\/x.com\/baldwin_IVth"],"url":"https:\/\/perit.ai\/blogs\/author\/pratyakshpatel\/"}]}},"_links":{"self":[{"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/posts\/1114","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/comments?post=1114"}],"version-history":[{"count":2,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/posts\/1114\/revisions"}],"predecessor-version":[{"id":1116,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/posts\/1114\/revisions\/1116"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/media\/1108"}],"wp:attachment":[{"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/media?parent=1114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/categories?post=1114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/perit.ai\/blogs\/wp-json\/wp\/v2\/tags?post=1114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}