Skip to content

    Forward Deployed Engineer

    AI POC Design and Handling Objections

    Design a proof of concept for the Order and Policy Assistant with written success and exit criteria and a timebox, then answer four customer objections.

    By Published 5 min read

    • fde
    • solution-architect
    • pre-sales
    • poc
    • objections
    • stakeholders
    Share

    This lesson is part of AI Solution Architect: Estimate, Propose and Defend. Enroll for free, then sign in, to read it in full.

    What you'll learn: how to design a proof of concept (POC) that can end cleanly, with written success and exit criteria and a timebox, how to answer four objections with evidence, and how to settle a stakeholder conflict.

    At a glance

    Figure 1. A three-week POC with a gate at the end

    flowchart LR accTitle: A three week proof of concept plan accDescr: Week one agrees the question and written criteria, gathers documents and measures a baseline. Week two builds a thin read-only slice. Week three measures against the criteria and reports. The gate then gives go, stop with a report, or one extension with new criteria. A["Week 1: written criteria, documents, baseline"] --> C["Week 2: thin read-only slice"] C --> D["Week 3: measure and report"] D --> G{"Gate"} G -->|"criteria met"| GO["Go to pilot"] G -->|"missed"| ST["Stop with a report"] G -->|"close, one time only"| EX["One extension, new written criteria"]

    How to read this: criteria are written before any build starts, and the numbers decide the gate.

    • One question, the riskiest part.
    • Criteria are signed first.
    • The timebox ends it.

    Scenario

    Composite scenario, not a real company. Lumen Industrial Supply, a fictional distributor of industrial equipment, has approved a three-week POC of its Order and Policy Assistant, tested by six of its 24 customer-operations agents (all numbers illustrative). A team lead wants real orders from the live order management system (OMS). The IT security lead wants test data only until a review ends.

    What you will be able to do

    • Write a one-page POC plan with criteria and a timebox.
    • Choose go, stop or one extension from measured results.
    • Answer four objections with evidence.

    Prerequisites

    Core ideas

    What a POC plan contains

    Element Order and Policy Assistant (illustrative)
    Question Does it give correct, cited order and policy answers on Lumen's 62 documents and a test copy of the OMS?
    Success The acceptance criteria (AC) of the minimum viable product (MVP), run on the same 40-question test set (30 answerable, 10 unsupported): at least 27 of 30 answerable questions right, citing policy id and version, with 0 high-severity errors (a superseded or invented rule) (AC-1); all 9 version traps from the current version (AC-2); all 10 unsupported questions declined (AC-3); a held order reported as held (AC-4, P-HLD-05); the address rule applied (AC-5); 0 OMS write calls (AC-6). Also: no customer personal data in logs; median at or below 7 minutes against 9; model cost per contact at or below 0.0064 (placeholder EUR: 0.00495 times 1.3)
    Exit Stop if a superseded-version answer survives one fix round. Pause if OMS test access is late after week 1
    Timebox Three weeks; one extension at most
    Data and users 62 documents; policy owner as data owner; six agents timing 4 contacts each (24 timings, like the baseline)

    The POC allows 7 minutes, not the pilot's 6: six agents are new to the tool and 24 timings show direction only.

    Four objections

    Objection Evidence-based response
    "It will leak data." Each agent's own sign-in through the gateway; logs without personal data. Where the hosted model processes data is open with the IT security lead (threat modelling)
    "It will give wrong answers." Test-set results, refusal rate, the old 14-day return rule tested, a citation to check
    "We will be locked in." The model gateway keeps the provider swappable; Lumen owns the policy text and the 40-question test set
    "Agents will not use it." Six agents' timings, how often they overrode an answer, visible sources

    At the customer: "How do you know it works?" is an objection in disguise: name the test set, the pass rate and the failures found.

    Figure 2. A mid-POC request becomes a change request

    sequenceDiagram accTitle: A mid-POC request becomes a change request accDescr: A team lead asks the Forward Deployed Engineer to use live orders. The engineer logs a change request and the architect states its effect on timebox, data and risk. The Head of Customer Operations receives options and decides. The decision is recorded against the criteria. participant T as Team lead participant F as Forward Deployed Engineer participant A as Architect participant H as Head of Customer Operations T->>F: Asks to use live orders F->>A: Change request logged A->>A: Effect on timebox, data, risk A->>H: Options with effects, security view attached H-->>A: Decision A->>F: Update criteria or park the request

    How to read this: the sponsor decides from options that show the effects.

    Worked example

    Decision exercise. In week 2 the team lead asks for live orders; the IT security lead says test data only. Choose: (A) switch quietly; (B) refuse both; (C) log a change request with the effects and let the Head of Customer Operations decide.

    Model answer

    Option C. A changes what the POC measures and breaks a security rule; B ignores a real wish. With C both risks are priced.

    Practice task

    Add the POC plan to your design pack: question, three numbered success criteria, two exit criteria, timebox, data owner, users, the gate rule, and one sentence per objection.

    At the gate and in the room (interactive when JavaScript is on)

    Results are close but short at the gate. No extension used yet.

    • Stop with a report
    • One extension, new written criteria
    • Lower the criteria to fit
    Answer

    One extension, new written criteria. Close, one time only. Lowering criteria makes the gate an opinion.

    A superseded-version answer survives one fix round.

    • Stop with a report
    • Run another fix round
    • Extend the timebox a week
    Answer

    Stop with a report. That is the exit criterion. More rounds become "one more week".

    They say it will give wrong answers. What do you bring?

    • A polished demo
    • The vendor's accuracy claim
    • Test-set results, refusal rate, the 14-day rule tested
    Answer

    Test-set results, refusal rate, the 14-day rule tested. A demo is one chosen path.

    Exercise

    Explain it back. Tell a sceptical vice president in three sentences why the POC has exit criteria and a fixed end. A good answer says what is avoided, what happens at the gate, and gives one number.

    Done when an outsider can see if it is on track.

    Hint 1: criteria

    Start from the proposal's promises.

    Hint 2: the ending

    Write the stop outcome first.

    Common mistakes

    • No exit criteria, so every result ends in "one more week".
    • Criteria written after the results.
    • Measuring a demo script, not a test set.

    Knowledge check

    1. Why write success criteria before building anything?

    Criteria written afterwards can be shaped to fit the results. Signed first, they make the gate a measurement.

    2. How does an exit criterion differ from a success criterion?

    Success says which result means go. Exit says what ends or pauses the POC early.

    3. The OMS test access arrives a week late. Is the POC failed?

    No. A late delivery is a failed assumption, not a failed idea. Pause the timebox and keep the criteria unchanged.

    4. How do you answer "we will be locked in"?

    Point to what Lumen owns: policy text, test set and gateway code. Then score an alternative on the same 40-question test set.

    5. Why take options, not a complaint, to the sponsor?

    The sponsor owns the trade-off between scope, time and risk. Options let them decide.

    You can now

    • Add the POC plan to your design pack.
    • Write success criteria, exit criteria and a timebox.
    • Choose go, stop or one extension from results.

    Further reading

    Last verified: 2026-11-03

    Next

    Architecture review board simulation

    Enroll to keep reading

    Lesson 6 of 15 · AI Solution Architect: Estimate, Propose and Defend

    Design a proof of concept for the Order and Policy Assistant with written success and exit criteria and a timebox, then answer four customer objections.

    In the rest of this lesson

    • Practice task
    • Exercise
    • Common mistakes
    • Knowledge check
    • You can now
    • Further reading

    Enrolling is free. It unlocks every lesson in AI Solution Architect: Estimate, Propose and Defend, tracks your progress across devices and keeps your quiz scores. The newsletter is optional.

    Ask about this article

    Get answers grounded in this post. AI-generated — based on this article, and may be imperfect.

    Scaled AI Weekly

    Enjoyed this? Get more like it every Monday.

    Real architecture decisions, LLMOps patterns that survive production, and engineering leadership advice — from 12+ years of building at enterprise scale. Free. No spam. Unsubscribe anytime.

    Get new articles by email

    Free. We email a confirmation link first, and you can unsubscribe from any email.

    Join engineers building production AI systems

    Comments