Skip to content

    Forward Deployed Engineer

    Blank-Page AI Design Defense on an Unseen Brief

    Practise a timed 30-minute AI design from an unseen business brief, score it with a seven-criterion rubric, then compare it with a scored model answer.

    By Published 8 min read

    • fde
    • solution-architect
    • design-defense
    • rubric
    • timed-practice
    • mastery
    Share

    This lesson is part of AI Solution Architect: Estimate, Propose and Defend. Enroll for free, then sign in, to read it in full.

    What you'll learn: how to produce and defend an AI design from an unseen brief in 30 minutes, how a seven-criterion rubric scores it (0 to 2 each, 14 in total, pass at 10), and how to read a scored model answer.

    At a glance

    Figure 1. The timed defense: four boxes, then a score

    flowchart LR accTitle: The timed blank-page defense accDescr: Five minutes to frame the problem, fifteen minutes to design with patterns and architecture, five minutes for risks and evaluation, five minutes to defend the decision aloud, then scoring against the seven-criterion rubric. A["0 to 5 min: frame outcome, users, data, scope"] --> B["5 to 20 min: design patterns, flow, failure path, human step"] B --> C["20 to 25 min: threats, test set, rough cost"] C --> D["25 to 30 min: defend decision, concede one weakness"] D --> E["Score with the rubric"]

    How to read this: the clock runs across all four boxes; scoring comes after.

    • One unseen brief, 30 minutes: 5 frame, 15 design, 5 risks and evaluation, 5 defend.
    • Seven criteria, 0 to 2 each, 14 in total; 10 passes.
    • Attempt first, then open the model answer.

    Scenario

    Composite scenario, not a real company. Cedar Row Facilities is a facilities-services firm with 1,200 active contracts and 40 account managers (illustrative numbers).

    Contracts are PDFs: three templates plus customer edits, about 15 percent scanned, amendments filed separately. Renewal dates and penalty clauses (a notice period before automatic renewal, a charge for early termination) sit in each manager's spreadsheet, and some renewals are noticed late. The firm wants an assistant that reads contracts, flags both, and drafts reminder emails a human approves. No legal advice.

    What you will be able to do

    • Produce a defensible design from an unseen brief in 30 minutes.
    • Score your own design against seven criteria and say where you lost points.
    • Defend one decision aloud and concede one weakness.

    Prerequisites

    Core ideas

    The rubric

    Criterion Weak (0) Acceptable (1) Strong (2)
    Requirements quality Starts drawing; no measure of success Users, data, one outcome, partly unmeasurable Measurable outcome, baseline to collect, constraints, out of scope, questions asked
    Pattern choice One pattern for everything A fitting pattern, no alternative Pattern follows the requirement; one alternative discarded with a reason
    Architecture soundness Boxes without flow or boundaries Components and flow; no failure path or trust boundary Flow, failure path and trust boundary drawn, plus the human step where the design acts
    Risk and security None, or "secure it" Two or three generic threats Threats tied to this design, each with a control; outbound actions need approval
    Evaluation plan "Test it" Metrics, no labelled set Labelled set and its mix, metrics, failure cases, how the outcome is measured
    Cost awareness None Says cost matters Volume times tokens, labelled placeholder prices, biggest driver, human time
    Communication No order, jargon Ordered, no clear decision Decision first, plain words, one weakness conceded

    How the steps feed the rubric

    Figure 2. Which design step earns which criterion

    flowchart LR accTitle: Design steps and rubric criteria accDescr: Steps one and two feed requirements quality. Step three feeds pattern choice. Step four feeds architecture soundness. Step six feeds risk and security. Step five feeds both the evaluation plan and cost awareness. Step seven and the defend phase feed communication. S12["Steps 1 and 2: frame, requirements"] --> R1["Requirements quality"] S3["Step 3: patterns"] --> R2["Pattern choice"] S4["Step 4: architecture"] --> R3["Architecture soundness"] S6["Step 6: threat model"] --> R4["Risk and security"] S5["Step 5: evaluation and budgets"] --> R5["Evaluation plan"] S5 --> R6["Cost awareness"] S7["Step 7 and the defend box"] --> R7["Communication"]

    How to read this: skipping a step leaves its criterion at 0.

    What the score means

    Pass is 10 of 14. Fix any 0 first: a 0 on risk and security means not ready to ship, whatever the total. The score measures one exercise, not an interview or job outcome.

    It can give practitioner-level ability to design, build and defend an enterprise AI solution from a blank page, with a path to deepen it through real projects. The next lesson is that path.

    Worked example

    Attempt the brief first, then open the model answer.

    Open after your attempt: the model answer and its score

    Frame. Outcome: no renewal notice deadline is missed. Baseline to collect: late renewals in 12 months, minutes to find a date. Users: 40 account managers, a legal reviewer. Data: 1,200 PDFs (about 180 scans) and amendments. Out of scope: legal advice, automatic sending.

    Design. A document-processing pipeline: structured extraction, a human review queue, and code for date arithmetic (renewal date minus notice period gives the deadline). The model only extracts fields and drafts text. Discarded: a chat agent over all contracts (no stored deadlines, no per-field accuracy) and automatic sending (no human check).

    Figure 3. Model answer: contract pipeline with human confirmation

    Contract renewal assistant: model answerDocument store to Worker (PDFs); Worker to Orchestrator (text); Orchestrator to Model gateway (extract); Model gateway to LLM provider (request); Orchestrator to Review queue (fields); Worker to Review queue (unreadable); Review queue to Contract records (confirmed); Contract records to Approval service (due); Approval service to Account manager (approved)OUTSIDE OUR CONTROLDocument store: contract PDFsDocument storecontract PDFsWorker: OCR, split pagesWorkerOCR, split pagesOrchestrator: validate, deadlinesOrchestratorvalidate,deadlinesModel gateway: schema, loggingModel gatewayschema, loggingLLM provider: extract, draftLLM providerextract, draftReview queue: human confirmsReview queuehuman confirmsContract records: confirmed fieldsContractrecordsconfirmed fieldsApproval service: draft needs OKApprovalservicedraft needs OKAccount manager: sends the emailAccountmanagersends the emailPDFstextextractrequestfieldsunreadableconfirmeddueapproved

    How to read this: the model sits at one edge, outside our control, and never sends anything; every field and every email passes a person, and an unreadable scan goes straight to review.

    Risks. Contract text saying "ignore your instructions": the model has no tools and its output must match a schema. A silently wrong date: a person confirms each extraction against the source page. An overriding amendment: linked to its contract, flagged on conflict. A wrong recipient: a human approves each draft.

    Evaluation and cost. A golden set of 100 contracts across templates, scans and amendments, labelled by two people. Metrics: date and notice-period exact match, penalty-clause recall, false-flag rate. Cost at placeholder prices of 1.00 in and 5.00 out per million tokens: the first load is 1,200 x 12,000 = 14,400,000 tokens in and 1,200 x 600 = 720,000 out, so 14.40 + 3.60 = 18.00. Monthly: 60 new contracts 0.90, and 40 reminder drafts at 2,000 in and 300 out each, 0.14 (OCR priced separately). Human time dominates: confirming 1,200 contracts at 2 minutes is 40 hours once, then about 2 hours a month.

    Defend. "A pipeline with human confirmation, not a chat agent: the business needs stored, checkable deadlines. Weakness: scanned contracts are unproven, so all 180 are checked by hand before any reminder goes out."

    Criterion Score Why
    Requirements quality 1 Measure, baseline, scope; no questions put to the customer
    Pattern choice 2 Two alternatives discarded
    Architecture soundness 2 Flow, failure path, boundary, review and approval
    Risk and security 2 Four threats, each with a control
    Evaluation plan 1 No failure-case review; no stated way to measure late renewals after launch
    Cost awareness 2 Computed, human time counted
    Communication 2 Decision first, plain words, weakness conceded
    Total 12 of 14 Pass

    Assumptions: all volumes, token counts, times and prices are illustrative; insert the provider's current published price and its date.

    Practice task

    Run the timed attempt on the Cedar Row brief, or on a colleague's brief if you have seen the model answer.

    1. Work 30 minutes on paper, no notes: frame 5, design 15, risks and evaluation 5, defend aloud 5 (record it).
    2. After a break, score each criterion 0, 1 or 2 from your page and the recording.
    3. Open the model answer, compare criterion by criterion and note your lowest.

    In the interview: "Here is a problem you have not seen; take 30 minutes." Strong: ask how success is measured before drawing; end by naming what you are least sure of.

    Score it (interactive when JavaScript is on)

    A design names date exact match as a metric but has no labelled set. Evaluation plan score?

    • 0
    • 1
    • 2
    Answer

    1. Metrics without a labelled set is the acceptable row.

    A design uses a chat agent over all contracts. What lifts pattern choice to 2?

    • Follow the requirement; discard one alternative with a reason
    • Add more tools
    • Use three patterns
    Answer

    Follow the requirement; discard one alternative with a reason. Strong means the pattern follows the requirement.

    A cost line says only that cost matters. What lifts it to 2?

    • A safety margin on tokens
    • The cheapest model's price
    • Volume times tokens at placeholder prices, the biggest driver, human time
    Answer

    Volume times tokens at placeholder prices, the biggest driver, human time. Strong names the driver; here human confirmation dwarfs the tokens.

    Exercise

    Explain it back. In three sentences, explain the rubric to a colleague who will score your next attempt: what it measures, what a 0 and a 2 look like on one criterion, and what pass means.

    Acceptance criteria: the seven criteria, one criterion with concrete weak and strong behaviours, and the pass mark. Done when two people score the same design within two points.

    Hint 1: where scorers disagree

    Scorers differ most between 1 and 2. Write the observable behaviour that separates them.

    Hint 2: make it observable

    Replace "good" with something countable, such as "names a baseline to collect".

    Common mistakes

    • Drawing at once, with no measure of success.
    • Choosing an agent with no alternative discarded.
    • Writing "test it" instead of a labelled set and metrics.

    Knowledge check

    1. Why do the first five minutes go to framing and not drawing?

    Without a measurable outcome, users and constraints, every later choice is a guess you cannot defend. The frame also gives you questions for the customer.

    2. A design scores 10 in total but 0 on risk and security. Does it pass?

    Not by this rubric: a 0 on risk and security means not ready to ship, whatever the total. A high total can hide a missing threat model.

    3. The model answer names metrics and a golden set but scores 1 on evaluation. Why?

    It does not say how failures on the set would be reviewed, or how late renewals would be measured after launch, so nobody can show the outcome improved.

    4. Why must the assistant not send the reminder emails itself?

    An email is an outbound action the customer sees and cannot recall. A person approves each draft, so a wrong date or recipient is caught first.

    5. Monthly model cost is about 1.04 at placeholder prices. Can you skip cost awareness?

    No. Human confirmation is 40 hours once and about 2 hours a month, which dwarfs the tokens. Cost awareness means finding the real driver.

    You can now

    • Add a blank-page design on an unseen brief to your design pack.
    • Run a 30-minute design in four timed boxes.
    • Score a design on seven criteria and find the lowest.
    • Defend one decision and concede one weakness.

    Further reading

    Last verified: 2026-11-03

    Next

    Continue with Your 90-day mastery path, which turns your lowest criterion into a practice plan.

    Enroll to keep reading

    Lesson 9 of 15 · AI Solution Architect: Estimate, Propose and Defend

    Practise a timed 30-minute AI design from an unseen business brief, score it with a seven-criterion rubric, then compare it with a scored model answer.

    In the rest of this lesson

    • Practice task
    • Exercise
    • Common mistakes
    • Knowledge check
    • You can now
    • Further reading

    Enrolling is free. It unlocks every lesson in AI Solution Architect: Estimate, Propose and Defend, tracks your progress across devices and keeps your quiz scores. The newsletter is optional.

    Ask about this article

    Get answers grounded in this post. AI-generated — based on this article, and may be imperfect.

    Scaled AI Weekly

    Enjoyed this? Get more like it every Monday.

    Real architecture decisions, LLMOps patterns that survive production, and engineering leadership advice — from 12+ years of building at enterprise scale. Free. No spam. Unsubscribe anytime.

    Get new articles by email

    Free. We email a confirmation link first, and you can unsubscribe from any email.

    Join engineers building production AI systems

    Comments