Website proposals → decision brief
Can AI normalize two differently structured vendor proposals, surface material gaps, and preserve uncertainty without manufacturing an apples-to-apples winner?
Reject for this workflow
Trial 1 scored 100/100 with no hard fail, but Trials 2 and 3 each scored 75/100 and hard-failed by inferring that editor access proves staff can edit both text and photos. Under the precommitted rule, any hard fail rejects the workflow even though the median score was 75, not below 75.
--- BUYER BRIEF --- Lakeview Home Organizing is a synthetic eight-person service business replacing its public website. Must-haves: - Home, Services, About, Gallery, and Contact pages - Embed the company’s existing Jobber request form - Staff can update text and photos - Setup plus mandatory charges for the first 12 months after launch must stay at or below $7,000 before tax, excluding the existing Jobber subscription and domain registration Preferences: - Go live within six weeks of vendor selection - Own and be able to move the final website and content - Keep ongoing costs predictable The owner has not assigned weights to the preferences. --- PROPOSAL A --- Northline Web Co. — Custom Website Project Project fee: $6,400 fixed Scope: - Discovery call and sitemap - Custom visual design - Five pages: Home, Services, About, Gallery, and Contact - Migration of client-supplied final copy and images for those five pages - Embed the client’s existing Jobber request form - Responsive implementation - Google Analytics 4 installation - Page titles, meta descriptions, and XML sitemap - Content-management-system editor access - One 60-minute staff training session - Two consolidated design revision rounds - One pre-launch quality-assurance round Schedule: Delivery is estimated at six weeks from kickoff. Scheduling begins after Northline receives the signed agreement and kickoff payment. The estimate assumes consolidated client feedback within two business days of each review request. Payment: - 40% at signing - 40% at design approval - 20% before launch Hosting and support: Managed hosting is included for the first 12 months after launch. It renews month-to-month at $30 per month after that. Northline will correct implementation defects reported within 30 calendar days after launch. Later content-update assistance is available at $140 per hour. Ownership: After final payment, Northline transfers the final custom design, site files, and approved site content to the client. Third-party software licenses, if any are later requested and approved, are not included in the project fee and may not be transferable. Exclusions: Copywriting, photography, logo work, domain registration, the Jobber subscription, custom Jobber or API integration, legal-policy drafting, ongoing SEO, and a formal accessibility audit. --- PROPOSAL B --- Spruce Digital — Website Launch + Care Plan Setup fee: $4,200 Required care plan: $195 per month for 12 months beginning on the launch date. The first charge is made at launch, followed by 11 monthly charges. Scope: - Adaptation of a Spruce website template - Seven pages: Home, Services, About, Process, Gallery, FAQ, and Contact - Up to 1,500 words of draft website copy based on a client questionnaire - Client-supplied photos - Embed the client’s existing Jobber request form; no custom data synchronization - Responsive implementation - Basic page metadata and XML sitemap - An analytics dashboard - Editor access - One recorded 45-minute handoff session Schedule: Delivery is estimated at four to five weeks after Spruce receives the completed questionnaire, brand assets, client photos, and cleared first setup installment. Payment: - 50% of the setup fee at signing - 50% of the setup fee at launch - Care-plan payments billed monthly beginning at launch Care plan: The care plan includes hosting, security updates, daily backups, and up to 60 minutes of content changes per month. Unused time does not roll over. Other work is billed at $125 per hour. Spruce targets a response within two business days for support requests submitted Monday through Friday. The care plan may be cancelled during its initial 12-month term by paying 50% of the remaining monthly payments. After the initial term, it continues month-to-month at $195 per month. Spruce may change that rate with 30 days’ notice. Ownership: The client owns final approved copy and client-supplied photos. Spruce retains its template, design system, software configuration, and source repository. At termination, Spruce will provide an export of the current page copy and uploaded images on request. The template license and source repository are not transferred. Exclusions: Domain registration, the Jobber subscription, custom Jobber integration, photography, logo work, legal-policy drafting, and a formal accessibility audit.
You are preparing an audit-friendly vendor comparison for a small service-business owner. Use only the Buyer Brief and Proposal A and Proposal B below. Do not use outside knowledge. Rules: 1. Never invent, estimate, or silently fill in a price, feature, deadline, obligation, ownership right, service level, revision allowance, cancellation term, or other missing term. 2. If a proposal does not state something, write "Not stated." Absence does not mean no, zero, included, excluded, free, unlimited, or equivalent. 3. Preserve every condition attached to a price or timeline. Do not compare durations without retaining their different starting triggers. 4. Keep one-time fees, mandatory recurring fees, optional fees, and hourly rates separate. 5. You may perform arithmetic only from stated figures. Label calculated values "Calculated," show the formula, and state what is excluded. 6. Do not treat an embedded Jobber form as custom integration or data synchronization. 7. Do not treat a support response target as a resolution guarantee or uptime commitment. 8. Distinguish ownership of copy and images from ownership or portability of the full website, template, configuration, and source files. 9. Do not create a weighted score or overall winner because the buyer has not supplied preference weights. 10. Separate sourced facts, calculations, judgment, and clarification questions. Return these sections: A. REQUIREMENTS CHECK A table with: - Buyer requirement or preference - Proposal A evidence - Proposal B evidence - Status for each vendor: Meets, Does not meet, or Unclear - Short supporting source phrase B. NORMALIZED COMMERCIAL TERMS Show: - Setup fee - Mandatory recurring charges - Calculated first-12-month cost - Renewal cost after month 12 - Optional or out-of-scope rates - Payment schedule - Cancellation terms - Any commercial term that remains unknown C. MATERIAL SCOPE AND SERVICE DIFFERENCES List only decision-relevant differences. Do not label a difference better or worse without explaining the buyer preference that would make it so. D. RISKS AND UNKNOWNS Separate vendor-specific unknowns from risks directly supported by stated terms. E. CONDITIONAL DECISION GUIDE Give no more than three "Choose A if..." or "Choose B if..." statements. If the evidence does not support an overall winner, say so directly. F. CLARIFICATION QUESTIONS Give the five highest-value questions, addressed to the appropriate vendor. G. CONFIDENCE AND REVIEW State what the comparison can establish, what it cannot establish, and what a human should verify before signing. Keep the answer under 1,000 words. --- BUYER BRIEF --- Lakeview Home Organizing is a synthetic eight-person service business replacing its public website. Must-haves: - Home, Services, About, Gallery, and Contact pages - Embed the company’s existing Jobber request form - Staff can update text and photos - Setup plus mandatory charges for the first 12 months after launch must stay at or below $7,000 before tax, excluding the existing Jobber subscription and domain registration Preferences: - Go live within six weeks of vendor selection - Own and be able to move the final website and content - Keep ongoing costs predictable The owner has not assigned weights to the preferences. --- PROPOSAL A --- Northline Web Co. — Custom Website Project Project fee: $6,400 fixed Scope: - Discovery call and sitemap - Custom visual design - Five pages: Home, Services, About, Gallery, and Contact - Migration of client-supplied final copy and images for those five pages - Embed the client’s existing Jobber request form - Responsive implementation - Google Analytics 4 installation - Page titles, meta descriptions, and XML sitemap - Content-management-system editor access - One 60-minute staff training session - Two consolidated design revision rounds - One pre-launch quality-assurance round Schedule: Delivery is estimated at six weeks from kickoff. Scheduling begins after Northline receives the signed agreement and kickoff payment. The estimate assumes consolidated client feedback within two business days of each review request. Payment: - 40% at signing - 40% at design approval - 20% before launch Hosting and support: Managed hosting is included for the first 12 months after launch. It renews month-to-month at $30 per month after that. Northline will correct implementation defects reported within 30 calendar days after launch. Later content-update assistance is available at $140 per hour. Ownership: After final payment, Northline transfers the final custom design, site files, and approved site content to the client. Third-party software licenses, if any are later requested and approved, are not included in the project fee and may not be transferable. Exclusions: Copywriting, photography, logo work, domain registration, the Jobber subscription, custom Jobber or API integration, legal-policy drafting, ongoing SEO, and a formal accessibility audit. --- PROPOSAL B --- Spruce Digital — Website Launch + Care Plan Setup fee: $4,200 Required care plan: $195 per month for 12 months beginning on the launch date. The first charge is made at launch, followed by 11 monthly charges. Scope: - Adaptation of a Spruce website template - Seven pages: Home, Services, About, Process, Gallery, FAQ, and Contact - Up to 1,500 words of draft website copy based on a client questionnaire - Client-supplied photos - Embed the client’s existing Jobber request form; no custom data synchronization - Responsive implementation - Basic page metadata and XML sitemap - An analytics dashboard - Editor access - One recorded 45-minute handoff session Schedule: Delivery is estimated at four to five weeks after Spruce receives the completed questionnaire, brand assets, client photos, and cleared first setup installment. Payment: - 50% of the setup fee at signing - 50% of the setup fee at launch - Care-plan payments billed monthly beginning at launch Care plan: The care plan includes hosting, security updates, daily backups, and up to 60 minutes of content changes per month. Unused time does not roll over. Other work is billed at $125 per hour. Spruce targets a response within two business days for support requests submitted Monday through Friday. The care plan may be cancelled during its initial 12-month term by paying 50% of the remaining monthly payments. After the initial term, it continues month-to-month at $195 per month. Spruce may change that rate with 30 days’ notice. Ownership: The client owns final approved copy and client-supplied photos. Spruce retains its template, design system, software configuration, and source repository. At termination, Spruce will provide an export of the current page copy and uploaded images on request. The template license and source repository are not transferred. Exclusions: Domain registration, the Jobber subscription, custom Jobber integration, photography, logo work, legal-policy drafting, and a formal accessibility audit.
Audit-friendly comparison
## A. REQUIREMENTS CHECK | Buyer requirement or preference | Proposal A evidence and status | Proposal B evidence and status | |---|---|---| | Five named pages | **Meets.** “Five pages: Home, Services, About, Gallery, and Contact.” | **Meets.** Seven pages include all five named pages. | | Existing Jobber request form | **Meets.** “Embed the client’s existing Jobber request form.” | **Meets.** Same embed; “no custom data synchronization.” | | Staff updates text and photos | **Unclear.** “Content-management-system editor access,” but editing capabilities are not stated. | **Unclear.** “Editor access,” but editing capabilities are not stated. | | First 12 months at or below $7,000 before tax | **Meets on stated mandatory fees.** $6,400 project fee; first-12-month hosting included. | **Meets on stated mandatory fees.** $4,200 setup plus 12 × $195 required care plan = $6,540. | | Live within six weeks of vendor selection | **Unclear.** “Six weeks from kickoff,” not selection, conditional on two-business-day feedback. | **Unclear.** “Four to five weeks after” receipt of named materials and cleared first installment, not selection. | | Own and move website and content | **Unclear.** After final payment A transfers “final custom design, site files, and approved site content,” but portability constraints are not fully stated. | **Does not meet as written for the full site.** Copy and client photos are exportable, but the “template, design system, software configuration, and source repository” are retained. | | Predictable ongoing costs | **Unclear.** Hosting renews month-to-month at $30; cancellation terms and future rate-change terms are not stated. | **Unclear.** $195 monthly after the initial term, but Spruce “may change that rate with 30 days’ notice.” | Neither offers custom Jobber integration; an embed is not data synchronization. ## B. NORMALIZED COMMERCIAL TERMS | Term | Proposal A | Proposal B | |---|---|---| | Setup fee | $6,400 fixed project fee | $4,200 | | Mandatory recurring charges | First 12 months’ hosting included; none separately stated then | $195/month for 12 months from launch | | First-12-month cost | **Calculated:** $6,400 + $0 stated hosting charge = **$6,400** | **Calculated:** $4,200 + (12 × $195) = **$6,540** | | Calculation exclusions | Tax, Jobber, domain, excluded work, approved third-party licenses | Tax, Jobber, domain, excluded and other work | | Renewal after month 12 | $30/month, month-to-month | $195/month, month-to-month; rate may change with 30 days’ notice | | Optional/out-of-scope rates | Later content updates: $140/hour; approved third-party license cost not stated | Other work: $125/hour | | Payment schedule | 40% signing; 40% design approval; 20% before launch | 50% setup at signing; 50% at launch; care plan monthly from launch | | Cancellation | **Not stated.** Refund terms are also not stated. | During initial term: 50% of remaining monthly payments; setup-fee refund terms are not stated. | ## C. MATERIAL SCOPE AND SERVICE DIFFERENCES - A provides a custom five-page site and transfers specified assets after final payment; B supplies seven template-based pages but retains the template, configuration, and repository. A favors stated control; B favors two extra pages over full-site portability. - A migrates client-supplied final copy and images. B drafts up to 1,500 words from a questionnaire and uses client photos. - A includes two design revision rounds, pre-launch QA, and 30 days of defect corrections. B’s revision allowance is **Not stated**; its plan includes hosting, security updates, daily backups, and 60 non-rolling content-change minutes monthly. - A installs Google Analytics 4. B supplies an analytics dashboard, but the analytics platform is **Not stated**. - A estimates six weeks from kickoff; B estimates four to five weeks after receiving the questionnaire, brand assets, photos, and cleared installment. The triggers differ. ## D. RISKS AND UNKNOWNS **Vendor-specific unknowns** - A: cancellation/refund terms, selection-to-kickoff time, ongoing response target, uptime commitment, and third-party-license portability effects are **Not stated**. - B: revision rounds, analytics platform, time until start conditions are met, resolution guarantee, uptime commitment, and setup-fee refund terms are **Not stated**. - Neither proposal confirms total elapsed time from vendor selection to launch. **Risks supported by stated terms** - A’s estimate depends on consolidated feedback within two business days, and the client must supply final copy and images. - B retains core assets, charges for initial-term cancellation, can change its renewal rate, and lets unused change time expire. - B’s two-business-day support target is a response target, not a resolution guarantee or uptime commitment. A states neither an ongoing response target nor an uptime commitment. ## E. CONDITIONAL DECISION GUIDE - Choose A if ownership/control of the specified custom design and files leads, subject to confirming portability. - Choose B if included copy drafting, two additional pages, and ongoing managed assistance matter more than transfer of the full site platform. - Choose A if the stated post-year hosting price matters most; choose B if the included monthly maintenance services justify its higher, changeable renewal price. The evidence does not support an overall winner without buyer preference weights and answers to the open questions. ## F. CLARIFICATION QUESTIONS 1. **A:** What are the cancellation and refund terms before and after work begins? 2. **A:** Can the delivered site run with another host, and which licenses, configuration, credentials, or source materials would not transfer? 3. **B:** How many design and content revision rounds are included, and what happens after that allowance? 4. **B:** What powers the site and analytics dashboard, and what is required and provided to migrate a working site—not only content? 5. **Both:** From selection, what prerequisites and latest dates apply to launch, and can staff edit text and photos on every page? ## G. CONFIDENCE AND REVIEW This comparison establishes stated scope, conditional schedules, payment terms, ownership language, service differences, and mandatory first-year charges. It cannot establish quality, selection-to-launch time, unstated service levels, full portability, or future out-of-scope cost. Before signing, a human should verify answers in the contract, test editing/export, confirm deliverables and dependencies, and review cancellation, license, renewal, and data-access terms.
Run and correction archive
These are the original preserved Markdown files, published byte-for-byte. Status language inside each file reflects when it was written; for example, the evaluation's “public release pending” line is a historical record, not the current release state. Invalid-pilot files are correction history only and are excluded from every published score and verdict.
- Authoritative v2 specification and frozen rubric
The complete execution input, answer key, 100-point rubric, hard-fail rules, and verdict order used for the published run set.
SHA-256 32dc2e8d1b226f11f41bf1fa47ef37d8bc0a68883f6072c36168d995d9879f06 - Published v2 Trial 1
The Trial 1 artifact designated for publication by the frozen v2 protocol before generation; it later scored 100/100 with no hard fail.
SHA-256 f1beec8527febc5ff571dea1cb23931900017a29187393cea7bc29b6b5ff3b3b - Published v2 Trial 2
The complete 75/100 output that hard-failed by upgrading editor access into text-and-photo editing capability.
SHA-256 5c0f65994198e72cff38f601a04b7f57b101d3dbada583531f8cf56c462939f0 - Published v2 Trial 3
The complete 75/100 output that repeated the same material unsupported feature claim.
SHA-256 d021772ada790b10d5491940542fbef1ad1c31ffe4a3cdfbafae4db2738e409c - Independent v2 evaluation
The six-part per-trial scoring matrix, exact hard-fail evidence, verdict calculation, and evidence limits.
SHA-256 84b7409b8879b9aa32e202f7c6c2cbf08f622af7e1e40cc5eb6d5207e28e5ffb - Invalid pilot specification and correction record
Process history only—not verdict evidence. It records why the first input/rubric pairing was invalidated before publication.
SHA-256 1d947a609fc7b6adb6d07427f97d6f2def122ae3d552273082be10b7e9347bf1 - Invalid pilot Trial 1
Preserved process history only; excluded from every published score and verdict.
SHA-256 53adb0757a7de929c1a5750d376165d5ede5486a8beca0f1ffe7b3f7716f7d15 - Invalid pilot Trial 2
Preserved process history only; excluded from every published score and verdict.
SHA-256 f63a90dceaf5ed5ae304e86b4221e11062d4b8efe78369fd0a478b10d3e1c530 - Invalid pilot Trial 3
Preserved process history only; excluded from every published score and verdict.
SHA-256 3dccfc290a19c47b64838a016fe9e24e31f03232f205a557706c0ad54e380340
- Trials 2 and 3 marked the staff text-and-photo editing requirement as met based only on editor access. Neither proposal states that the supplied editor permits both kinds of updates.
- The unsupported feature claim zeroed the 25-point missing-term-discipline section in each affected trial; the hard-fail rule independently determined the public verdict.
- The frozen v2 protocol designated Trial 1 for publication before generation; it was not selected because it scored better, and the archive exposes all three scored v2 outputs.
- It measures disciplined comparison from supplied synthetic text; it does not validate either vendor, establish market pricing, interpret a contract, or prove reliable behavior beyond these observed runs.
- Proposal claims, technical fit, contract language, vendor reliability, and every material clarification still require human verification before signing.
Evaluation
The published archive preserves the authoritative specification, all three v2 outputs, the independent evaluation, and the invalid-pilot correction record. Those files do not independently prove fresh-context execution or record the exact model version, settings, runtime, latency, per-trial cost, or generation timestamps; those measurements remain unknown—not zero. Local SHA-256 values verify current bytes, not generation time or chain of custody.
All business names, vendor names, prices, scope details, and contract terms are synthetic and were written solely for this experiment. No personal, confidential, proprietary, or private business information was used.
- Run ID
- 002-v2 · Trials 1–3
- Timestamp
- 2026-08-18; per-trial timestamps were not independently captured.
- Model
- Codex agent session model; exact serving revision unavailable.
- Settings
- Three separate fresh contexts with no conversation history and identical task instructions; inherited defaults were used, while temperature and seed were unavailable.
- Evaluator
- A fourth fresh Codex agent context, separate from the three generators, audited every output against the frozen v2 rubric.
- Rubric timing
- Precommitted in the authoritative v2 specification before generation; specification SHA-256 32dc2e8d1b226f11f41bf1fa47ef37d8bc0a68883f6072c36168d995d9879f06.
- Corrections
- The earlier pilot was invalid because its input omitted the named pages, payment terms, and exclusions required by the rubric. Its specification and three outputs remain published only as correction history; none is evidence for or mixed into the v2 verdict.
- Integrity hashes
- Specification · 32dc2e8d1b226f11f41bf1fa47ef37d8bc0a68883f6072c36168d995d9879f06
- Trial 1 · f1beec8527febc5ff571dea1cb23931900017a29187393cea7bc29b6b5ff3b3b
- Trial 2 · 5c0f65994198e72cff38f601a04b7f57b101d3dbada583531f8cf56c462939f0
- Trial 3 · d021772ada790b10d5491940542fbef1ad1c31ffe4a3cdfbafae4db2738e409c
- Evaluation · 84b7409b8879b9aa32e202f7c6c2cbf08f622af7e1e40cc5eb6d5207e28e5ffb