West Yorkshire Combined Authority / Pilot Learner Destinations System

Tender Submission

Working notes on the winning proposal by Thrive Economics (with IBP Strategy & Research) for the WYCA Learner Destinations Survey. The completed proposal is incorporated into the contract, so everything here is a binding delivery commitment.

Key facts at a glance
Supplier
Thrive Economics (lead) + IBP Strategy & Research (sub-processor)
Team
6 people; every SoR requirement has a named owner
Baseline forecast
2,900 completions (20% of 14,500)
Matched pairs
698 total (348 online + 350 phone) · ±3.5pp at 95%
Data architecture
IBP holds identifiable data; Thrive analyses a pseudonymised feed
Legacy
Whole system transfers to WYCA at completion, no licence fees
① Question 1 — Insight & Methodology

1.1 — Our understanding of the commission

🏗
How 1.1 affects design: the pseudonymised-extract / single-identifiable-data-location split is now a hard architectural commitment — the analysis database and dashboard must never hold names or contact details. The "affordable at 3× scale" test is what justifies the automation-heavy build (deterministic matching, validated intake, automated extracts) and points straight at deliverable D4, the 45,000-learner roll-out.

1.2 — Our understanding of the context

How 1.2 affects design — the data providers

My reading of who supplies the learner data, by type, and what each implies for the build.

Data providerData provider type
Leeds Adult LearningLA adult learning service
Kirklees adult learning serviceLA adult learning service
Bradford adult learning serviceLA adult learning service
Calderdale adult learning serviceLA adult learning service
Wakefield adult learning serviceLA adult learning service
Leeds City College (Luminate group)FE college
Keighley College (Luminate group)FE college
University Centre Leeds (Luminate group)FE college
Bradford CollegeFE college
Calderdale CollegeFE college
Kirklees CollegeFE college
Heart of Yorkshire groupFE college
Leeds College of BuildingFE college
MaximusIndependent training provider (Adult Skills DPS)
Specialist local providersIndependent training provider (Adult Skills DPS)

Design implications

1.3 — Our delivery model

Six defining features, each a deliberate methodological choice.

Figure 1 — Proposed learner survey process: end-to-end swimlane across Learner, Learning Provider, IBP Strategy & Research, Thrive Economics and WYCA
Figure 1 — Proposed learner survey process (end-to-end swimlane across all five parties). Open full size ↗
📊
Your scope — the full Data Platform + dashboard (Data Platform Lead): you take the response feed from the survey software (Snap) via its API, pseudonymise and transform it in a Microsoft Fabric pipeline, load only reporting fields into the analysis database (a Fabric Lakehouse or Warehouse), and build the Power BI dashboards on top. Everything from the survey-software feed to the dashboard is yours.
  • Boundary / DPIA point: IBP's Snap platform holds the identifiable data; your pipeline pulls via the Snap API and pseudonymises, so you do handle identifiable data at the extraction/pseudonymisation step, and only pseudonymised fields land downstream. Note the submitted doc is inconsistent here — Figure 1 shows pseudonymisation on IBP's side, feature 5 puts it in your pipeline; worth pinning down exactly where it executes.
  • Access model: WYCA sees everything; each provider sees only its own learners (two access tiers).
  • Per-provider data-quality panel: files received, rejection rate, days since last upload.
  • Core content: baseline/outcome response numbers, matched pairs by provider and provision, response-rate tracking (against the forecast targets in Figure 2).
  • Role: WYCA's live progress tracker and the standing exhibit at the bi-weekly steering group — must be always-current, not batch-updated.

1.4 — Our work stages, deliverables and milestones

Seven stages, mapped to the SoR deliverables and published dates. Stages 3 and 5 (highlighted) are your dashboard scope.

#Stage (timing)What happensDeliverable / milestone
1Inception & design lock (Aug–Sep 2026)Inception meeting; delivery strategy + target respondent numbers agreed; instruments, sampling, quota and matching rules locked; DPIA support; provider engagement planInception paper — Sept 2026 (30%)
2Provider mobilisation & intake system (Sep–Oct 2026)Intake template mandated by WYCA; data validation processes developed and tested with IBP; provider briefings; first files validated and loadedAll participating providers live
3Survey build & data pipeline (Sep–Oct 2026)Snap survey build with unique-ID links; Snap API extract pipeline, Fabric analysis database and Power BI dashboard built and tested against live test dataDashboard operational — Oct 2026 (20%)
4Rolling fieldwork (Oct 2026–Aug 2027)Invitations auto-generated by email/SMS as validated records arrive; follow-ups issued automatically at set intervals; automated reminders (WhatsApp considered at mobilisation); channel success reviewed to inform rollout; 350 telephone interviews, steered monthly, extendable to 500Survey issuance across 11 months (Oct 2026–Aug 2027), within the 14-month window
5Ongoing management & reporting (continuous)Bi-weekly steering; live dashboard maintained; response-rate reports; per-provider data-quality monitoring and exception management; 3-working-day responseBi-weekly steering; dashboard always current
6Analysis (Jul–Sep 2027)Full statistical analysis (SDs, standard errors, confidence levels) by provision and provider; effectiveness + VfM led by the economist, Green/Magenta BookAnalysis complete for reporting
7Final report, presentation & scale-up (Sep 2027)Final report + one-page graphical summary + executive summary; presentation; costed 45,000+ roll-out methodologyFinal report — Sept 2027 (50%)
📅
Your milestone — Oct 2026 dashboard operational (20% payment). Stage 3 is your whole build in a tight Sep–Oct window: the Snap API extract pipeline, the Fabric analysis database and the Power BI dashboard, tested against live test data. Stage 5 is then your continuous run phase across the full fieldwork period.

1.5 — Sample size

The fieldwork funnel: conservative, evidenced forecasts. Matched pairs are the unit of value.

14,500
Learners invited
Whole eligible base
→
2,900
Baseline surveys
20% response (conservative)
→
348
Online matched pairs
12% of baseline convert
+
350
Telephone matched pairs
Guaranteed, quota-managed (extendable to 500)
=
698
Matched pairs
±3.5pp at 95% confidence

Based on the submission's Figure 2. Open original Figure 2 ↗

What 698 pairs can honestly support — tiered reporting

Programme level
Full inferential statistics (SDs, standard errors, confidence intervals). Margin of error ±3.5pp.
Provision level (×3)
Full inferential statistics per provision type; the quota-managed telephone sample protects precision in the smallest cohort.
Provider level
Descriptive only, with explicit uncertainty ranges and a minimum cell size of 30. Provider × provision cells mostly too small — flagged, not reported spuriously.
🔧
Implications for my design:
  • Warehouse grain & dimensions: model to programme / provision (×3) / provider, plus channel (online vs telephone), monthly cohort, and the four outcome types. The matched pair is the core fact.
  • Track actuals vs forecast: the dashboard's response-rate view is variance-to-target against these numbers (2,900 baseline; 348 + 350 = 698 pairs), by provision and provider.
  • Minimum cell size of 30 is a build rule, not a footnote: a reusable measure that flags or suppresses cells below 30, so neither the dashboard nor the report ever shows a small number as if precise.
  • Two reporting registers from one model: inferential at programme/provision (carry SD, standard error, confidence intervals) and descriptive at provider — the warehouse must hold, or let you compute, the statistics behind both.
  • Quota attainment: the 350 telephone pairs (extendable to 500) are steered to targets across provision, provider and demographics — hold the channel and quota dimensions so the dashboard can show attainment vs plan.

1.6 — Compatibility with the brief

A point-for-point compliance mapping to the Statement of Requirements.

1.7 — Our experience of similar projects

Each defining feature traces to something learned on similar work.

What experience taught usHow it shaped the methodology
Skills evaluation for WYCA (ESOL, Essential Skills; the providers and learner journeys first-hand)Realistic assumptions about provider capacity and contactability; a genuinely light-touch provider role; instruments that reflect how these courses run.
Whole-base learner surveys returned single-digit response; telephone pilots roughly doubled itA defensible conservative 20% baseline forecast; multi-channel invitations timed to enrolment; telephone capacity deployed where it creates matched pairs.
Fieldwork with low-literacy and ESOL learners: long instruments and numeric scales suppress responseThree-minute surveys at Entry Level reading age; three consistent answer scales; no numeric scales; translated online surveys where required.
IBP's survey operations (telephone fieldwork, Snap management)Quota-managed interviewing steered monthly; a single secure identifiable-data environment; professionally managed reminder and exception processes.
Multi-provider data collection: inconsistent submission is the main cause of delay and quality failure; manual cleaning does not scaleMandated intake template, automated validation with exception reports, and per-provider data quality on the dashboard.
Green Book and Magenta Book practice (HM Treasury appraisal / evaluation)An analysis plan specified before fieldwork; instruments designed backwards from the effectiveness / VfM analysis; uncertainty reported honestly.

1.8 — What WYCA owns when the commission ends

📦
Your deliverables: the platform components in that pack are yours to produce — data model, integration pipelines, database schema, Power BI reports, source code and documentation. Build for handover from day one: documented, source-controlled and transferable, not a personal toolset.

1.9 — Assumptions and managed dependencies

Three dependencies, each a managed dependency with a fallback, not a condition of delivery.

⚠
Live decision for you: the hosting choice (Thrive-hosted vs WYCA tenant) is yours, and the WYCA-tenant option needs platform access confirmed by September 2026 — effectively next month. Ties to Questions Q2 (tenants); needs an owner now.
② Question 2 — Resources

2.1 — Our team

A six-person team; every SoR requirement has a named owner; the personal-data boundary runs cleanly between roles.

PersonCommission roleFocus
Chris Maunder (Co-Director, Thrive)Commission DirectorSingle point of contact; methodology; analysis oversight; final report author
Sam Maunder (Research Consultant, Thrive)Research ConsultantResponse monitoring; data-quality management; statistical analysis; reporting
Dom Chapman (Co-Director, Thrive)Economic ModellingEffectiveness & VfM analysis; survey-design input
Eddy Graham (Director, IBP)Survey Operations Lead (named sub-processor)Research design + fieldwork QA; all identifiable data; 350 telephone interviews
Fraser Gilfillan (Consultant, IBP)Survey ManagerDay-to-day survey ops (Snap set-up, issuance, response monitoring); data processing; collation into matched dataset
Matthew Denison (Associate, Thrive)Data Platform LeadSnap API integration; Fabric pipelines; pseudonymisation; analytical database; Power BI dashboards

2.2 (how the team fits together) is team-glue with no design impact — omitted.

2.3 — Technical resources

Technical architecture: identifiable data in IBP's Snap platform; a Microsoft Fabric pipeline pseudonymises via the Snap API and loads a Lakehouse/Azure SQL analysis database behind a Power BI dashboard; two hosting options
Technical architecture (final submission) — from learner response to live dashboard. Open full size ↗
🔧
Your build — the stack, now committed: Fabric F2 pay-as-you-go with a nightly refresh (paused otherwise), a Fabric Lakehouse or Warehouse as the analysis database (the bid figure labels it "Lakehouse / Azure SQL"), and a Power BI import model on shared Pro capacity so reports stay live while F2 is paused. The whole solution transfers to WYCA with source code and documentation. Full proposal and costs: Data Platform Architecture →
④ Question 4 — Quality Control (points that touch your build)

Q3 (Timescales) and 2.4 (case studies) omitted — nothing design-relevant. The Quality Control points that land on your platform:

Section tracker
Q1 — Insight & Methodology Covered
Q2 — Resources (team, tech stack) Covered
Q3 — Timescales Not relevant
Q4 — Quality Control Covered
Workplan & fee (separate doc) Not relevant

Source: _context\Tender Submission\Data Destination Response, Thrive Economics.docx and Data Destination Workplan, Thrive Economics.docx