Student Success by DesignA practitioner’s guide to theory, data, and AI in student success

6.3 · Theory–Technology Bridge

Evaluation and implementation framework

A theory-informed checklist for reviewing a new tool or analytics project. Use it in procurement, pilot design, and annual review.

Short shows the summary, takeaway, and questions.
Visual model · Cross-functional team decision framework

Select an element for details.

1Student success What mechanism does this support, and what is the response?
2IT & data What data does it use, how current is it, and who can see it?
3Institutional research How will we know it caused the change we see?
4Faculty What will students experience in courses because of it?
5Advisors Do we have capacity to respond to every flag?
6Ethics & compliance Is it lawful, fair, and transparent?
7Students Would you want this? What would make you trust it?

How to read the results

  • Critical stop (do not launch or continue): no named mechanism or defined intervention; no named person accountable for responding to flags; no review of performance across student groups; no documented data retention, access, and sunset terms.
  • Remediate before scale: no comparison group or impact plan; staff capacity to respond not resourced; students cannot see what data is used about them; no cross-functional review that includes students.
  • Improve during the pilot: students not yet involved in design or testing; mechanism measures not yet collected; demographic traits still used as standalone risk drivers, with a plan and date to remove them.

Theory

Evidence

Equity

Student agency

Human role

Governance