Research design
Purpose & research questions
This protocol evaluates whether a TEL environment designed with Design Thinking scaffolds can produce measurable traces of Flexible Thinking (FT).
RQ1 — Decision flexibility
Do learners switch strategies when evidence contradicts the initial hypothesis?
RQ2 — Evidence-based justification
Do learners justify choices using concrete evidence (logs, sources, observations) rather than intuition?
RQ3 — Transfer & reflection
Can learners articulate what transfers to new contexts and propose a Plan B?
Participants
- Target group: higher‑education learners in TEL / computing / digital pedagogy (or teacher‑training cohorts).
- Suggested sample size: 8–20 participants for a pilot (thesis‑level feasibility study).
- Prerequisites: basic ability to interpret simple logs + reflect on decisions.
Procedure (45–60 minutes)
| Phase | Task | Captured evidence |
|---|---|---|
| Warm‑up | Read the FT rubric criteria + success indicators. | Baseline rubric entry (optional). |
| Module 1 | Complete one branching incident (2–3 decision points). | Path choices, hint usage, reflections, time stamps. |
| Module 2 | Write prompt v1→v3, critique outputs, add a fact‑check source. | Prompt versions, checklist, source panel, reflection. |
| Module 3 | Submit evidence + 2 interpretations, peer review another submission. | Evidence list, alternatives map, peer review scores, transfer statement. |
| Debrief | Self‑score using the inline rubric (all modules). | Rubric entries + justification text. |
Measures & analysis
- Log metrics: decision paths, strategy switches, hint ladder levels, time on task.
- Rubric scoring: 1–4 per FT criterion with brief justification.
- Reflection quality: claim→evidence→alternative→limitation structure (qualitative coding).
- Peer review: clarity/evidence/alternatives/transfer ratings + comments.
Live dataset (this browser)
What has been captured so far
Runs (all modules)
pie
Rubric entries
radar
Ethics & data protection
This demo is local‑first. Evidence is stored in the browser (localStorage) and exported manually.
No server tracking is enabled. For formal studies: obtain informed consent, avoid sensitive personal data, and anonymize exports.
—