创建词汇测验题目

Thesis: A well-designed self-assessment item should elicit evidence of both conceptual understanding and transfer, be anchored in explicit success criteria, and include a calibration step that prompts students to compare their judgments against standards. Such features enhance validity (alignment to intended learning outcomes), reliability (consistency through analytic criteria), and promote self-regulated learning through structured reflection (Sadler, 1989; Hattie & Timperley, 2007; Andrade & Valtcheva, 2009).

Self-assessment question (adaptable to any topic; replace #{input_your_topic} with the specific domain) Prompt: In 150–200 words, explain a central principle or mechanism in #{input_your_topic}. Then construct and analyze one original example or case that demonstrates the principle in practice. After writing your response:

1. Self-rate your work on the four criteria below (0–3 scale per criterion) and justify each rating in one sentence.
2. Identify one targeted improvement and revise one sentence of your response accordingly.

Success criteria (analytic; for self-rating)

• Conceptual Accuracy (0–3): The principle is correctly defined; key terms and relationships are precise; no misconceptions.
• Application/Transfer (0–3): The example is novel (not from class materials) and correctly analyzed with explicit, stepwise reasoning using the principle.
• Evidence/Justification (0–3): Claims are supported (e.g., with rules, data, derivations, or authoritative sources); reasoning is traceable.
• Clarity/Organization (0–3): The response is concise, logically structured, and uses discipline-appropriate terminology and notation.

Scoring guidance

• 3 = Meets criterion fully and consistently; 2 = Minor gaps; 1 = Major gaps or partial fulfillment; 0 = Absent or incorrect.
• Mastery threshold: 10–12; Developing: 7–9; Needs support: ≤6.
• Calibration step: After self-rating, compare your response to an instructor-provided exemplar or checklist and adjust ratings if warranted, noting the rationale for any change.

Rationale and evidence

• Criterion-referenced self-assessment improves students’ ability to identify gaps relative to standards, which is foundational for formative assessment (Sadler, 1989).
• Structured self-assessment with explicit criteria and justification enhances feedback quality and learning gains (Hattie & Timperley, 2007).
• Requiring a concrete revision operationalizes feedback into action, strengthening self-regulation and performance (Andrade & Valtcheva, 2009).
• Analytic rubrics increase reliability of judgments and clarify expectations for both accuracy and transfer (Panadero & Jonsson, 2013).

References (APA 7th)

• Andrade, H., & Valtcheva, A. (2009). Promoting learning through self-assessment. Theory Into Practice, 48(1), 12–19.
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.
• Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment: A review. Educational Research Review, 9, 129–144.
• Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144.

论证与设计原则 为学习某一具体主题的学生设计自我评估题，宜同时考察概念掌握、迁移应用与元认知监控，并确保与课程学习成果对齐，以支撑有效解释分数所代表的能力（Messick, 1995；AERA, APA, & NCME, 2014）。基于证据中心化设计（Evidence-Centered Design, ECD）框架，应明确待收集的证据、评价规则与任务情境，以提高效度与可解释性（Mislevy, Almond, & Lukas, 2004）。此外，纳入自我校准与反思环节可促进自我调节学习与学习者对错误来源的识别（Nicol & Macfarlane-Dick, 2006；Andrade & Valtcheva, 2009）。为避免过度依赖主观判断，建议结合评分量表与概率式置信报告，并用Brier分数评估校准质量（Brier, 1950）。

自我评估题（适用于学习［主题］的学生） 说明：将“［主题］”替换为您当前学习的具体内容（如线性回归、细胞有丝分裂、国际贸易比较优势等）。独立完成题目后，依据评分量表进行自评与校准。

题干与作答要求

• 第A部分（概念界定，约150字）

  1. 选择并准确陈述［主题］中的一个核心概念/原理/模型（明确关键术语与符号）。
  2. 列出其适用条件与主要假设（至少2项），并指出一个常见误解或滥用情形。

• 第B部分（迁移应用，约300–400字） 3) 自拟一个与现实或学科实践相关的微型情境（含必要数据/信息），将第A部分的概念/模型应用于该情境： a) 明确问题与判据（需可操作与可检验）； b) 给出推理或求解步骤并得出结论； c) 说明结论的证据基础与不确定性来源（至少2项）。

• 第C部分（自我校准与反思，约150字） 4) 对你的整体结论报告主观置信度p（0–1），并计算Brier分数BS = (p − o)²，其中o为结论的真实性判断（若你经查证或与标准答案比对为正确则o = 1，否则o = 0）。 5) 简述造成不确定性的关键假设或数据缺口，并提出一项具体的改进行动（如查验某数据、对比替代模型、复核推理步骤）。

评分量表（用于自评；总分20分）

• 概念准确性（0–4分）：定义规范、术语与符号使用准确；适用条件与假设表述清晰。
• 误解识别（0–2分）：能指出具代表性的误解，并解释其成因或后果。
• 情境建模与判据（0–4分）：问题界定明确、判据合理，可据此检验结论。
• 推理与证据（0–6分）：推理链完整、步骤可复核；证据与结论匹配，论证避免跳步。
• 局限与不确定性（0–2分）：识别至少2项不确定性来源及其对结论的影响。
• 学术规范与清晰性（0–2分）：表述结构化、引用或数据来源交代清楚（如适用）。

自我校准与记录建议

• 在每一维度给出自评分，并用简短证据说明（例如“满足条件X，引用数据Y，推导步骤Z可复核”）。
• 记录置信度p与BS，用以追踪校准质量：较低的BS（接近0）表明更好的置信-正确性匹配（Brier, 1950）。
• 若BS偏高，优先复核高置信但错误的环节，避免系统性过度自信（Nicol & Macfarlane-Dick, 2006）。

评分者参考要点（供制定标准答案使用）

• 第A部分：应包含该概念/模型的标准化定义、关键条件与适用边界；列出典型误解的判别点。
• 第B部分：情境与判据可操作；推理步骤可追踪且与结论一致；能提供与结论相关的最小充分证据。
• 第C部分：置信度报告合理；Brier分数计算正确；反思具可执行的改进措施。

参考文献

• AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Washington, DC: AERA.
• Andrade, H., & Valtcheva, A. (2009). Promoting learning through self-assessment. Theory Into Practice, 48(1), 12–19.
• Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78(1), 1–3.
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry. American Psychologist, 50(9), 741–749.
• Mislevy, R. J., Almond, R. G., & Lukas, J. F. (2004). A brief introduction to evidence-centered design (ETS RR-04-16). Princeton, NJ: ETS.
• Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self‐regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.