Tag
The paper proposes AICG, an AI-aware cognitive-supervised two-branch framework for automated mathematical short-answer grading that combines RoBERTa-based scoring with Q-matrix skill prediction and a Gen-AI detector to weight unreliable responses, reducing MAE by 50.3% and improving QWK from 0.798 to 0.927 over RoBERTa regression.
CmdRound is an assessment platform for hiring managers that gives candidates 55 minutes with Claude Code to complete real engineering tasks, producing rule-based scores and call replays with no LLM judge. It is priced at $49 for 10 candidates with a one-year validity.
In his talk, Carson Gross discussed the impact of AI on university computer science education, arguing that in the AI era, students still need to be taught to write and read code, while also noting that AI brings an assessment crisis and opportunities for pedagogical change.
This paper investigates whether LLMs can accurately predict item difficulty levels in large-scale reading and writing tests, finding that GPT-4.1 achieves moderate accuracy but is outperformed by ConvBERT, and that LLMs tend to underestimate difficulty for hard items.