Tag
IBM Research introduces ScarfBench, an open benchmark for evaluating AI agents on cross-framework Java migration tasks, focusing on Spring, Jakarta EE, and Quarkus. The benchmark assesses whether migrated applications build, deploy, and preserve behavior, unlike traditional code generation benchmarks.