Open-source tabular model validation toolkit TanML needs feedback [D]

Reddit r/MachineLearning Tools
open-source tabular-data model-validation ml-toolkit model-risk explainability regulated-industry

Summary

TanML is an MIT-licensed automated model-validation toolkit for tabular machine-learning models, designed for regulated environments. The developers seek feedback on its features and reports.

We’re developing TanML, an MIT-licensed automated model-validation toolkit for tabular machine-learning models. TanML runs locally and provides an end-to-end workflow covering data profiling, preprocessing, feature-power ranking, model development, evaluation, drift analysis, stress testing, SHAP explainability, and audit-ready Word reports. It is designed particularly for model-risk workflows in banking, credit risk, insurance, and other regulated environments. We would appreciate critical feedback from model developers and validators: Which capabilities would be useful in your existing workflow? What important validation tests are missing? Are the generated reports suitable for independent review? What would prevent your team from adopting a toolkit like this? GitHub: https://github.com/tdlabs-ai/tanml
Original Article

Similar Articles

TabularMath: Understanding Math Reasoning over Tables with Large Language Models

arXiv cs.CL

TabularMath introduces a benchmark and AutoT2T framework for evaluating LLMs' mathematical reasoning over tabular data, revealing that table complexity, data quality, and modality significantly impact model performance. The study addresses a gap in LLM evaluation by systematically assessing robustness to incomplete or inconsistent table information in real-world scenarios.

Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

arXiv cs.AI

Introduces Xiaomi-TabLDM, a tabular foundation model that leverages synthetic data and in-context learning for superior prediction accuracy without task-specific fine-tuning, achieving top rankings on multiple benchmarks.

TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling

arXiv cs.CL

TriVAL introduces a tri-validation framework that performs explicit validation at three stages of automatic optimization modeling (semantic specification, mathematical formulation, code generation) to improve faithfulness, and also presents NL4COP, a new benchmark for combinatorial optimization problems.