N. Kashani Motlagh, J. Davis, T. Anderson, J. Gwinnup
Journal extension evaluating per-class binomial reject thresholds on benchmark image and text datasets and twelve synthetic variants, from 2 to 1,000 classes.
- Extends the natural reject-region constraint across controlled synthetic data, benchmark image classification, and text classification.
- Reports transfer behavior on CINIC10 and long-tailed iNaturalist19 alongside explicit selective-accuracy, reject-accuracy, and coverage tradeoffs.
Related code and data Reject-option classification
N. Kashani Motlagh, J. Davis, J. Gwinnup, G. Erdmann, T. Anderson
VGAMT scores 81% ImageCoMMuTE and 63% TextCoMMuTE on contrastive diagnostics, with 13% favorable and 0% unfavorable preference flips versus a mixed-image baseline.
- Introduced imagery-aware contrastive probes for testing whether model scores change under mismatched visual context.
- Evaluated three English-to-French multimodal model families, plus gated variants, under matched and mismatched visual context.
N. Kashani Motlagh, J. Davis, T. Anderson, J. Gwinnup
Per-class abstention without preset rejection costs or accuracy/coverage targets: 97.4% selective accuracy at 79.7% coverage on ImageNet validation.
- Springer Best Paper Award at ISVC 2022; later extended in the MVA 2025 journal version.
- At the ImageNet δ=.75 operating point, B-CDF improved select accuracy by 0.4 percentage points and coverage by 1.3 points versus an uncalibrated global 0.5 threshold.
Related code and data Reject-option classification
N. Kashani Motlagh, A. Radhakrishnan, J. Davis, R. Ilin
OpenStreetMap-guided imagery collection and labeling tools for building temporal satellite datasets for dynamic-region analysis.
- Combined OpenStreetMap extraction, polygon filtering, and temporal imagery download scripts in a public Python workflow.
- Released the collection code and a sample construction-site satellite-imagery dataset under the repository's GPL license.
Related code and data Satellite imagery collection