Logo image
ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
Journal article   Open access   Peer reviewed

ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation

Anindya Mondal, Sauradip Nag and Anjan Dutta
ACM transactions on graphics
19/07/2026

Abstract

Computer Science - Computer Vision and Pattern Recognition Image Diffusion Counting Generation Counting Computer Science
ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training required. Our model is built on existing 3B-parameter unified foundation model and is adapted for object localization tasks using three key innovations: density-aware adaptive zooming with objectness maps for spatial grounding; a boundary-aware count policy via GRPO to eliminate crop-boundary errors; and a cycle-consistent GRPO strategy where the understanding branch self-critiques generated outputs, closing the understanding-generation gap without any external annotations. ABACUS achieves state-of-the-art results across seven benchmarks, outperforming both task-specific specialists and larger generalist models.
pdf
ABACUS_SIGASIA_2696.17 MBDownloadView
Author's Accepted Manuscript Open Access CC BY V4.0

Metrics

1 Record Views

Details

Logo image

Usage Policy