The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image. Source: Scene Graph Generation by Iterative Message Passing

The current state-of-the-art on Visual Genome is SpeaQ (without reweighting). See a full comparison of 18 papers with code.

2022年1月3日 · Scene Graph Generation (SGG) refers to the task of automatically mapping an image into a semantic structural scene graph, which requires the correct labeling of detected objects and their relationships.

Unbiased Scene Graph Generation (Unbiased SGG) aims to predict more informative scene graphs composed of more "tail predicates" *(in contrast to "head predicates" in terms of class frequencies) by dealing with the skewed, long-tailed predicate class distribution.

2024年12月15日 · Our method achieves state-of-the-art results on the Action Genome (AG) benchmark, and extensive experiments show the effectiveness of SceneLLM in understanding and generating accurate dynamic scene graphs.

2024年12月17日 · Under the new frame, we propose Retrieval-Augmented Scene Graph Generation (RA-SGG), which identifies potential instances to be multi-labeled and enriches the single-label with multi-labels that are semantically similar to the original label by retrieving relevant samples from our established memory bank.

2024年1月26日 · To achieve this goal, we introduce a novel and pragmatic framework for scene graph generation, namely Lifelong Scene Graph Generation (LSGG), where tasks, such as predicates, unfold in a streaming fashion.

Existing research addresses scene graph generation (SGG) -- a critical technology for scene understanding in images -- from a detection perspective, i. e., objects are detected using bounding boxes followed by prediction of their pairwise relationships.

2024年10月20日 · Current approaches for open-vocabulary scene graph generation (OVSGG) use vision-language models such as CLIP and follow a standard zero-shot pipeline -- computing similarity between the query image and the text embeddings …

2024年12月8日 · Scene Graph Generation (SGG) converts visual scenes into structured graph representations, providing deeper scene understanding for complex vision tasks. However, existing SGG models often overlook essential spatial relationships and struggle with generalization in open-vocabulary contexts.