Skip to content

hii0608/ImageRetreivalGS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

(참고) 23.12.02에 push 한 것들은 distance, angle 만을 특징으로 한 것.

CBIR-SubSG

Contents based Image Retrieval Method based on Scene Graph using Subgraph Learning.
Main idea is Subgraph Learning and A* Graph Edit Distance.
Inspired by Neural subgraph matching and simGNN.

  • Subgraph Learning
    • Through GNN Learning, a similar pair of subgraphs are embedded close to the same embedding space
  • A* Graph Edit Distance
    • Graph Similarity method that appllied with A* Algorithm to GED

Train GNN encoder

  1. Train the encoder : python3 -m cbir_subsg.train.
    Note that a trained order embedding model checkpoint is provided in ckpt/model.pt.
  2. Optionally, analyze the trained encoder via python3 -m cbir_subsg.test

Usage

Scene Graph data (common/data.py) can be used to train the model.
Transfer the learned model to make inference on scene graph data (see cbir_subsg/test.py).

Available configurations can be found in cbir_subsg/config.py.

Dependencies

The library uses PyTorch and PyTorch Geometric to implement message passing graph neural networks (GNN). It also uses DeepSNAP, which facilitates easy use of graph algorithms (such as subgraph operation and matching operation) to be performed during training for every iteration, thanks to its synchronization between an internal graph object (such as a NetworkX object) and the Pytorch Geometric Data object.

Graph Edit Distance(GED) uses graph-matching-toolkit used SimGNN papers.
To use the GED, follow these steps:

Detailed library requirements can be found in requirements.txt

About

ImageRetreival based on Graph Sequence

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published