Code for Dataset Generation

[yeliudev]

Hi @mmaaz60, thanks for sharing this great work!

I was wondering whether you have a plan to share the code for semi-automated dataset generation (the pipeline of using Katna to extract keyframes -> using BLIP2 & GRIT to generate frame-wise captions -> filtering with Tag2Text). If not, is it possible to share the generated dense captions from these large vision models?

Thank you!

[sunwhw]

Me too!

[mmaaz60]

Hi @yeliudev @sunwhw

I appreciate your interest in our work. We recently released our work called VideoGPT+ and an improved semi-automatic video annotation pipeline for dataset generation. All the scripts to run the pipeline are also released.

Please check it out at GitHub, HuggingFace.

Please let me know if you have any questions. Good Luck!