VisualGPT, CVPR 2022 Proceeding, GPT as a decoder for vision-language models

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

CLIPxGPT Captioner is Image Captioning Model based on OpenAI's CLIP and GPT-2.

[CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion model with additional semantic prior.

Paper notes in deep learning/machine learning and computer vision

Tensorflow implementation of "Show, Attend and Tell: Neural Image Caption Generation with Visual Attention" Support python3.6, python3.7 TensorFlow1.8 TensorFlow1.12 TensorFlow1.13 TensorFlow1.14 numpy 1.12 or newer

An Image captioning web application combines the power of React.js for front-end, Flask and Node.js for back-end, utilizing the MERN stack. Users can upload images and instantly receive automatic captions. Authenticated users have access to extra features like translating captions and text-to-speech functionality.

pre-trained model and source code for generate description of images.

A Python base cli tool for caption images with WD series, Joy-caption-pre-alpha,meta Llama 3.2 Vision Instruct and Qwen2 VL Instruct models.

[IGARSS 2022] CapFormer: Pure transformer for remote sensing image caption

Image Caption

Image captioning project.

a py3 lib for NLP & image-caption metrics : BLEU METEOR CIDEr ROUGE SPICE WMD

Simple but Comprehensive PyTorch Implementation of Image Captioning Models.

This repository reimplements "Show, Attend and Tell" model and add extra deep learning techniques.

some works on ncnn

Using image caption models to extract prompts in ComfyUI

Transformer block in tf.keras similar to PyTorch's nn.Transformer block.

Allows to generate image caption information from annotations