ARCHIVES

Original Article

Generative AI-Based Image Captioning System Using Vision Transformers and Large Language Models

Ameena Firdous1Dr.Waseema Masood2

¹ Assistant Professor, Nawab Shah Alam Khan College of Engineering and Technology, Hyderabad, Telangana, India. ² Associate Professor, Deccan College of Engineering and Technology, Hyderabad, Telangana, India.

Published Online: March-April 2026

Pages: 67-73

Abstract

View PDF

Recent developments of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) have helped tremendously in improving the capabilities of machines to comprehend and write human-like language. Nonetheless, linking the visual information with natural language comprehension is a difficult issue to be solved in artificial intelligence. This project is aimed at the creation of the intelligent image captioning system that will provide the link between the computer vision and natural language processing. The suggested system processes the visual information in images and automatically produces valuable and contextual text description of the visual images, which will allow the machines to understand and describe the visual scenes in a better way. The system combines computer vision models, which are based on deep learning, and language generation techniques, which are based on transformers. One of the pretrained vision encoders in the form of a Convolutional Neural Network (CNN) or a Vision Transformer (ViT) is then applied to images and the visual features are then processed by a language decoder to create coherent captions. To train the model and evaluate it, publicly available datasets (MS COCO and Flickr8k/Flickr30k) are used. It is implemented with the help of Python and deep learning systems such as PyTorch or TensorFlow. Standard measures such as BLEU, METEOR and ROUGE are used to measure performance. The suggested system shows how generative AI can be used to enhance image understanding, accessibility, and automated content description with the help of computer vision.

Related Articles

2026

AI-Based Stomach Cancer Detection Using Biomarkers, Medical Images, and Voice Analysis

2026

Hydrogen-Efficient Eco-Driving and Route Planning for Fuel-Cell Electric Vehicles Using Multi-Objective Optimization Under Traffic and Terrain Uncertainty

2026

A Data-Driven Machine Learning Framework for Assessing Patent Commercial Value and Technological Significance

2026

Evaluating Student Academic Performance Through a Benchmark of Fuzzy Reasoning Models

2026

Soft Computing Approaches for Robust Analysis of Imbalanced and Noisy Data

2026

Smart Attendance System Using Face Recognition and Gaze-Based Attention Monitoring

2026

Analyzing Customer Review Sentiments using Machine Learning

2026

Agentic Artificial Intelligence as a Strategic HR Partner: Redefining Decision-Making Authority and Strategic Roles

2026

Solid Waste Management Rules, 2026 (India): Regulatory Design Review and Environmental Benefits for Urban Sustainability

2026

Optimizing Hospital Resource Utilization Using Power BI Analytics