Generates textual description of any given image. Use both Natural Language Processing (NLP) and Computer Vision to generate captions. The idea implemented is to replace the encoder (RNN layer) in an encoder-decoder architecture with a deep Convolutional Neural Network (CNN) trained to classify objects in images.
https://data-flair.training/blogs/python-based-project-image-caption-generator-cnn/
https://www.tensorflow.org/api_docs/python/tf/keras/
Make sure you have python installed on your system.
I have used pipenv to manage virtual environment and packages.
You can install pipenv using pip by running
$ python -m pip install pipenvNow clone this repo and install all the dependencies
$ git clone https://github.com/Smile040501/image_captioning.git
$ cd image_captioning/
$ pipenv install --devOnce all the packages are installed, you may try running one of the following commands
# To generate predicted captions for all the dev dataset images
$ pipenv run python generate_caption.py generate
# To generate a prediction for provided image
$ pipenv run python generate_caption.py image <path_to_image>Or you may use try using Jupyter Notebooks.
(Make sure to select python interpreter as installed by pipenv)
Node.js REST API for the project to make requests from frontend and predict caption for uploaded image from frontend.
This project requires NodeJS (version 8 or later) and NPM.
To make sure you have them available on your machine, try running the following command.
$ npm -v
7.20.3
$ node -v
v14.17.4BEFORE YOU INSTALL : Please read the Prerequisites.
Start with cloning this repo on your local machine, copying this template folder to destination folder and installing dependencies.
$ git clone https://github.com/Smile040501/image_captioning.git
$ cd image_captioning/
$ npm installIn the project directory, you can run:
Runs the app in the development mode.
You can make request to http://localhost:8000
It will bundle the app using webpack to build folder and serve it using nodemon.
It will re-bundle whenever you make edits to any of the development file.
Will serve the app using nodemon.
Make sure the app was build before webpack at least once and build folder exists.
Builds the app for production to the build folder.
It correctly bundles the app in production mode and optimizes the build for the best performance.
The build is minified.
Your app is ready to be deployed!
Mayank Singla