Batch Prediction

[Sayyam-Jain]

Hi. Thank you for the nice work. I noticed that during prediction, each image is loaded and OCR is predicted. Can you please tell me how to predict on a batch of images simultaneously in order to increase GPU efficiency and save time. Thanks

elif parameters.phase == 'predict':
            for line in sys.stdin:
                filename = line.rstrip()
                try:
                    with open(filename, 'rb') as img_file:
                        img_file_data = img_file.read()
                except IOError:
                    logging.error('Result: error while opening file %s.', filename)
                    continue
                text, probability = model.predict(img_file_data)
                logging.info('Result: OK. %s %s', '{:.2f}'.format(probability), text)

[thewhiteflower110]

For testing I found it -> model/model.py line no. 85
For predict, you may improvise the predict method on line no. 288 of model.py