FP16

[HuLu65]

Whether YOLOV5 fp16 inference is supported

[fcakyon]

For yolov5 mixed precision inference:

from sahi import AutoDetectionModel
from sahi.predict import predict
import yolov5

model = yolov5.load('yolov5s.pt')

model.amp = True  # for automated mixed precision inference

detection_model = AutoDetectionModel.from_pretrained(
    model_type='yolov5',
    model=model,
)

predict(
    detection_model=detection_model,
    other parameters ...
)

For yolov5 fp16 inference:

from sahi import AutoDetectionModel
from sahi.predict import predict
import yolov5

model = yolov5.load('yolov5s.pt')
model = model.half()  # for half precision inference

detection_model = AutoDetectionModel.from_pretrained(
    model_type='yolov5',
    model=model,
)

predict(
    detection_model=detection_model,
    other parameters ...
)