Add Dockerfile with ROCm support

[jakki-amd]

Description

Add Dockerfile with ROCm support

Fixes #4

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• New feature (non-breaking change which adds functionality)
• This change requires a documentation update

Feature/Issue validation/testing

• Regression test

FAILED test_handler.py::test_huggingface_bert_model_parallel_inference

Checklist:

• Did you have fun?
• Have you added tests that prove your fix is effective or that this feature works?
• Has code been commented, particularly in hard-to-understand areas?
• Have you made corresponding changes to the documentation?

[smedegaard]

tested on AMD node with

DOCKER_BUILDKIT=1 docker build --build-arg ROCM_VERSION=rocm62 --build-arg MACHINE_TYPE=gpu -t rocm-testing -f ./docker/Dockerfile.rocm .

docker run --device=/dev/kfd --device=/dev/dri -e JAVA_TOOL_OPTIONS="-Dlogging.level.root=DEBUG" -e HIP_VISIBLE_DEVICES=6 -e PYTHONLOG=DEBUG -it rocm-testing /bin/bash

python3 /serve/test/regression_tests.py

Result

┌─────────────────────────┬─────────────────────┬────────────────────┐
│                         │            executed │             failed │
├─────────────────────────┼─────────────────────┼────────────────────┤
│              iterations │                  11 │                  0 │
├─────────────────────────┼─────────────────────┼────────────────────┤
│                requests │                  11 │                  0 │
├─────────────────────────┼─────────────────────┼────────────────────┤
│            test-scripts │                  11 │                  0 │
├─────────────────────────┼─────────────────────┼────────────────────┤
│      prerequest-scripts │                   0 │                  0 │
├─────────────────────────┼─────────────────────┼────────────────────┤
│              assertions │                  11 │                  0 │
├─────────────────────────┴─────────────────────┴────────────────────┤
│ total run duration: 14s                                            │
├────────────────────────────────────────────────────────────────────┤
│ total data received: 1.7kB (approx)                                │
├────────────────────────────────────────────────────────────────────┤
│ average response time: 1252ms [min: 6ms, max: 10.6s, s.d.: 3s]     │
├────────────────────────────────────────────────────────────────────┤
│ average DNS lookup time: 852µs [min: 156µs, max: 1ms, s.d.: 616µs] │
├────────────────────────────────────────────────────────────────────┤
│ average first byte time: 1247ms [min: 3ms, max: 10.6s, s.d.: 3s]   │
└────────────────────────────────────────────────────────────────────┘

[smedegaard]

#27 (comment)

[smedegaard]

update docs ❤️