Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: support bentoml.depends.from_url("http://already.deployed-bento.com:3000") #4745

Closed
KimSoungRyoul opened this issue May 19, 2024 · 2 comments
Labels
enhancement Enhancement proposals

Comments

@KimSoungRyoul
Copy link
Contributor

Feature request

@bentoml.service(
    traffic={"timeout": 600},
    workers=8,
resources={"cpu": "1"}
)
class ControlNet:
    # Pass the dependent Service class as an argument
    # controlnet_service = bentoml.depends(SDXLControlNetService)
    controlnet_service = bentoml.depends.from_url(
       url= "http://already.deployed-bento.com:3000",
       input =  Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
       output =  Annotated[torch.Tensor, Shape((1, 4)), DType("float32")],
    )  

    @bentoml.api
    async def generate(self, image: PIL_Image, params: Params) -> PIL_Image:

Motivation

No response

Other

No response

@KimSoungRyoul KimSoungRyoul added the enhancement Enhancement proposals label May 19, 2024
@frostming
Copy link
Contributor

Thanks, this will be included in 1.4, the next minor release

@KimSoungRyoul
Copy link
Contributor Author

KimSoungRyoul commented Dec 22, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement proposals
Projects
None yet
Development

No branches or pull requests

2 participants