You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The playground shows the blank page for ChatBedrock based chain with configurable_field for llm temperature.
The playground works fine without the configurable_field.
Setting the temperature via the swagger WebUI works fine.
Setup: langchain-aws==0.2.9 langserve==0.3.0
class JokeRequest(BaseModel):
topic: str
llm = ChatBedrockConverse(
model_id="meta.llama3-8b-instruct-v1:0", # "amazon.titan-text-express-v1" gives the same result
temperature=0.0,
).configurable_fields(temperature=ConfigurableField(
id="llm_temperature",
name="LLM Temperature",
description="The temperature of the LLM",
)
)
add_routes(
app,
PromptTemplate.from_template("Tell me a joke about {topic}") | llm | StrOutputParser(),
path="/joke",
input_type=JokeRequest,
output_type=str,
)
Also tried this with the same result
...
llm = ChatBedrock(
model_id="meta.llama3-8b-instruct-v1:0",
model_kwargs=dict(temperature=0.0),
beta_use_converse_api=True, # False gives the same result
).configurable_fields(temperature=ConfigurableField(
id="llm_temperature",
name="LLM Temperature",
description="The temperature of the LLM",
)
)
...
The text was updated successfully, but these errors were encountered:
The playground shows the blank page for ChatBedrock based chain with configurable_field for llm temperature.
The playground works fine without the configurable_field.
Setting the temperature via the swagger WebUI works fine.
Setup:
langchain-aws==0.2.9
langserve==0.3.0
Also tried this with the same result
The text was updated successfully, but these errors were encountered: