Skip to content

[CB] Split token streaming and generation to different threads for all CB based pipelines #7245

[CB] Split token streaming and generation to different threads for all CB based pipelines

[CB] Split token streaming and generation to different threads for all CB based pipelines #7245

Annotations

2 errors

cpp-beam_search_causal_lm-ubuntu (python ./samples/python/text_generation/beam_search_causal_lm.py)

cancelled Jan 23, 2025 in 1m 42s