AttributeError: 'Bonito' object has no attribute 'llm_engine'

[yangboz]

after using python3.9 , torch2.5.1 to install bonito Version: 0.0.2.

running

# Generate synthetic instruction tuning dataset
sampling_params = SamplingParams(max_tokens=256, top_p=0.95, temperature=0.5, n=1)
synthetic_dataset = bonito.generate_tasks(
    unannotated_text,
    context_col=context_column,
    task_type=task_type,
    sampling_params=sampling_params
)

it throws

 ImportError: cannot import name 'SamplingParams' from 'bonito'

any idea? thanks.

[yangboz]

sorry , found sampleingParams in vllm, but after that , still meets

AttributeError: 'Bonito' object has no attribute 'llm_engine'

more

RuntimeError: Failed to infer device type
Exception ignored in: <function LLM.__del__ at 0x7f7e0ddf59d0>
Traceback (most recent call last):
  File "/home/toyou/anaconda3/envs/py39/lib/python3.9/site-packages/vllm/entrypoints/llm.py", line 236, in __del__
    if self.llm_engine and hasattr(self.llm_engine, "shutdown"):

[davidnewman02]

to install bonito Version: 0.0.2.

The latest bonito version is v0.8.1; please ensure you are installing ont-bonito this project is unaffiliated with BatsResearch group .

Please create a new venv and attempt the installation from scratch.

[yangboz]

to install bonito Version: 0.0.2.

The latest bonito version is v0.8.1; please ensure you are installing ont-bonito this project is unaffiliated with BatsResearch group .

Please create a new venv and attempt the installation from scratch.

let me have a try at first. thanks.