[BFCL] multi_turn_base_2 question clarification

[kevins981]

Hi Gorilla/BFCL contributors,

First of all, thank you for your work! I found BFCL very smooth to setup and use :)

A quick question on multi_turn_base_2:
The initial config of the filesystem has the directory /simona/documents. However, the first question asks the model to "Go into document folder...".

Is the directory name mismatch intentional here, i.e. the model is expected to figure out that the user actually meant documents?

Best regards,
Kevin

[HuanzhiMao]

Hey Kevin,

Thank you for the kind words and for trying out BFCL!

We aim to keep user queries as close to real-life scenarios as possible while still providing a reasonable challenge. If the prompt were something like “x is 1, y is 2,” it wouldn’t be very engaging— the model could simply copy the query to generate a function call.

That said, precision does matter in certain cases. For instance, there’s a clear difference between TeamNotes.txt and TeamNote.txt when creating a new file, so we make sure to emphasize clarity where it’s crucial.

Regarding the specific prompt you mentioned:

Go into document folder and Could you create a document titled 'TeamNotes.txt' for keeping track of all the fresh ideas?

Here, 'TeamNotes.txt' is quoted to indicate that it should be used exactly as written, whereas “document” isn’t. Our intention is for the model to explore the backend system and infer that “document folder” refers to documents from context, especially given that it’s common practice to say “go to the document folder” even if the actual folder is named Documents (or has an added ‘s’).

We appreciate your feedback, and would love to know what you think about it.