Skip to content

Conversation

zucchini-nlp
Copy link
Member

@zucchini-nlp zucchini-nlp commented Oct 9, 2025

What does this PR do?

As per title, in v5 we will start saving in the new nested format. The loading is still supported though for old-format configs

Also, we don't need an optional_attributes field that does not do what it is called. Since it is only chat template, let's just manually pop and set it. For audio tokenizers, it'd be nice to refactor a bit, I think we could try to move it in self.attributes

Fixes #40447 by deleting ambiguously named optional_attributes

@zucchini-nlp zucchini-nlp mentioned this pull request Oct 9, 2025
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: align, auto, chinese_clip, clipseg, flava, granite_speech, layoutlmv2, layoutlmv3, markuplm, mgp_str, oneformer, owlvit, speech_to_text, speecht5, vision_text_dual_encoder, wav2vec2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Processor does not load optional attributes

2 participants