Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Release_v2150] Update ReleaseNotes.md #3214

Conversation

nikita-malininn
Copy link
Collaborator

Changes

  • Added v2.15.0 template;

Reason for changes

  • Upcoming release;

Related tickets

  • 161230;

For the contributors:

Please add your changes (as the commit to the branch) to the list according to the template and previous notes;
Do not add tests-related notes;
Provide the list of the PRs (for all your notes) in the comment for the discussion;

@nikita-malininn
Copy link
Collaborator Author

@alexsu52, @ljaljushkin, @l-bat, @nikita-savelyevv, @andreyanufr, @andrey-churkin, @daniil-lyakhov, @kshpv, @AlexanderDokuchaev, @anzr299 fill the document with your changes for the upcoming release, please.

@ljaljushkin ljaljushkin removed their assignment Jan 27, 2025
@ljaljushkin
Copy link
Contributor

no changes from my side

@MaximProshin
Copy link
Collaborator

@andrey-churkin , please add the deprecation note about create_compressed_model() in TF among the description of the related changes and the reference to the example.

@MaximProshin
Copy link
Collaborator

@l-bat , please update the list of new/updated notebooks with NNCF support. Here is a draft list from my side (to be confirmed):
openvinotoolkit/openvino_notebooks#2572
openvinotoolkit/openvino_notebooks#2619
openvinotoolkit/openvino_notebooks#2673
openvinotoolkit/openvino_notebooks#2663
openvinotoolkit/openvino_notebooks#2683
openvinotoolkit/openvino_notebooks#2686
openvinotoolkit/openvino_notebooks#2696

ReleaseNotes.md Outdated
Comment on lines 16 to 18
- Significantly faster data-free weight compression for OpenVINO models: INT4 compression is now up to 10x faster, while INT8 compression is up to 3x faster. The larger the model the higher the time reduction.
- AWQ weight compression is now up to 2x faster, improving overall runtime efficiency.
- Peak memory usage during INT4 data-free weight compression in the OpenVINO backend is reduced up to 50% for certain models.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@andreyanufr
Copy link
Collaborator

no changes from my side

ReleaseNotes.md Outdated
- General:
- ...
- Features:
- (TorchFX, Experimental) Preview support for the new `quantize_pt2e` API has been introduced, enabling quantization of `torch.fx.GraphModule` models with the `OpenVINOQuantizer` and the `X86InductorQuantizer` quantizers. `quantize_pt2e` API utilizes `MinMax` algorithm statistic collectors, as well as `SmoothQuant`, `BiasCorrection` and `FastBiasCorrection` Post-Training Quantization algorithms.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator

@anzr299 anzr299 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No changes from me

ReleaseNotes.md Outdated
- ...
- Features:
- (TorchFX, Experimental) Preview support for the new `quantize_pt2e` API has been introduced, enabling quantization of `torch.fx.GraphModule` models with the `OpenVINOQuantizer` and the `X86InductorQuantizer` quantizers. `quantize_pt2e` API utilizes `MinMax` algorithm statistic collectors, as well as `SmoothQuant`, `BiasCorrection` and `FastBiasCorrection` Post-Training Quantization algorithms.
- (TensorFlow) The `nncf.quantize()` method is now the recommended way for the quantization initialization for Quantization-Aware Training. Please refer to an [example](examples/quantization_aware_training/tensorflow/mobilenet_v2) for more details about how to use new approach.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

- AWQ weight compression is now up to 2x faster, improving overall runtime efficiency.
- Peak memory usage during INT4 data-free weight compression in the OpenVINO backend is reduced up to 50% for certain models.
- Deprecations/Removals:
- (TensorFlow) The `nncf.tensorflow.create_compressed_model()` method is now marked as deprecated. Please use the `nncf.quantize()` method for the quantization initialization.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ReleaseNotes.md Outdated
- Features:
- (TorchFX, Experimental) Preview support for the new `quantize_pt2e` API has been introduced, enabling quantization of `torch.fx.GraphModule` models with the `OpenVINOQuantizer` and the `X86InductorQuantizer` quantizers. `quantize_pt2e` API utilizes `MinMax` algorithm statistic collectors, as well as `SmoothQuant`, `BiasCorrection` and `FastBiasCorrection` Post-Training Quantization algorithms.
- (TensorFlow) The `nncf.quantize()` method is now the recommended way for the quantization initialization for Quantization-Aware Training. Please refer to an [example](examples/quantization_aware_training/tensorflow/mobilenet_v2) for more details about how to use new approach.
- (TensorFlow) Compression layers placement in the model now can be serialized and restored with new API functions: `nncf.tensorflow.get_config()` and `nncf.tensorflow.load_from_config()`. Please see [documentation](/docs/usage/training_time_compression/quantization_aware_training/Usage.md#saving-and-loading-compressed-models) for the saving/loading of a quantized model for more details.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@andrey-churkin andrey-churkin self-requested a review January 31, 2025 18:48
Copy link
Contributor

@alexsu52 alexsu52 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

ReleaseNotes.md Outdated
- ...
- Features:
- (TorchFX, Experimental) Preview support for the new `quantize_pt2e` API has been introduced, enabling quantization of `torch.fx.GraphModule` models with the `OpenVINOQuantizer` and the `X86InductorQuantizer` quantizers. `quantize_pt2e` API utilizes `MinMax` algorithm statistic collectors, as well as `SmoothQuant`, `BiasCorrection` and `FastBiasCorrection` Post-Training Quantization algorithms.
- (TensorFlow) The `nncf.quantize()` method is now the recommended way for the quantization initialization for Quantization-Aware Training. Please refer to an [example](examples/quantization_aware_training/tensorflow/mobilenet_v2) for more details about how to use new approach.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- (TensorFlow) The `nncf.quantize()` method is now the recommended way for the quantization initialization for Quantization-Aware Training. Please refer to an [example](examples/quantization_aware_training/tensorflow/mobilenet_v2) for more details about how to use new approach.
- (TensorFlow) The `nncf.quantize()` method is now the recommended API for Quantization-Aware Training. Please refer to an [example](examples/quantization_aware_training/tensorflow/mobilenet_v2) for more details about how to use new approach.

@nikita-malininn
Copy link
Collaborator Author

@MaximProshin, release notes are ready for review.

@nikita-malininn nikita-malininn merged commit 80bd756 into openvinotoolkit:release_v2150 Feb 3, 2025
3 checks passed
nikita-malininn added a commit to nikita-malininn/nncf that referenced this pull request Feb 3, 2025
### Changes

- Added v2.15.0 template;

### Reason for changes

- Upcoming release;

### Related tickets

- 161230;

#### For the contributors:
Please add your changes (as the commit to the branch) to the list
according to the template and previous notes;
Do not add tests-related notes;
Provide the list of the PRs (for all your notes) in the comment for the
discussion;

---------

Co-authored-by: Liubov Talamanova <[email protected]>
Co-authored-by: Nikita Savelyev <[email protected]>
Co-authored-by: Alexander Dokuchaev <[email protected]>
Co-authored-by: Daniil Lyakhov <[email protected]>
Co-authored-by: Andrey Churkin <[email protected]>
(cherry picked from commit 80bd756)
nikita-malininn added a commit that referenced this pull request Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation release target
Projects
None yet
Development

Successfully merging this pull request may close these issues.