v5.13.0

Release v5.13.0

What's Changed

• Bump Dependency by @Utkarsh-pro in #7070
• 👾 mdsequence bugfix by @baum in #7079
• Adding namespace STS by @liranmauda in #7074
• NSFS | Adding additional ops by @liranmauda in #7080
• Upgrade node v14 to v16 by @Utkarsh-pro in #7081
• Post nodev16 upgrade fixes by @Utkarsh-pro in #7084
• fix native MD5 calculation: Bump isa-l_crypto to 4f72976 by @Utkarsh-pro in #7088
• NSFS | Native xattr api additions by @romayalon in #7090
• Bump dependencies by @liranmauda in #7094
• NSFS | add read object op metric by @liranmauda in #7093
• Collecting FS worker stats and sending it to the to /metrics/nsfs_stats by @liranmauda in #7089
• Parse seq as int by @romayalon in #7097
• postgres client | upsert duplications fix by @romayalon in #7091
• remove sorting by version_past for Postgres by @dannyzaken in #7099
• 🧹 Fix event api export_activity_log reply schema by @baum in #7087
• Documentation for NSFS metrics flow by @liranmauda in #7098
• Bumped the version to 5.13.0 by @liranmauda in #7106
• NSFS - supporting GPFS DL for Encryption by @jackyalbo in #6973
• Allow anonymous access to object_api.list_objects by @Utkarsh-pro in #7077
• change in KeyCount field in s3 reply by @shirady in #7111
• Add a script to setup ceph account for s3 tests. by @alphaprinz in #7114
• fix for test_set_bucket_tagging by @naveenpaul1 in #7115
• NSFS | Versioning | set_bucket_versioning enablement by @romayalon in #7105
• Bump Dependencies by @liranmauda in #7116
• Pre-compiled regexp optimization by @baum in #7110
• Fix issue with signature calculation by @jackyalbo in #7104
• NSFS | Fix broken nsfs tool by @romayalon in #7121
• update tsconfig file with target es2021 by @shirady in #7123
• remove azure bucket load limit by @Utkarsh-pro in #7126
• NSFS | Versioning | Documentation by @romayalon in #7120
• Delete account should throw FORBIDDEN and not UNAUTHORIZED when it's owner of existing buckets by @romayalon in #7131
• add encoding url to list objects by @shirady in #7122
• NSFS | get_single_user_xattr() shouldnt throw in case of missing attribute by @romayalon in #7146
• node18 fixes for openssl3 by @guymguym in #7147
• Bump jsonwebtoken from 8.5.1 to 9.0.0 by @dependabot in #7138
• Bump dependencies by @liranmauda in #7149
• 🧹 Add s3perf flag documentation by @baum in #7145
• Fix test signature utils CRLF by @guymguym in #7150
• Bumping node from 16.14.0 to 18.12.1 by @liranmauda in #7152
• NSFS | add list buckets op metric by @liranmauda in #7137
• Added retry for sending the NSFS metrics by @liranmauda in #7140
• NSFS | Versioning | Safe API for POSIX + put object + complete multipart upload + copy object by @romayalon in #7119
• Adding ROOT key rotate to core by @jackyalbo in #7144
• Add a comment with gitleaks:allow by @shirady in #7157
• Ceph s3 Tests | Separate configuration from Running Tests + GitHub Action by @shirady in #7142
• Nooba bucket Logging configuration by @aspandey in #7141
• NSFS | Versioning | Implement GET/HEAD object by @v-harihar in #7133
• Add a step to cancel previous runs in GH Action by @shirady in #7159
• Update es after updating node version by @shirady in #7158
• NSFS | Versioning | Safe unlink - on error link back and not rename by @romayalon in #7160
• Ceph s3 Tests | Update Ceph S3 Tests Commit Number by @shirady in #7161
• Fix the replication scanner pagination support and add a fitting unittest by @Neon-White in #7163
• Ceph s3 Tests | Collect logs in case of failure by @shirady in #7170
• NSFS | Versioning | ENABLED | Delete object / Delete multiple objects implementation by @romayalon in #7154
• Consume secret data from a file. by @liranmauda in #7156
• Add workflow for automated NooBaa releases by @Utkarsh-pro in #7117
• Changes to all GitHub workflows - timeout, checkout v3, concurrency, general cleanup by @shirady in #7178
• Bug Fix #7166 | Change message of error in PG client by @shirady in #7167
• NSFS list_objects should only list latest objects by @v-harihar in #7168
• Remap environment variables to pre-existing secrets by @Utkarsh-pro in #7184
• NSFS | Adding metric type to the prefix + Removing the errors in the nsfs io count by @liranmauda in #7191
• Bump http-cache-semantics from 4.1.0 to 4.1.1 by @dependabot in #7194
• Fix Bug #7151 | Change the Printing From NaN to 0 (In Average Calc) by @shirady in #7202
• Fix releaser... again by @Utkarsh-pro in #7205
• Adding GCP Namespace - Phase 1 by @liranmauda in #7185
• use service certificate for rpc_http_server by @jackyalbo in #7208
• Adding crypto_utils by @liranmauda in #7216
• BZ 2168010 | Bytes used by Noobaa Bucket in Prometheus metrics by @naveenpaul1 in #7212
• Namespace GCP | Adding delete_object and upload_object by @liranmauda in #7213
• S3 Select Support by @alphaprinz in #7143
• Log based replication background worker and log parser by @Neon-White in #7124
• Namespace GCP | Adding delete multiple by @liranmauda in #7219
• System Store | Move refresh() outside of make_changes_internal() by @romayalon in #7221
• Namespace GCP | refactor upload by @liranmauda in #7224
• Namespace GCP | Adding upload_object (copy) and read object metadata by @liranmauda in #7225
• [Backport into 5.13] backporting some fixes into 5.13 by @liranmauda in #7251
• [Backport to 5.13] Fix: Log Replication Deletions on Conflicts by @liranmauda in #7254
• [Backport to 5.13] Bump dependencies by @liranmauda in #7266
• backport to 5.13 by @dannyzaken in #7272
• [Backport to 5.13] improve performance and fix lifecycle BG by @liranmauda in #7277
• [Backport to 5.13] fixing create_object_upload for namespace buckets by @jackyalbo in #7335
• 5.13 backport | NSFS | delete non existing object & GPFS lib crash by @romayalon in #7367
• [Partial backport to 5.13] perf issues: read_account + backport of check_miss revert by @jackyalbo in #7364

New Contributors

• @naveenpaul1 made their first contribution in #7115
• @aspandey made their first contribution in #7141

Full Changelog: version5.12.2...v5.13.0

v5.12.4

Release v5.12.4

What's Changed

• [Direct to 5.12] Bump dependencies to avoid CVE by @liranmauda in #7253
• [Backport to 5.12] improve performance and fix lifecycle BG by @liranmauda in #7280
• [Backport to 5.12] Fix isa-l.gyp to source the common sources explicitly in all arches by @liranmauda in #7320
• 5.12 Backport | Fix delete object when object doesn't exist by @romayalon in #7366
• [Backport to 5.12] perf issues: read_account + check_miss revert by @jackyalbo in #7368

Full Changelog: version5.12.2...v5.12.4

v5.11.0

Version Info

• Git Branch: 5.11
• Label: v5.11.0
• Images
  • docker.io/noobaa/noobaa-core:5.11.0
  • quay.io/noobaa/noobaa-core:5.11.0

Features

• NSFS Bug Fixes
• Added support for Lifecycle policy for object expiration

What's Changed

• Fix complete_object_multiparts on empty part list by @jackyalbo in #6855
• fix chunked upload by @romayalon in #6854
• Initial STS support by @romayalon in #6838
• add 5.10 to build on changes by @nimrod-becker in #6860
• Switch to CentOS Stream 8 as base image by @DanielSel in #6866
• Bucket lifecycle rule creation policies compatibility with aws new API by @liranmauda in #6849
• Bump node version to 14.18.2 by @nimrod-becker in #6871
• lifecycle - remove unwrap from the logs by @liranmauda in #6874
• Bump npm dependencies to avoid CVE by @liranmauda in #6875
• Fixing NSFS semaphore leak by @jeniawhite in #6868
• Fixing issue of NOENT when uploading object to deleted sub-dir by @jackyalbo in #6879
• Adapting OP_NAME_TO_ACTION to parse_op capitalization regarding uploadId by @jackyalbo in #6882
• Add support to content_encoding by @jackyalbo in #6881
• STS | Session tokens generation and parsing by @romayalon in #6859
• Disable NSFS md5 calculation by @romayalon in #6891
• Fix endpoint hanging by @romayalon in #6894
• Defer MD5 calculation and assignment of the azure blob upload to prevent upload blocking by @Utkarsh-pro in #6886
• Fix blob error codes extraction by @romayalon in #6903
• Fixing issue with sorting by wrong fields - leads to very slow object listing by @jackyalbo in #6909
• Performance improvements to md_aggregator in postgres by @jackyalbo in #6905
• Fix parallel bucket creation by @romayalon in #6911
• Calling dnf update with --nobest flag by @liranmauda in #6927
• Chunk fs | EINVAL error when writing more than 1024 buffers at one writev fix by @romayalon in #6928
• Adding minimal support for GPFS dynamic library by @jackyalbo in #6933
• Lifecycle feature enhancements by @baum in #6919
• Fix lifecycle size interval by @baum in #6946
• Set postgres collation default to C - fixing BZ 2068110 by @jackyalbo in #6931
• Bump minimist from 1.2.5 to 1.2.6 by @dependabot in #6939
• Bump moment from 2.29.1 to 2.29.2 by @dependabot in #6936
• Bump core dependencies by @liranmauda in #6951
• Bump version to 5.11 by @liranmauda in #6954
• Backport to 5.11 by @nimrod-becker in #6960
• Backport to 5.11 by @nimrod-becker in #6966
• [Backport to 5.11] Remove FE by @liranmauda in #6970
• [backport to 5.11] fixed err\warn messages with log0 level by @dannyzaken in #6976
• Backport to 5.11: stringify error codes before update_issues_report by @nimrod-becker in #6979
• [backport to 5.11] better handling of nodes_monitor nodes validity tests by @dannyzaken in #6984
• Backport to 5.11: Adding jemalloc to docker build by @nimrod-becker in #7001
• [Backport to 5.11] Bump moment from 2.29.3 to 2.29.4 by @liranmauda in #7021
• [BACKPORT to 4.11] | fix postgres unique indexes by @romayalon in #7045
• [Backport to 5.11] fix small mem leaks that accumulate by @nimrod-becker in #7048

New Contributors

• @DanielSel made their first contribution in #6866

Full Changelog: v5.10.1...v5.11.0

v5.10.1

Version Info:

• Git Branch: 5.10
• Label: v5.10.1
• Docker hub image
  • docker.io/noobaa/noobaa-core:5.10.1
  • quay.io/noobaa/noobaa-core:5.10.1

Features

• Postgres indexes improvements
• NSFS Bug Fixes
• Added support of STS for authentication in S3 cloud resources

v5.9.0

Version Info:

• Git Branch: 5.9
• Label: v5.9.0
• Docker hub image
  • docker.io/noobaa/noobaa-core:5.9.0
  • quay.io/noobaa/noobaa-core:5.9.0

Additions:

• Bucket Replication
• NSFS (Namespace Filesystem) GA

v5.8.0

Golden Axe
Version Info:

• Git Branch: 5.8
• Label: v5.8.0
• Docker hub image: noobaa/noobaa-core:5.8.0

Additions:

• NSFS (Namespace Filesystem) POC

v5.7.0

Frogger
Version Info:

• Git Branch: 5.7
• Label: v5.7.0
• Docker hub image: noobaa/noobaa-core:5.7.0

Additions:

• Added infrastructure to support different databases as the MD database via DBClient interface
• Added DBClient implementation for Postgresql.
• Support KMS for saving master encryption keys
• Initial support for namespace FS

v5.6

EarthBound
Version Info:

• Git Branch: 5.6
• Label: v5.6.0
• Docker hub image: noobaa/noobaa-core:5.6.0

Additions:

• NS CACHE (Caching Policy for Namespace buckets)
• Add secrets encryption capability (no rotation for this version)
• Add multiarch support (Z and Power
• NS on Azure multiple fixes

Internal:

• npm dependencies bump
• Replace most call sites of bluebird with native promise
• Support multiple prometheus reports from the same pod (Core, BG, Hosted etc.)

v5.5 'Digger'

Digger
Version Info:

• Git Branch: 5.5
• Label:
• Docker hub image:

Additions:

• Block deletions of accounts that are an owner of any bucket
• Allow using podman as docker-engine
• Add support for FIPS, use only crypto validated algorithms
• Allow querying the state of the system via an API call

Internal:

• Refactor RPCs calls that create tokens without account and fail on S3 access.
• Bump NPM deps
• Performance inmprovement on RPC requests handling
• Fixing multipart upload for NS bucket when using Azure NS Resource
• Refactor PV Pools , move logic to operator
• Adding accounts cache to S3 endpoints
• Divide dnf update and dnf install to 2 layers
• Add a lock on the load semaphore during make_changes

Fixes:
NOOBAA Functions - Trigger Event not produced #5992
Incorrect error returned if a user tries to recreate a bucket #5980
fixing 2 issues with namespace bucket on s3 #5963
Storage agent on Infinidat NFS fails to start due to read-only .snapshot folder #5940
(GAP) Namespace - Upload (multipart) to Azure blob not working #4203
List bucket for Gateway bucket fails if one of the namespace resources returns error #3671
#3568

Fix OnRelease handling when outside certain models https://bugzilla.redhat.com/show_bug.cgi?id=1811709
Fix diagnostics collection https://bugzilla.redhat.com/show_bug.cgi?id=1815088
Allow disabling compression in pipeline https://bugzilla.redhat.com/show_bug.cgi?id=1791328
Fixing backing store validity test https://bugzilla.redhat.com/show_bug.cgi?id=1827317
Restrict user privileges in Noobaa console - to OCP admins https://bugzilla.redhat.com/show_bug.cgi?id=1833030
Remove aws access key and secret in log file https://bugzilla.redhat.com/show_bug.cgi?id=1846759
Check in system_store on delete and update that ID exists https://bugzilla.redhat.com/show_bug.cgi?id=1839117

v5.4 'Catacomb'

Catacomb
Version Info:

• Git Branch: 5.4
• Label: 5.4.0
• Docker hub image: noobaa/noobaa-core:5.4.0

Additions:

Internal:

• Prevent updating endpoint group if no actual changes were made / happened

Fixes:
Validation of maximal k8s nodes & pv pool name https://bugzilla.redhat.com/show_bug.cgi?id=1813656
Add oauth access denied model https://bugzilla.redhat.com/show_bug.cgi?id=1810034
Fix deletion of backingstore https://bugzilla.redhat.com/show_bug.cgi?id=1817978