Skip to content

v5.16.0

Compare
Choose a tag to compare
@tangledbytes tangledbytes released this 18 Jul 13:57
· 529 commits to master since this release
v5.16.0
0910e00

Release v5.16.0

Docker Image - noobaa/noobaa-core:5.16.0

What's Changed

  • Config options for disable NamespaceMonitor, MD_aggregator, Issues_report update, pg client inspect prints by @romayalon in #7663
  • upgrade to node 20.9.0. ignore deprecated warnings to make nan compile. by @alphaprinz in #7660
  • manage_nsfs | Generate access keys by @liranmauda in #7666
  • NSFS | NC | health command exit by @naveenpaul1 in #7675
  • NSFS | NC | add manage_nsfs folder to RPM build by @naveenpaul1 in #7680
  • Use async-await in test_agent_blocks_reclaimer by @shirady in #7677
  • NSFS | NC | Fix bucket policy load inline principal by @romayalon in #7676
  • NSFS | NC | CLI | add filter to list by @liranmauda in #7681
  • NSFS | NC | fix allow http property on config by @romayalon in #7684
  • NSFS | NC | Fix Ceph S3 Tests by @shirady in #7685
  • CI | Update Ceph S3 Tests (Commit Hash Number and Pending Lists) by @shirady in #7686
  • NSFS | NC | fs_backend support on bucket and account config files and as config.json configuration for config dirs by @romayalon in #7679
  • NC | NSFS | new_buckets_path should be optional by @naveenpaul1 in #7682
  • NSFS | NC | Change Debug Level of a Message HTTP Not Enabled by @shirady in #7691
  • NSFS | NC | CLI | add/update bucket policy of a bucket by @romayalon in #7678
  • CI | Add a Printing to Test by @shirady in #7689
  • NSFS | NC | Add global storage backend type by @romayalon in #7698
  • NC | NSFS | revoking --new_access_key and fixing access key update issues by @liranmauda in #7697
  • CI | GAP | Ceph S3 Tests by @shirady in #7687
  • NSFS | NC | CLI |bucket delete leaving objects by @naveenpaul1 in #7703
  • NSFS - fix some small issues by @jackyalbo in #7639
  • Fix Eslint Errors by @shirady in #7706
  • NSFS | NC | Add Schema Validation to Bucket and Account Add and Update (NC NSFS CLI) by @shirady in #7702
  • Add experimental support for STS CLI usage by @Neon-White in #7605
  • Move Versioning Definition From bucket_api to common_api for Reuse by @shirady in #7711
  • NSFS | NC add nsfs_config_schema to nsfs_schema_utils and add missing properties by @romayalon in #7713
  • NSFS | NC | CLI | fix update creation_date and should_create_underlying_storage by @romayalon in #7708
  • NSFS | NC | Add Schema Validation to Bucket (bucketspace_fs) by @shirady in #7710
  • NSFS | NC | NC coretest - bug fixes - PR 1/3 by @romayalon in #7719
  • NSFS | NC | NC Coretests changes - PR 2/3 by @romayalon in #7720
  • NSFS | NC | Add Concurrency to list_config_files by @shirady in #7731
  • NSFS | NC | Verify That Account Doesn’t Own Buckets before Deletion by @shirady in #7723
  • Fix Eslint Errors by @shirady in #7732
  • NSFS | NC | Verify IP Address When Passing IP List by @shirady in #7736
  • NSFS | NC | Health script | distinguish between temporary and persistent errors by @naveenpaul1 in #7733
  • NSFS | NC | Avoid vacuumAndAnalyze on nc nsfs without db by @romayalon in #7737
  • NSFS | NC | Help Printing for Each Action by @shirady in #7741
  • Small object buffer fix by @jackyalbo in #7609
  • NSFS | NC | Verify That Bucket Owner Exists by @shirady in #7728
  • NSFS | NC | Split The Error "Account config should not be empty" by @shirady in #7742
  • NSFS | NC | NC github action for running nc coretests and other NSFS related tests - PR 3/3 by @romayalon in #7740
  • NSFS | NC | DOCS | Setting up SSL self signed certificates docs by @romayalon in #7727
  • NSFS | NC | Allow one or more buckets to use the same dir path by @naveenpaul1 in #7718
  • NSFS | NC | Validate Options in Manage NSFS (CLI) by @shirady in #7743
  • NSFS | NC | Health | add account uid gid can access new_buckets_path check by @naveenpaul1 in #7738
  • NSFS | NC | Health | Account without new_buckets_path by @romayalon in #7748
  • Fixing ESlint issues and returning some missing rules by @jackyalbo in #7751
  • [ESLint Fixes] moving to @Stylistic plugin + fixes by @jackyalbo in #7761
  • Update Spectrum Archive deployment guide by @tangledbytes in #7543
  • Add configuration to deny upload to "STANDARD" storage class by @tangledbytes in #7725
  • Noobaa/Bucket Logging : Log delivery to noobaa core by @aspandey in #7576
  • NSFS | NC | Add Details to Error Message When Invalid Schema by @shirady in #7758
  • Improve chunk delete performance by @tangledbytes in #7484
  • NSFS | NC | Check Option Type from CLI by @shirady in #7756
  • NSFS | NC | CLI | List config files performance improvement & added new filters for list accounts/buckets by @romayalon in #7745
  • NSFS | NC | Health script - PR 1/2 | new_buckets_path bug fixes by @romayalon in #7765
  • CI | Update Checkout Version by @shirady in #7769
  • NSFS | NC | Improve Help Printings by @shirady in #7767
  • NSFS | NC | Add owner_account to the bucket schema as a required property by @shirady in #7776
  • [NSFS | NC] fix NooBaa NSFS RPM Upgrade by @tangledbytes in #7773
  • NSFS | NC | Fix Bucket Creation Verification by @shirady in #7785
  • NSFS | NC | CLI | Account add/update when uid = 0 and gid != 0 bug fix by @romayalon in #7788
  • NSFS | NC | Health script | Add syslogng services by @naveenpaul1 in #7780
  • Update dependencies by @liranmauda in #7760
  • NSFS | NC | CLI | add/update account | check account has rw permissions to new buckets path by @romayalon in #7777
  • NSFS | NC | Fix Check Flag Type From Manage NSFS CLI by @shirady in #7791
  • CI | Jest add workflow_dispatch (Manual Run on master) by @shirady in #7798
  • NSFS | NC | S3 Flow | Fix list buckets creation date by @romayalon in #7799
  • NSFS | NC | Events | bugs & events addition to manage nsfs CLI by @naveenpaul1 in #7759
  • NSFS | NC | Update Help access_key as Identifier of Account (Delete, Update) by @shirady in #7808
  • NSFS | NC | Directories cache max total usage reduction and configuration addition to nsfs_config_schema by @romayalon in #7806
  • NSFS | NC | Fix Issue with Flags Separator by @shirady in #7810
  • NSFS | NC | Remove Email from NSFS Account and Bucket in manage_nsfs (CLI) by @shirady in #7801
  • NSFS | NC | Remove SensitiveStrings in manage_nsfs by @shirady in #7796
  • NSFS | S3 flow | BucketspaceFS - system/bucket_owner should be account name and wrap bucket name as Sensitive String by @romayalon in #7814
  • convert activity logs in the object server to dbg1 by @liranmauda in #7804
  • NSFS | NC | list buckets missing policy check & performance improvement by @romayalon in #7812
  • Bump version to 5.16.0 by @liranmauda in #7817
  • NSFS | NC | Update Docs Related to Last Changes in Manage NSFS by @shirady in #7815
  • NSFS | NC | Improve Performance in verify_bucket_owner by @shirady in #7813
  • [NC | NSFS] WAL based tape migrations and recalls by @tangledbytes in #7601
  • NSFS | NC | CLI | account missing name in error message by @naveenpaul1 in #7823
  • [NSFS | NC] Wal Cleanup by @tangledbytes in #7822
  • [NC | NSFS] replace scan_expired with process_expired by @tangledbytes in #7825
  • nodes_monitor.js | location_info.region is assigned only if it is defined by @liranmauda in #7831
  • NSFS Fixes | handling too many forks exits + cleaning unwrap error in log by @jackyalbo in #7807
  • logrotate : logrotate.sh is running but not rotating the logs by @aspandey in #7800
  • fixed signature calculations for cpp aws-sdk by @dannyzaken in #7829
  • namespace_monitor.js | Fixing the error object values to start with a lowercase by @liranmauda in #7846
  • Fix CVE-2023-42282 by @liranmauda in #7850
  • NSFS | Tests refactoring start by @romayalon in #7774
  • NSFS | Copy rsyslog config file as regular file by @piste-jp in #7789
  • NSFS | NC | Fix authorize_request_policy for from-file flows by @romayalon in #7859
  • NSFS | NC | Fail nsfs.js completely on system.json failure by @romayalon in #7858
  • NSFS | NC | Fix owner_account runtime object by @romayalon in #7862
  • [NC | NSFS] Disallow incorrect storage classes by @tangledbytes in #7847
  • Migrating to AWS SDK V3 | Following PR on a Fix That Was Added by @shirady in #7860
  • NSFS | NC | Add a Flag to Change the Value of allow_bucket_creation by @shirady in #7827
  • NSFS | NC | CI | Add architecture to RPM manual build github action by @romayalon in #7866
  • NSFS | NC | Prevent Adding Additional Properties (Bucket Schema) by @shirady in #7830
  • NSFS | NC | Use --from_file Option in Account Create by @shirady in #7779
  • Fixes - GCP write not waiting for finish before resolve by @jackyalbo in #7868
  • NSFS | NC | Missing Space Removal in Help by @shirady in #7878
  • [NC | NSFS] Fix WAL processing failure by @tangledbytes in #7848
  • NSFS | NC | Add disable dev random seed flag by @naveenpaul1 in #7864
  • CI | Ceph S3 Tests | Adding Tests to pending_list by @shirady in #7893
  • NSFS | NC | Use --from_file Option in Bucket Create by @shirady in #7879
  • NSFS | NC | health giving trimmed output in pipe by @naveenpaul1 in #7898
  • CI | NSFS | NC | Jest Tests - Change the value of tmp_fs_path For Concurrent Run by @shirady in #7897
  • NSFS | NC | CLI | Change the fs_context by @shirady in #7885
  • bucket_logging: Change bucket API's and functions as per schema by @aspandey in #7901
  • Bucket Logging: BG worker to upload bucket logs by @aspandey in #7816
  • Add system tuning hint in cases of DB query timeouts by @Neon-White in #7844
  • Support delete replication flow in bucket_diff - PR 2 by @achouhan09 in #7867
  • bucket_logging: Bucket log processing in side car container by @aspandey in #7837
  • Bucket API Scehma: Remove "name" field from logging by @aspandey in #7903
  • move node-gyp to devDependencies to avoid shipping it by @liranmauda in #7891
  • NSFS | NC | Allow unset 'new_buckets_path' by @nadavMiz in #7899
  • NSFS | NC | Use avj compile and Reuse validate Function by @shirady in #7887
  • NSFS | NC | fix get-bucket-website function for bucketspace fs by @nadavMiz in #7904
  • NSFS | NC | Manage NSFS | Remove wide Property from Fetch Data by @shirady in #7907
  • Bump dependencies to avoid CVE by @liranmauda in #7906
  • Improve docs regarding ACL support by @Neon-White in #7886
  • [NSFS | NC] Simplify GLACIER xattr + minor fixes by @tangledbytes in #7895
  • NSFS | NC | Account Add new_buckets_path As Optional in Help by @shirady in #7919
  • NSFS | CLI | Delete the bucket only if the bucket is empty or with --force flag by @naveenpaul1 in #7911
  • NSFS | NC | Symlinks should contain a relative path by @naveenpaul1 in #7916
  • [NC] Restructure RPM Build process by @tangledbytes in #7841
  • Bucket_logging: Reset rsyslogd after logrotation by @aspandey in #7923
  • Fix s3_get_bucket_policy_status by @nadavMiz in #7926
  • Anonymous access - add missing await to authorize_anonymous_access() by @romayalon in #7929
  • NSFS | NS | nc_coretest use rm instead of rmdir by @shirady in #7922
  • [NC | NSFS] Fix glacier expiry buggy test by @tangledbytes in #7937
  • Bumping node from 20.9.0 to 20.11.0 by @liranmauda in #7935
  • Removed the dependency on request npm module by @dannyzaken in #7925
  • NSFS | Fix lstat on mac by @romayalon in #7882
  • [NC | NSFS] Fix GLACIER issues by @tangledbytes in #7942
  • [NC | NSFS] Improve time bounds for glacier operations by @tangledbytes in #7908
  • Fix Bug BZ 2271067 | NSFS | Change Mapping in Pool Server by @shirady in #7936
  • [NC | NSFS] Add basic support for write thresholds by @tangledbytes in #7943
  • Bump version to 5.17.0 by @liranmauda in #7948
  • NSFS | NC | CLI | Add force_md5_etag option to account and bucket by @nadavMiz in #7915
  • Support delete flow for log based replication by @achouhan09 in #7739
  • [NC | NSFS] Fix statfs cache size by @tangledbytes in #7951
  • change bucket policy validation order in bucketspace-fs by @nadavMiz in #7946
  • Bumping dependencies by @liranmauda in #7958
  • NSFS | Empty 'logs' directory is getting created under 's3-config' directory by @naveenpaul1 in #7947
  • Fix Bug BZ 2272900 | NSFS | Remove Issues Updates with System Store by @shirady in #7954
  • [NC | NSFS] use fixed hh:mm for running expiry script by @tangledbytes in #7952
  • NSFS | NC | Secret Keys Encryption by @romayalon in #7955
  • bucket_logging: Store log objects inside log prefix directory by @aspandey in #7950
  • NSFS | NC | Avoid Updating Config When No Update Property Was Sent by @shirady in #7905
  • Load balancing config option to limit server.maxRequestsPerSocket and force clients to reconnect and rebalance by @guymguym in #7968
  • NSFS | Improve list objects performance on top of NS FS (PR 1/3) by @naveenpaul1 in #7912
  • Throw an appropriate exception when user provides an empty object version ID by @Neon-White in #7970
  • Fix Bug 7941 | Fix URL Decoding for Copyobject by @shirady in #7984
  • NSFS | NC | Manage NSFS | Create bucket - Add Check If Bucket Owner Has rw_access to Underlying Path by @shirady in #7913
  • Bumping isa-l to v2.31.0 by @liranmauda in #7967
  • Revert "Bumping isa-l to v2.31.0" by @liranmauda in #7985
  • S3 | EncodeURIComponent / DecodeURIComponent xattr by @romayalon in #7986
  • NC | Secret Keys Encryption Gaps by @romayalon in #7979
  • NSFS | Add support for list multipart uploads in namespace_fs, pagination not handled by @naveenpaul1 in #7987
  • NC | generate_entropy() - add dasd disks to the supported devices by @romayalon in #7994
  • github stale action by @guymguym in #7990
  • [NC | NSFS | Glacier] Support max restore days + auto logs dir creation by @tangledbytes in #7991
  • NSFS | Add FS ENOTDIR error translation to RPC NO_SUCH_OBJECT error by @romayalon in #7995
  • NSFS | NC | Removal of NSFS prefix from user facing components - service, cli, configs and events by @romayalon in #7989
  • Bucket_logging: Time bound bucket logs delivery by @aspandey in #7996
  • NSFS | NC | CLI Refactor Validation (Partial) by @shirady in #7917
  • NC | Whitelist Server IP Fix by @romayalon in #8002
  • NC | Virtual hosts configuration support by @romayalon in #8003
  • NC | CLI | Restrict Access Keys chars + performance improvement by @romayalon in #8008
  • Bumping dependency to avoid CVE by @liranmauda in #8010
  • NSFS | Improve list objects, MAC changes in Napi by @naveenpaul1 in #8012
  • NC | config.json - Remove host_customization pattern by @romayalon in #8011
  • Fix ENOTSUP by falling back to meta files by @tangledbytes in #8005
  • NC | UploadPart | finish_upload | stat(part-{num}) should not check ctime due to concurrency part uploads of the same part. by @romayalon in #8017
  • NC | S3 Flow | Get-Bucket-Policy-Status fix by @romayalon in #8022
  • NC | S3 flow | Put-Bucket-Policy Invalid Body error fix by @romayalon in #8026
  • [NC | NSFS] Hourly accurate glacier expiry by @tangledbytes in #8020
  • Rework S3 object version ID and marker check by @Neon-White in #8014
  • NSFS | Logrotate is not performing for noobaa logs by @naveenpaul1 in #7998
  • Fixed issue for wrong creation_time for non-nsfs buckets while listin… by @achouhan09 in #8021
  • Backport to 5.16 by @nimrod-becker in #8088
  • [Backport 5.16] [NC | NSFS | Glacier] filter out failed recalls by @tangledbytes in #8089
  • [5.16] LIFECYCLE - fix issue with delete only 3K objects a day by @jackyalbo in #8092
  • [Backport Into 5.16] bucket logging: Change logrotate configuration from daily to hourly by @liranmauda in #8093
  • [Backport into 5.16] Implement log replication prefix filtering (#8087) by @liranmauda in #8103
  • [Backport to 5.16] fix for list_objects by @dannyzaken in #8105
  • [Backport to 5.16] fixed construct_url to handle ipv6 address by @dannyzaken in #8127
  • [Backport to 5.16] Fixing lifecycle schema issues by @jackyalbo in #8137
  • 5.16 | NC Backports by @romayalon in #8142
  • [Backport to 5.16] Bumping dependency to avoid CVE by @liranmauda in #8163

Full Changelog: v5.15.0...v5.16.0