v5.16.0
Release v5.16.0
Docker Image - noobaa/noobaa-core:5.16.0
What's Changed
- Config options for disable NamespaceMonitor, MD_aggregator, Issues_report update, pg client inspect prints by @romayalon in #7663
- upgrade to node 20.9.0. ignore deprecated warnings to make nan compile. by @alphaprinz in #7660
- manage_nsfs | Generate access keys by @liranmauda in #7666
- NSFS | NC | health command exit by @naveenpaul1 in #7675
- NSFS | NC | add manage_nsfs folder to RPM build by @naveenpaul1 in #7680
- Use async-await in
test_agent_blocks_reclaimer
by @shirady in #7677 - NSFS | NC | Fix bucket policy load inline principal by @romayalon in #7676
- NSFS | NC | CLI | add filter to list by @liranmauda in #7681
- NSFS | NC | fix allow http property on config by @romayalon in #7684
- NSFS | NC | Fix Ceph S3 Tests by @shirady in #7685
- CI | Update Ceph S3 Tests (Commit Hash Number and Pending Lists) by @shirady in #7686
- NSFS | NC | fs_backend support on bucket and account config files and as config.json configuration for config dirs by @romayalon in #7679
- NC | NSFS | new_buckets_path should be optional by @naveenpaul1 in #7682
- NSFS | NC | Change Debug Level of a Message HTTP Not Enabled by @shirady in #7691
- NSFS | NC | CLI | add/update bucket policy of a bucket by @romayalon in #7678
- CI | Add a Printing to Test by @shirady in #7689
- NSFS | NC | Add global storage backend type by @romayalon in #7698
- NC | NSFS | revoking
--new_access_key
and fixing access key update issues by @liranmauda in #7697 - CI | GAP | Ceph S3 Tests by @shirady in #7687
- NSFS | NC | CLI |bucket delete leaving objects by @naveenpaul1 in #7703
- NSFS - fix some small issues by @jackyalbo in #7639
- Fix Eslint Errors by @shirady in #7706
- NSFS | NC | Add Schema Validation to Bucket and Account Add and Update (NC NSFS CLI) by @shirady in #7702
- Add experimental support for STS CLI usage by @Neon-White in #7605
- Move Versioning Definition From
bucket_api
tocommon_api
for Reuse by @shirady in #7711 - NSFS | NC add nsfs_config_schema to nsfs_schema_utils and add missing properties by @romayalon in #7713
- NSFS | NC | CLI | fix update creation_date and should_create_underlying_storage by @romayalon in #7708
- NSFS | NC | Add Schema Validation to Bucket (
bucketspace_fs
) by @shirady in #7710 - NSFS | NC | NC coretest - bug fixes - PR 1/3 by @romayalon in #7719
- NSFS | NC | NC Coretests changes - PR 2/3 by @romayalon in #7720
- NSFS | NC | Add Concurrency to
list_config_files
by @shirady in #7731 - NSFS | NC | Verify That Account Doesn’t Own Buckets before Deletion by @shirady in #7723
- Fix Eslint Errors by @shirady in #7732
- NSFS | NC | Verify IP Address When Passing IP List by @shirady in #7736
- NSFS | NC | Health script | distinguish between temporary and persistent errors by @naveenpaul1 in #7733
- NSFS | NC | Avoid vacuumAndAnalyze on nc nsfs without db by @romayalon in #7737
- NSFS | NC | Help Printing for Each Action by @shirady in #7741
- Small object buffer fix by @jackyalbo in #7609
- NSFS | NC | Verify That Bucket Owner Exists by @shirady in #7728
- NSFS | NC | Split The Error "Account config should not be empty" by @shirady in #7742
- NSFS | NC | NC github action for running nc coretests and other NSFS related tests - PR 3/3 by @romayalon in #7740
- NSFS | NC | DOCS | Setting up SSL self signed certificates docs by @romayalon in #7727
- NSFS | NC | Allow one or more buckets to use the same dir path by @naveenpaul1 in #7718
- NSFS | NC | Validate Options in Manage NSFS (CLI) by @shirady in #7743
- NSFS | NC | Health | add account uid gid can access new_buckets_path check by @naveenpaul1 in #7738
- NSFS | NC | Health | Account without new_buckets_path by @romayalon in #7748
- Fixing ESlint issues and returning some missing rules by @jackyalbo in #7751
- [ESLint Fixes] moving to @Stylistic plugin + fixes by @jackyalbo in #7761
- Update Spectrum Archive deployment guide by @tangledbytes in #7543
- Add configuration to deny upload to "STANDARD" storage class by @tangledbytes in #7725
- Noobaa/Bucket Logging : Log delivery to noobaa core by @aspandey in #7576
- NSFS | NC | Add Details to Error Message When Invalid Schema by @shirady in #7758
- Improve chunk delete performance by @tangledbytes in #7484
- NSFS | NC | Check Option Type from CLI by @shirady in #7756
- NSFS | NC | CLI | List config files performance improvement & added new filters for list accounts/buckets by @romayalon in #7745
- NSFS | NC | Health script - PR 1/2 | new_buckets_path bug fixes by @romayalon in #7765
- CI | Update Checkout Version by @shirady in #7769
- NSFS | NC | Improve Help Printings by @shirady in #7767
- NSFS | NC | Add
owner_account
to the bucket schema as a required property by @shirady in #7776 - [NSFS | NC] fix NooBaa NSFS RPM Upgrade by @tangledbytes in #7773
- NSFS | NC | Fix Bucket Creation Verification by @shirady in #7785
- NSFS | NC | CLI | Account add/update when uid = 0 and gid != 0 bug fix by @romayalon in #7788
- NSFS | NC | Health script | Add syslogng services by @naveenpaul1 in #7780
- Update dependencies by @liranmauda in #7760
- NSFS | NC | CLI | add/update account | check account has rw permissions to new buckets path by @romayalon in #7777
- NSFS | NC | Fix Check Flag Type From Manage NSFS CLI by @shirady in #7791
- CI | Jest add
workflow_dispatch
(Manual Run on master) by @shirady in #7798 - NSFS | NC | S3 Flow | Fix list buckets creation date by @romayalon in #7799
- NSFS | NC | Events | bugs & events addition to manage nsfs CLI by @naveenpaul1 in #7759
- NSFS | NC | Update Help
access_key
as Identifier of Account (Delete, Update) by @shirady in #7808 - NSFS | NC | Directories cache max total usage reduction and configuration addition to nsfs_config_schema by @romayalon in #7806
- NSFS | NC | Fix Issue with Flags Separator by @shirady in #7810
- NSFS | NC | Remove Email from NSFS Account and Bucket in manage_nsfs (CLI) by @shirady in #7801
- NSFS | NC | Remove SensitiveStrings in manage_nsfs by @shirady in #7796
- NSFS | S3 flow | BucketspaceFS - system/bucket_owner should be account name and wrap bucket name as Sensitive String by @romayalon in #7814
- convert activity logs in the object server to dbg1 by @liranmauda in #7804
- NSFS | NC | list buckets missing policy check & performance improvement by @romayalon in #7812
- Bump version to 5.16.0 by @liranmauda in #7817
- NSFS | NC | Update Docs Related to Last Changes in Manage NSFS by @shirady in #7815
- NSFS | NC | Improve Performance in
verify_bucket_owner
by @shirady in #7813 - [NC | NSFS] WAL based tape migrations and recalls by @tangledbytes in #7601
- NSFS | NC | CLI | account missing name in error message by @naveenpaul1 in #7823
- [NSFS | NC] Wal Cleanup by @tangledbytes in #7822
- [NC | NSFS] replace scan_expired with process_expired by @tangledbytes in #7825
- nodes_monitor.js | location_info.region is assigned only if it is defined by @liranmauda in #7831
- NSFS Fixes | handling too many forks exits + cleaning unwrap error in log by @jackyalbo in #7807
- logrotate : logrotate.sh is running but not rotating the logs by @aspandey in #7800
- fixed signature calculations for cpp aws-sdk by @dannyzaken in #7829
- namespace_monitor.js | Fixing the error object values to start with a lowercase by @liranmauda in #7846
- Fix CVE-2023-42282 by @liranmauda in #7850
- NSFS | Tests refactoring start by @romayalon in #7774
- NSFS | Copy rsyslog config file as regular file by @piste-jp in #7789
- NSFS | NC | Fix authorize_request_policy for from-file flows by @romayalon in #7859
- NSFS | NC | Fail nsfs.js completely on system.json failure by @romayalon in #7858
- NSFS | NC | Fix owner_account runtime object by @romayalon in #7862
- [NC | NSFS] Disallow incorrect storage classes by @tangledbytes in #7847
- Migrating to AWS SDK V3 | Following PR on a Fix That Was Added by @shirady in #7860
- NSFS | NC | Add a Flag to Change the Value of
allow_bucket_creation
by @shirady in #7827 - NSFS | NC | CI | Add architecture to RPM manual build github action by @romayalon in #7866
- NSFS | NC | Prevent Adding Additional Properties (Bucket Schema) by @shirady in #7830
- NSFS | NC | Use
--from_file
Option in Account Create by @shirady in #7779 - Fixes - GCP write not waiting for finish before resolve by @jackyalbo in #7868
- NSFS | NC | Missing Space Removal in Help by @shirady in #7878
- [NC | NSFS] Fix WAL processing failure by @tangledbytes in #7848
- NSFS | NC | Add disable dev random seed flag by @naveenpaul1 in #7864
- CI | Ceph S3 Tests | Adding Tests to
pending_list
by @shirady in #7893 - NSFS | NC | Use
--from_file
Option in Bucket Create by @shirady in #7879 - NSFS | NC | health giving trimmed output in pipe by @naveenpaul1 in #7898
- CI | NSFS | NC | Jest Tests - Change the value of
tmp_fs_path
For Concurrent Run by @shirady in #7897 - NSFS | NC | CLI | Change the
fs_context
by @shirady in #7885 - bucket_logging: Change bucket API's and functions as per schema by @aspandey in #7901
- Bucket Logging: BG worker to upload bucket logs by @aspandey in #7816
- Add system tuning hint in cases of DB query timeouts by @Neon-White in #7844
- Support delete replication flow in bucket_diff - PR 2 by @achouhan09 in #7867
- bucket_logging: Bucket log processing in side car container by @aspandey in #7837
- Bucket API Scehma: Remove "name" field from logging by @aspandey in #7903
- move node-gyp to devDependencies to avoid shipping it by @liranmauda in #7891
- NSFS | NC | Allow unset 'new_buckets_path' by @nadavMiz in #7899
- NSFS | NC | Use avj
compile
and Reusevalidate
Function by @shirady in #7887 - NSFS | NC | fix get-bucket-website function for bucketspace fs by @nadavMiz in #7904
- NSFS | NC | Manage NSFS | Remove
wide
Property from Fetch Data by @shirady in #7907 - Bump dependencies to avoid CVE by @liranmauda in #7906
- Improve docs regarding ACL support by @Neon-White in #7886
- [NSFS | NC] Simplify GLACIER xattr + minor fixes by @tangledbytes in #7895
- NSFS | NC | Account Add
new_buckets_path
As Optional in Help by @shirady in #7919 - NSFS | CLI | Delete the bucket only if the bucket is empty or with --force flag by @naveenpaul1 in #7911
- NSFS | NC | Symlinks should contain a relative path by @naveenpaul1 in #7916
- [NC] Restructure RPM Build process by @tangledbytes in #7841
- Bucket_logging: Reset rsyslogd after logrotation by @aspandey in #7923
- Fix s3_get_bucket_policy_status by @nadavMiz in #7926
- Anonymous access - add missing await to authorize_anonymous_access() by @romayalon in #7929
- NSFS | NS |
nc_coretest
userm
instead ofrmdir
by @shirady in #7922 - [NC | NSFS] Fix glacier expiry buggy test by @tangledbytes in #7937
- Bumping node from 20.9.0 to 20.11.0 by @liranmauda in #7935
- Removed the dependency on request npm module by @dannyzaken in #7925
- NSFS | Fix lstat on mac by @romayalon in #7882
- [NC | NSFS] Fix GLACIER issues by @tangledbytes in #7942
- [NC | NSFS] Improve time bounds for glacier operations by @tangledbytes in #7908
- Fix Bug BZ 2271067 | NSFS | Change Mapping in Pool Server by @shirady in #7936
- [NC | NSFS] Add basic support for write thresholds by @tangledbytes in #7943
- Bump version to 5.17.0 by @liranmauda in #7948
- NSFS | NC | CLI | Add force_md5_etag option to account and bucket by @nadavMiz in #7915
- Support delete flow for log based replication by @achouhan09 in #7739
- [NC | NSFS] Fix statfs cache size by @tangledbytes in #7951
- change bucket policy validation order in bucketspace-fs by @nadavMiz in #7946
- Bumping dependencies by @liranmauda in #7958
- NSFS | Empty 'logs' directory is getting created under 's3-config' directory by @naveenpaul1 in #7947
- Fix Bug BZ 2272900 | NSFS | Remove Issues Updates with System Store by @shirady in #7954
- [NC | NSFS] use fixed
hh:mm
for running expiry script by @tangledbytes in #7952 - NSFS | NC | Secret Keys Encryption by @romayalon in #7955
- bucket_logging: Store log objects inside log prefix directory by @aspandey in #7950
- NSFS | NC | Avoid Updating Config When No Update Property Was Sent by @shirady in #7905
- Load balancing config option to limit server.maxRequestsPerSocket and force clients to reconnect and rebalance by @guymguym in #7968
- NSFS | Improve list objects performance on top of NS FS (PR 1/3) by @naveenpaul1 in #7912
- Throw an appropriate exception when user provides an empty object version ID by @Neon-White in #7970
- Fix Bug 7941 | Fix URL Decoding for Copyobject by @shirady in #7984
- NSFS | NC | Manage NSFS | Create bucket - Add Check If Bucket Owner Has
rw_access
to Underlying Path by @shirady in #7913 - Bumping isa-l to v2.31.0 by @liranmauda in #7967
- Revert "Bumping isa-l to v2.31.0" by @liranmauda in #7985
- S3 | EncodeURIComponent / DecodeURIComponent xattr by @romayalon in #7986
- NC | Secret Keys Encryption Gaps by @romayalon in #7979
- NSFS | Add support for list multipart uploads in namespace_fs, pagination not handled by @naveenpaul1 in #7987
- NC | generate_entropy() - add dasd disks to the supported devices by @romayalon in #7994
- github stale action by @guymguym in #7990
- [NC | NSFS | Glacier] Support max restore days + auto logs dir creation by @tangledbytes in #7991
- NSFS | Add FS ENOTDIR error translation to RPC NO_SUCH_OBJECT error by @romayalon in #7995
- NSFS | NC | Removal of NSFS prefix from user facing components - service, cli, configs and events by @romayalon in #7989
- Bucket_logging: Time bound bucket logs delivery by @aspandey in #7996
- NSFS | NC | CLI Refactor Validation (Partial) by @shirady in #7917
- NC | Whitelist Server IP Fix by @romayalon in #8002
- NC | Virtual hosts configuration support by @romayalon in #8003
- NC | CLI | Restrict Access Keys chars + performance improvement by @romayalon in #8008
- Bumping dependency to avoid CVE by @liranmauda in #8010
- NSFS | Improve list objects, MAC changes in Napi by @naveenpaul1 in #8012
- NC | config.json - Remove host_customization pattern by @romayalon in #8011
- Fix ENOTSUP by falling back to meta files by @tangledbytes in #8005
- NC | UploadPart | finish_upload | stat(part-{num}) should not check ctime due to concurrency part uploads of the same part. by @romayalon in #8017
- NC | S3 Flow | Get-Bucket-Policy-Status fix by @romayalon in #8022
- NC | S3 flow | Put-Bucket-Policy Invalid Body error fix by @romayalon in #8026
- [NC | NSFS] Hourly accurate glacier expiry by @tangledbytes in #8020
- Rework S3 object version ID and marker check by @Neon-White in #8014
- NSFS | Logrotate is not performing for noobaa logs by @naveenpaul1 in #7998
- Fixed issue for wrong creation_time for non-nsfs buckets while listin… by @achouhan09 in #8021
- Backport to 5.16 by @nimrod-becker in #8088
- [Backport 5.16] [NC | NSFS | Glacier] filter out failed recalls by @tangledbytes in #8089
- [5.16] LIFECYCLE - fix issue with delete only 3K objects a day by @jackyalbo in #8092
- [Backport Into 5.16] bucket logging: Change logrotate configuration from daily to hourly by @liranmauda in #8093
- [Backport into 5.16] Implement log replication prefix filtering (#8087) by @liranmauda in #8103
- [Backport to 5.16] fix for list_objects by @dannyzaken in #8105
- [Backport to 5.16] fixed construct_url to handle ipv6 address by @dannyzaken in #8127
- [Backport to 5.16] Fixing lifecycle schema issues by @jackyalbo in #8137
- 5.16 | NC Backports by @romayalon in #8142
- [Backport to 5.16] Bumping dependency to avoid CVE by @liranmauda in #8163
Full Changelog: v5.15.0...v5.16.0