Skip to content

Remove deprecated Local metadata server and config options #3350

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

pcholakov
Copy link
Contributor

@pcholakov pcholakov commented Jun 3, 2025

IMPORTANT: This should only be merged once we are ready to release 1.4.0

Something I've noticed is that we don't fail with an error if a value is specified for an enum-based property, which cannot be resolved to any particular variant - this was not introduced by this change but I was surprised to discover that e.g. # [metadata-client] type = "foo" just silently reverts to the default (e.g. replicated following this change).

Defaults are unchanged:

[metadata-server]
request-queue-length = 32
rocksdb-memory-budget = "29.2 MiB"
rocksdb-memory-ratio = 0.009999999776482582
rocksdb-disable-direct-io-for-reads = true
rocksdb-disable-direct-io-for-flush-and-compactions = true
rocksdb-disable-wal = false
rocksdb-disable-statistics = false
rocksdb-max-background-jobs = 14
rocksdb-compaction-readahead-size = "1.9 MiB"
rocksdb-statistics-level = "except-timers"
rocksdb-log-level = "error"
rocksdb-log-keep-file-num = 1
rocksdb-log-max-file-size = "61.0 MiB"
rocksdb-block-size = "64.0 KiB"
raft-election-tick = 10
raft-heartbeat-tick = 2
raft-tick-interval = "100ms"
status-update-interval = "5s"
log-trim-threshold = 1000

We still detect potential misconfiguration if a user runs the metadata-server role with one of the non-native client types:

2025-06-03T20:12:53.446686Z ERROR restate_server: Restate application failed error=Invalid configuration: Detected possible misconfiguration. This node runs a "local" metadata server but is configured to use the "object-store" metadata client. If you don't want to run a metadata server, remove the metadata-server role. If you want to use the Restate metadata store, then set metadata-client.type = "replicated" or leave it unset restate.error.code=None

Copy link

github-actions bot commented Jun 3, 2025

Test Results

  7 files  ±0    7 suites  ±0   4m 59s ⏱️ +8s
 54 tests ±0   53 ✅ ±0  1 💤 ±0  0 ❌ ±0 
223 runs  ±0  220 ✅ ±0  3 💤 ±0  0 ❌ ±0 

Results for commit c601f2e. ± Comparison against base commit f73e1f4.

♻️ This comment has been updated with latest results.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe we have equivalent coverage for the Raft Server path between the RocksDB durability layer and the Raft cluster chaos test; but let me know if you think there's value in porting these over to the Raft Server.

MultiNodeCluster,
}

pub async fn migrate_nodes_configuration(
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved to mod.rs.

@pcholakov pcholakov force-pushed the remove-deprecated-local-loglet branch from b2c6e4e to c601f2e Compare June 3, 2025 20:24
@pcholakov pcholakov marked this pull request as ready for review June 3, 2025 20:43
@pcholakov pcholakov requested a review from tillrohrmann June 3, 2025 20:43
@AhmedSoliman
Copy link
Contributor

Wrong title?

@tillrohrmann
Copy link
Contributor

This PR should be merged once we decide to release 1.4.0, right?

@pcholakov pcholakov changed the title Remove deprecated local loglet provider Remove deprecated Local metadata server and config options Jun 4, 2025
@pcholakov
Copy link
Contributor Author

Wrong title?

Indeed it was! Sorry about that.

This PR should be merged once we decide to release 1.4.0, right?

Yes, definitely!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants