Skip to content

Commit

Permalink
Update data.md
Browse files Browse the repository at this point in the history
  • Loading branch information
terrywbrady authored Feb 13, 2024
1 parent 8dd45f2 commit 0918ed2
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions design/queue-2023/data.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,5 +38,9 @@ A fixed header may continue to be utilized for sorting records. This headers sh
- A JSON schema should exist to validate the payload
- Schema validation should only be applied during system testing

#### Space Considerations
> ZooKeeper was not designed to be a general database or large object store. Instead, it manages coordination data. This data can come in the form of configuration, status information, rendezvous, etc. A common property of the various forms of coordination data is that they are relatively small: measured in kilobytes. The ZooKeeper client and the server implementations have sanity checks to ensure that znodes have less than 1M of data, but the data should be much less than that on average. [^1]
[^1]: https://zookeeper.apache.org/doc/r3.3.3/zookeeperProgrammers.html#Data+Access

#### Final vs Volatile data fields
- As we write to zookeeper, should be distinguish our static fields (submitter, file name) from the volatile fields (status, space_needed, last update)?

0 comments on commit 0918ed2

Please sign in to comment.