Skip to content

Commit

Permalink
Update _posts/2024-09-24-creating-a-new-database-integration-with-dat…
Browse files Browse the repository at this point in the history
…a-prepper.markdown

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Taylor Gray <[email protected]>
  • Loading branch information
graytaylor0 and natebower authored Nov 5, 2024
1 parent f3ed634 commit ee68a61
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -106,7 +106,7 @@ public void run() {
}
```

The key components and workflow in the code for implementing source coordination in Data Prepper are as follows:
The key components and code workflow for implementing source coordination in Data Prepper are as follows:

1. Upon starting Data Prepper, a leader partition is established. See the [code reference](https://github.com/graytaylor0/data-prepper/blob/6e38dead8e9beca089381519654f329b82524b9d/data-prepper-plugins/sample-source-coordination-source/src/main/java/SampleSource.java#L41)). The single leader partition is assigned to the Data Prepper node that successfully calls `acquireAvailablePartition(LeaderPartition.PARTITION_TYPE)`, assigning it the task of identifying new database files.
2. When a Data Prepper node owns the leader partition, it queries the hypothetical database and creates new partitions in the source coordination store, enabling all nodes running this source to access these database file partitions.
Expand Down

0 comments on commit ee68a61

Please sign in to comment.