The dispatch package is designed to manage a pool of nodes within a distributed system, particularly focusing on maintaining the state and availability of these nodes for job execution. It interacts with Redis to register nodes, keep heartbeats, and retrieve the list of active nodes. The package ensures that jobs are only executed on nodes that are in a steady state, avoiding nodes that are upgrading or otherwise unavailable.
-
NodePool: Central component that manages the lifecycle and state of nodes within the distributed system. It ensures that jobs are executed on nodes that are in a steady state and not undergoing upgrades or maintenance.
-
RedisDriver: Responsible for the interaction with Redis. It registers service nodes, maintains heartbeats to keep nodes alive, and retrieves the list of active nodes. This driver plays a crucial role in ensuring that the NodePool has up-to-date information about the state of each node in the system.
-
ConsistentHash: Utilized for evenly distributing jobs across nodes, minimizing reassignment when nodes change, and maintaining load balance.
-
dcron: package is designed for distributed cron job scheduling within a distributed system. It ensures reliable execution of scheduled tasks across a cluster of nodes by leveraging components like
nodepoolfor node management andRedisDriverfor state synchronization and node communication. Key features include fault tolerance, load balancing, dynamic node management, and support for standard cron syntax for job scheduling. This setup allowsdcronto efficiently distribute and manage tasks, ensuring high availability and scalability of scheduled jobs across the distributed system.
Feel free to explore, contribute, and shape the future of go-dispatch with us! Your feedback and collaboration are invaluable as we continue to refine and enhance this tool.
To get started, see CONTRIBUTING.md.
Please adhere to Starton's Code of Conduct.
go-dispatch is licensed under the Apache License 2.0.
- Starton: [email protected]
- Ghislain Cheng