Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CGW 1.0 release #63

Merged
merged 136 commits into from
Jul 5, 2024
Merged

CGW 1.0 release #63

merged 136 commits into from
Jul 5, 2024

Conversation

Cahb
Copy link
Contributor

@Cahb Cahb commented Jul 4, 2024 •
edited
Loading

First (1.0) official release of the CGW application.
The release consists of:

  • (core) Threadpool-driven async incoming (secure) Websockets Connection handling of uCentral-protocol abiding devices (APs and Switches); supports mTLS / certificate+MAC (based on data in the certificate) validation, duplicate connection detection etc;
  • (core) Built-it horizontal scaling: Async communication and support for multiple CGW (shards) instances deployment;
  • (core) Kafka-driven NB API (requests/results as well as messages from uCentral devices are pushed to Kafka; NB API can control CGW - group assignment, infra list creation, pushing down configs to uCentral devices etc) through Kafka;
  • (feature) Dynamic Topology Map building and discovery, based on both direct connections from the uCentral devices, as well as the data they post in the State event messages and Realtime events (currently only <client.leave>, <client.join> RT events are supported);
    NOTE: the feature is disabled by default, as it's deemed too unstable with high load of data sent from high amount devices;
  • (feature) Basic health-check and counters support (how many devices are up, is the application healthy - up and operating - etc);
  • (feature) Message queue embedded support: NB API can queue up the requests for any device, and the queue is handled by the CGW internally;

phwhite and others added 30 commits March 17, 2024 20:33
@phwhite
cgw: initial commit
6a0344a 
Signed-off-by: Paul White <[email protected]>
@Cahb
PLV next features #1
af48010 
- Add rebalancing implementation (basic);
- Add prometheus metrics (draft);

Signed-off-by: Oleksandr Mazur <[email protected]>
Change-Id: Iff273da2fcbe938ada51b97c87dcc3e534d1f95d
@Cahb
Update readme, add make to ease-out building
eda553c 
- Update readme;
- Add run script that helps running cgw;
  (utilizes enviroment variables for starting app);
- Add makefile that will be used for building app
  (build, deploy, run, run tests etc)

Signed-off-by: Oleksandr Mazur <[email protected]>
Change-Id: I5b72e35a121afa95f3102efad8f1748995910a76
proper rust formatting - cargo fmt
071a253
cargo fix --bin "ucentral-cgw" --allow-dirty
a95082a
@Cahb
Merge pull request #4 from optim-enterprises-bv/next
6802e9e 
Next
@Cahb
Fix invalid device MAC reporting upon connect
85ebb2e 
- Rework JSON parser of uCentral messages to report
  valid mac to conn_server (in hex + uppercase),
  either way, connmap lookup can fail and cgw is unable
  to forward (sink down) msg from NB API to device;
- Comment-out stale connection closing (for now);

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #7 from Telecominfraproject/fix/invalid_mac_report…
ac7e2f3 
…_fix

Fix invalid device MAC reporting upon connect
@Cahb
Implement dockerized building and running of CGW
c3172ee 
- Use special build-env docker image that uses local project
  directory (volume mount) to speedup build.
- Implement cgw-img (docker image) generation.
- Track cgw-img tag based on commit.

Signed-off-by: Oleksandr Mazur <[email protected]>
@SviatoslavBoichuk
Added RAM cache for device - Groupd ID mapping
8493d0e
@Cahb
Merge pull request #8 from SviatoslavBoichuk/dev-add-device-to-group-…
61cd00d 
…cache

Dev add device to group cache
@Cahb
Merge pull request #6 from Telecominfraproject/feat/dockerized_cgw
2368bf0 
Implement dockerized building and running of CGW
@Cahb
Revert "Added RAM cache for device - Groupd ID mapping"
f74d66a 
This reverts commit 8493d0e.

Commit was merged by mistake by @Cahb
@Cahb
Merge pull request #14 from Telecominfraproject/revert/revert-ram-cache
890fd1c 
Revert "Added RAM cache for device - Groupd ID mapping"
@SviatoslavBoichuk
Added RAM cache for device - Groupd ID mapping
ddf72c6
@Cahb
Merge pull request #16 from SviatoslavBoichuk/dev-device-ram-cache
6337a22 
Added RAM cache for device - Groupd ID mapping
@SviatoslavBoichuk
Update device cache with FW version and device capabilities
caf22ed
@SviatoslavBoichuk
Reformat and sanitize
4cfebbf
@Cahb
Merge pull request #18 from SviatoslavBoichuk/dev-device-caps
6bec554 
Get device capabilities from first connectnion
@SviatoslavBoichuk
Refactoring: changed device cache functions name
a56354e
@SviatoslavBoichuk
Refactoring: renamed structs, enums, functions in cgw_ucentral_parser.rs
699ace9
@SviatoslavBoichuk
Refactoring: get device from cache as mutable object and update it in…
fbf7359 
…stead of getting it from cache for each field
@Cahb
Merge pull request #19 from SviatoslavBoichuk/dev-refactoring
bb84945 
Dev refactoring
@SviatoslavBoichuk
Changed NB messages type
f835edb
@Cahb
Merge pull request #20 from SviatoslavBoichuk/dev-modify-nb-messages-…
a26459a 
…type

Changed NB messages type
@SviatoslavBoichuk
Split UCentral messages parser for AP and Switch devices
0d8882f
@SviatoslavBoichuk
Make command parser more generic to cover all command types
23c7670
@Cahb
Merge pull request #21 from SviatoslavBoichuk/dev-draft-split-parser
891db96 
Dev draft split parser
added docker-compose and helm chart
bd862ff 
Signed-off-by: outbackdingo <[email protected]>
@Cahb
Fix invalid app_args processing
ab62ffb 
- Tweak script to respect cgw_id
- Remove hardcoded broker ip for NB API producer

Signed-off-by: Oleksandr Mazur <[email protected]>
Cahb and others added 21 commits July 1, 2024 21:00
@Cahb
Build: Print version (hash) tag whenever app starts
f6205c2 
NOTE: CI changes will be made in other PRs.
This one only covers the buildsystem / application part;

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
CGW: Fix compiler warning introduced with previous changes
d69a485 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Dockerfile: Uppercase the <as> instruction to fix warnings
969ef8b 
Originally <as> is lowercased in present Dockerfile, which might
omit warnings upon build.
Fix this by uppercasing the <AS> instructions.

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #57 from Telecominfraproject/feat/print_app_ver_on…
6ac82b0 
…_start

Build: Print version (hash) tag whenever app starts
Try new build envs
734f4c3
Try new build envs
95c72aa 
Signed-off-by: Carsten Schafer <[email protected]>
@Cahb
CGW: AP Parser: Remove unnecessary logs
94c7f82 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
CGW: AP Parser: Fix expected state <serial> location
98c3153 
State messages have only one place for serial - state: params:serial,
while CGW expected it to be in params:state:serial as well.
Fix it by removing the last params:state:serial expectation

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
CGW: Fix formatting of some source files
8a82815 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #58 from Telecominfraproject/fix/minor_fixes_and_f…
16a4fd6 
…ormatting

Fix/minor fixes and formatting
@Cahb
CGW: Dockerfile: revert (temporarily) root user
afc9171 
This is a debug-oriented (in cloud deployment) change to debug
real-life deployment.

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #59 from Telecominfraproject/fix/dockerfile_tempor…
03485a3 
…arily_revert_root_user

CGW: Dockerfile: revert (temporarily) root user
@Cahb
CGW: Allow disabling topomap handling through env var
58e59cc 
To disable the feature, the CGW_FEATURE_TOPOMAP_DISABLE should
be exported (value doesn't matter);
To enabled it back, the ENV var CGW_FEATURE_TOPOMAP_DISABLE
should be unset:
$ unset CGW_FEATURE_TOPOMAP_DISABLE

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Build: enable temporarily debug-only build by default
b14b5ed 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #61 from Telecominfraproject/tmp/enable_default_de…
760bb4c 
…bug_build

Build: enable temporarily debug-only build by default
@Cahb
Merge pull request #60 from Telecominfraproject/feat/allow_disabling_…
7fa2658 
…topomap_processign

CGW: Allow disabling topomap handling through env var
@Cahb
CGW: TopoMap: Disable by default
2531373 
Change current behavior of CGW to <disable> the
TopoMap feature by default, as it's current
implementation is very unstable with high
number of devices sending their state info data.

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Revert "Build: enable temporarily debug-only build by default"
21793ef 
This reverts commit b14b5ed.

Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Utils: Kafka producer: change default subnet to localhost
7bf8e1e 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Utils: simulation runner: fix sim not starting
91ca720 
Signed-off-by: Oleksandr Mazur <[email protected]>
@Cahb
Merge pull request #62 from Telecominfraproject/fix/pre_release_fixes
bbbfe14 
Fix/pre release fixes
@Cahb Cahb marked this pull request as draft July 4, 2024 14:12
@Cahb Cahb marked this pull request as ready for review July 4, 2024 14:37
@Cahb Cahb requested a review from phwhite July 4, 2024 14:37
Carsten Schafer and others added 4 commits July 5, 2024 08:10
@Cahb Cahb merged commit 6202aec into main Jul 5, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@phwhite phwhite phwhite approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@Cahb @phwhite @SviatoslavBoichuk @outbackdingo @carsten989