Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finish all hackerthon planned functionalities #25

Merged
merged 168 commits into from
Jan 31, 2024
Merged

Finish all hackerthon planned functionalities #25

merged 168 commits into from
Jan 31, 2024

Conversation

peterxcli
Copy link
Member

@peterxcli peterxcli commented Jan 30, 2024 •
edited
Loading

  • GenAI (Vertex AI + Pinecone)
    • Analyze Log
    • Store Log and feedback
    • Self-Improved Analyzer progressively
  • monitor controller
    • Retrieve Log and Metric
    • Scale Cloud Run Actively
    • The Bridge between GenAI and Discord Bot
  • Discord Bot
    • Push alert
    • Thread conversation
  • Consumer
    • Serverless
    • Simulate Scalable Generic Task Consumer
    • Stress Test API to simulate real world scenario
  • Code coverage / TDD
    • Pytest, High code coverage
  • Wheel CI (aka. build our CI from wheel)
    • Workflow as Code (yaml format)
    • Github webhook triggered
  • DevOps
    • Github Action
    • GitFlow
    • CI/CD
    • Docker / Containerization

jason810496 and others added 30 commits January 23, 2024 02:22
@jason810496
hotfix : bandit action version
fd0f09e
@jason810496
add : consumer setup
00f95b2
@jason810496
ci : add public docker image build
23f6ece
@jason810496
fix : build context
419a368
@jason810496
fix : docker file context
11139c1
@jason810496
add : initial consumer structure
50fe37a
@jason810496
add : lock save counters
3632d99
@peterxcli
chore: add google-cloud-run dependency
97e34bf
@peterxcli
docs: add README.md for Cloud Run Monitor System
3cebd28
@peterxcli
feat: add CloudRunManager class for managing Cloud Run instances
85a15b6
@jason810496
feat : add all routes
e79f076
@jason810496
feat : add statistics services
21c6488
@jason810496
feat : add normal behavior controller
a77191f
@jason810496
refactor : rm unused code for job service
46dff87
@jason810496
add : settings config
2ccf23a
@jason810496
feat: full , status , job
35ad4eb 
- full : full resource in specific time
- status : get current status of resource
- job : background normal behavior stimate controller
@peterxcli
docs: add setup instructions for Ngrok and GitHub OAuth application a…
abff00f 
…nd Drone, but not success
@peterxcli
feat: update Drone configuration with ha
7792766
@peterxcli
docs: add .sqlite to .gitignore and create Makefile to start drones
6c1ec56
@jason810496
ci : fix consumer docker ci action
a7e4f39
@jason810496
ci : fix bandit action check scope
10a8c64
@jason810496
refactor : fix consumer details
4eeb5ef
@peterxcli
fix: update docker compose command in Makefile
027ccf0
@HenryChang6
Merge pull request #4 from NCKU-CSIE-Union/feature/discord-bot
43b32fd 
Update Feature/discord bot
@jason810496
feat : add log service
122dd62
@jason810496
Merge pull request #3 from NCKU-CSIE-Union/feature/consumer
4818fb6 
Feature/consumer
@peterxcli
chore: add pyproject.toml file with project dependencies
16a7454
@peterxcli
docs: add more logging and metrics API documentation
6db83e9
@peterxcli
feat: add get_metrics method for CloudRunManager class
f0a1781
@peterxcli
docs: add init gcloud setting
40b10f5
jerrykal and others added 29 commits January 27, 2024 00:47
@jerrykal
Add memory feature to log analyzer
04f6633
@jerrykal
Merge pull request #23 from NCKU-CSIE-Union/feat/llm_log_analyzer
a57a94a 
Add memory feature to log analyzer
@jerrykal
Add docstrings to LLMLogAnalyzer
4e02d9a
@jerrykal
Merge pull request #24 from NCKU-CSIE-Union/feat/llm_log_analyzer
ab60b27 
Add docstrings to LLMLogAnalyzer
@jason810496
fix : fix ci runner dependencies
4ed1f99
@peterxcli
chore: update env template
89a30a6
@peterxcli
feat: integrate monitor with LLM and discord
09c5d2e
@peterxcli
feat: update deps for monitor and handle error
f2952ac
@peterxcli
Merge branch 'feature/integration' into dev
46299e5
@jason810496
ci : add main deploy
07593a3
@jason810496
add : deploy main dependencies
945d092
@jason810496
hotfix : requirements.txt
415554e
@peterxcli
fix: make default reducer to median
79e137f
@jason810496
hotfix : requirements depedencies fix
62630ab
@jason810496
Merge branch 'dev' of https://github.com/NCKU-CSIE-Union/TSMC-Hackath…
6c75941 
…on-2024-IT-Infra into dev
@jason810496
add : bot testing
0798eb7
@peterxcli
feat: add ai unit test
8bf7767
@peterxcli
feat: run test data and simulate as real time data and sen alert
54cb406
@peterxcli
feat: add log_size parameter to MonitorRunner and main.py
21bb856
@peterxcli
fix: type
d158ab2
@jason810496
docs : add presentation pdf
300a4ac
@peterxcli
fix: fix test data simulator, add Discord message to on_ready event
be9e6bf
@peterxcli
Merge remote-tracking branch 'origin/document' into dev
013257c
@peterxcli
docs: Add GenAI, monitor controller, Discord Bot, Consumer, code cove…
000bcf0 
…rage/TDD, Wheel CI, and DevOps sections
@peterxcli
Merge remote-tracking branch 'origin/testing/ai' into dev
14384de
@peterxcli
Merge remote-tracking branch 'origin/testing/bot' into dev
f204d18
@peterxcli
Merge remote-tracking branch 'origin/testing/mointor' into dev
acc358d
@jason810496
fix : read credentials from os env
2e5dde2
@jason810496
docs : update README sections
d4c39a6 
- add system architecture
- add presentation
- add gitflow diagram
- add author
@jason810496 jason810496 merged commit fb17c96 into main Jan 31, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@peterxcli @jason810496 @HenryChang6 @jerrykal