Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release current version of ml-platform #819

Merged
merged 77 commits into from
Sep 17, 2024
Merged

Release current version of ml-platform #819

merged 77 commits into from
Sep 17, 2024

Commits on Sep 16, 2024

  1. Update fluentbit config (#721) 

    update fluentbit config
    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7afa5ca View commit details
    Browse the repository at this point in the history

  2. Added product category preprocessing (#733) 

    * Added product category cleanup
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    47dfa2b View commit details
    Browse the repository at this point in the history

  3. Added architecture diagrams

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a0a02b7 View commit details
    Browse the repository at this point in the history

  4. Data processing observability (#752) 

    add observability for data processing
    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    6b70a2d View commit details
    Browse the repository at this point in the history

  5. correct typos (#754)

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3fa24ed View commit details
    Browse the repository at this point in the history

  6. adding product category cleanup

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    69f2651 View commit details
    Browse the repository at this point in the history

  7. added a line between import and variables

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    96d3de6 View commit details
    Browse the repository at this point in the history

  8. removed redundant column

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3f0f073 View commit details
    Browse the repository at this point in the history

  9. adding dataprep for fine tuning

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    f3f03fd View commit details
    Browse the repository at this point in the history

  10. taking in the new code with logging

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    75e3552 View commit details
    Browse the repository at this point in the history

  11. finetune use cases - rebase/squash

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    51b3ac5 View commit details
    Browse the repository at this point in the history

  12. fix eval logging and readme formatting

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    42322a3 View commit details
    Browse the repository at this point in the history

  13. add preqreqs of dependent examples

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    302667a View commit details
    Browse the repository at this point in the history

  14. Updating the Google Terraform provider version

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8c66ecd View commit details
    Browse the repository at this point in the history

  15. Switched to Google managed DCGM

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    0622977 View commit details
    Browse the repository at this point in the history

  16. Added README for Config Controller module

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    38679a4 View commit details
    Browse the repository at this point in the history

  17. Fixed merge conflicts

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    da00241 View commit details
    Browse the repository at this point in the history

  18. Updated dataprocessing test script

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b2d7ee1 View commit details
    Browse the repository at this point in the history

  19. Reviewed and formatted

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fc83116 View commit details
    Browse the repository at this point in the history

  20. Initial updates from testing

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2e92fbb View commit details
    Browse the repository at this point in the history

  21. Initial updates from testing

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    6006f7d View commit details
    Browse the repository at this point in the history

  22. Documentation update for data pre-processing use case (#771) 

    documentation update for data preprocessing usecase
    @gushob21 @arueth
    gushob21 authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    23b0a16 View commit details
    Browse the repository at this point in the history

  23. variables for batch size and gradient

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2da1f7c View commit details
    Browse the repository at this point in the history

  24. fix gradient variable name

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    f0a74b3 View commit details
    Browse the repository at this point in the history

  25. Update README.md 

    Corrected data bucket information
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8c3985b View commit details
    Browse the repository at this point in the history

  26. formatting markdown and update region

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fed9872 View commit details
    Browse the repository at this point in the history

  27. additional formatting of md

    @kenthua @arueth
    kenthua authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    f0c0786 View commit details
    Browse the repository at this point in the history

  28. Moved the git configuration to a secret manager secret

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    98ab17b View commit details
    Browse the repository at this point in the history

  29. Converted data preparation to use structured JSON logging

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2b16d82 View commit details
    Browse the repository at this point in the history

  30. Adding a serviceaccount.yaml for creating a KSA with platform. Updati… 

    …ng the documentation for datapreparation and fine-tuning
    @gushob21 @arueth
    gushob21 authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fe23121 View commit details
    Browse the repository at this point in the history

  31. Updating the documentation for fine-tuning

    @gushob21 @arueth
    gushob21 authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    bbe08b7 View commit details
    Browse the repository at this point in the history

  32. Converted fine tuning to use structured JSON logging and enhanced log… 

    …ging
    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ccacff9 View commit details
    Browse the repository at this point in the history

  33. Converted model eval to use structured JSON logging and enhanced logging

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    f599e68 View commit details
    Browse the repository at this point in the history

  34. Standardized cloud build, logging, and signal handling

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3fdd9d9 View commit details
    Browse the repository at this point in the history

  35. Standardized bucket name variables and cloud build commands

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    599eb94 View commit details
    Browse the repository at this point in the history

  36. Updates for data-processing

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    263ae9f View commit details
    Browse the repository at this point in the history

  37. Updates for data-preparation

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fc3d2b3 View commit details
    Browse the repository at this point in the history

  38. Updates for finetuning

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    f6a7b7f View commit details
    Browse the repository at this point in the history

  39. fix typo in the manifest

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7030ab4 View commit details
    Browse the repository at this point in the history

  40. Updates for model-eval

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2110cac View commit details
    Browse the repository at this point in the history

  41. Standardized READMEs

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    352fe3f View commit details
    Browse the repository at this point in the history

  42. Added dependency on git_config secret

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    d61bb86 View commit details
    Browse the repository at this point in the history

  43. Simplied variable configuration and environment setup

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2f616c2 View commit details
    Browse the repository at this point in the history

  44. add observability to data prep step

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8809272 View commit details
    Browse the repository at this point in the history

  45. Simplied variable configuration and environment setup

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    d08b036 View commit details
    Browse the repository at this point in the history

  46. minor update for the data prep step

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    87f1d81 View commit details
    Browse the repository at this point in the history

  47. add time estimate for the data prep step

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    08840d1 View commit details
    Browse the repository at this point in the history

  48. clean up the data prep readme

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8e5652e View commit details
    Browse the repository at this point in the history

  49. Set force_destroy to true for buckets

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    32c0299 View commit details
    Browse the repository at this point in the history

  50. Fixed dependencies

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7030bed View commit details
    Browse the repository at this point in the history

  51. Added Google service account for builds

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3789d09 View commit details
    Browse the repository at this point in the history

  52. Added MLP_CLUSTER_KUBERNETES_HOST and MLP_CLUSTER_LOCATION to the env… 

    …ironment configuration output
    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    30503b0 View commit details
    Browse the repository at this point in the history

  53. adding images for finetuning narrative

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ffda567 View commit details
    Browse the repository at this point in the history

  54. rearranging datapreprocessing image

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ca19a2b View commit details
    Browse the repository at this point in the history

  55. Update README.md

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3109dfa View commit details
    Browse the repository at this point in the history

  56. Added l4 deployment option to model-eval

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    71a1440 View commit details
    Browse the repository at this point in the history

  57. Added additional environment cleanup steps

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    bc0dbc3 View commit details
    Browse the repository at this point in the history

  58. Clean up data processing readme

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    446cfe7 View commit details
    Browse the repository at this point in the history

  59. Clean up data processing readme

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    1c467c9 View commit details
    Browse the repository at this point in the history

  60. Add files via upload

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    d2096d4 View commit details
    Browse the repository at this point in the history

  61. Add files via upload 

    Uploading images for end 2 end narrative
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    0c84c42 View commit details
    Browse the repository at this point in the history

  62. Add steps to install MLflow

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    1c00289 View commit details
    Browse the repository at this point in the history

  63. Create end-2-end-narrative.md 

    Initial Draft
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    910a17d View commit details
    Browse the repository at this point in the history

  64. Update end-2-end-narrative.md 

    Added the images
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    784850d View commit details
    Browse the repository at this point in the history

  65. Update end-2-end-narrative.md 

    Added Readme link for implementation stpes
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    24c0ce5 View commit details
    Browse the repository at this point in the history

  66. Update end-2-end-narrative.md 

    correcting the links
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8417d6c View commit details
    Browse the repository at this point in the history

  67. Update README.md 

    Added new usecases
    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    5e1033a View commit details
    Browse the repository at this point in the history

  68. add mlflow to the readme

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    1fe2ef9 View commit details
    Browse the repository at this point in the history

  69. add mlflow to the readme

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c353d7b View commit details
    Browse the repository at this point in the history

  70. Fix mlflow set experiment issue

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    17c5920 View commit details
    Browse the repository at this point in the history

  71. Fix mlflow set experiment issue

    @xiangshen-dk @arueth
    xiangshen-dk authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    476181c View commit details
    Browse the repository at this point in the history

  72. Updated test scripts

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    14f4c2a View commit details
    Browse the repository at this point in the history

  73. Fixing formatting issues

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3e132d4 View commit details
    Browse the repository at this point in the history

  74. Updated test scripts

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    d40466b View commit details
    Browse the repository at this point in the history

  75. Enhancements to the mlflow logging and metrics for fine-tuning (#813)

    @karajendran @arueth
    karajendran authored and arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b35d204 View commit details
    Browse the repository at this point in the history

  76. Added unique prefix to namespace kubernetes service accounts

    @arueth
    arueth committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ef55fe0 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Disabling broken CI

    @arueth
    arueth committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    807c5c9 View commit details
    Browse the repository at this point in the history