{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":681825498,"defaultBranch":"main","name":"ai-on-gke","ownerLogin":"vivianrwu","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-08-22T20:55:15.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/135869712?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1721067077.0","currentOid":""},"activityList":{"items":[{"before":"0fd14fd965d5ea191e66877e4f0a023a000bfd3c","after":"2c2fec4067e1d7cc7acd01f99ccef85fe1240ea7","ref":"refs/heads/main","pushedAt":"2024-08-26T18:57:56.000Z","pushType":"push","commitsCount":23,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add latency profile generator (#775)\n\n* Add latency profile generator\r\n\r\nThis change adds a new benchmarking suite called\r\nlatency-profile-generator which runs serving benchmarks at different\r\nrequest rates to produce latency and throughput numbers at different\r\nQPS. This can be used to identify how different models and model servers\r\nperform depending on incoming traffic.\r\n\r\n* Update readme and GCS push steps\r\n\r\n* first commit\r\n\r\n* remove profiling\r\n\r\n* correct steps\r\n\r\n* correct steps\r\n\r\n* jetstream option for backend arg\r\n\r\n* extra parameters\r\n\r\n* configurable pipeline starting point, request rates configurable\r\n\r\n* WIP changes/reversions\r\n\r\n* setting for building latency profiler image\r\n\r\n* onoly build once for profile-generator\r\n\r\n* fmt\r\n\r\n* fmt\r\n\r\n* Move deploy model server from profile-generator to latency-profile\r\n\r\n* fix kubectl wait\r\n\r\n* dmt\r\n\r\n* intermediate changes\r\n\r\n* Update table of contents\r\n\r\n* Fix lint issues\r\n\r\n* remove specific project id\r\n\r\n* remove artifact_registry\r\n\r\n* Stripped back LPG automation for separate PR\r\n\r\n* typo\r\n\r\n* nit\r\n\r\n* remove bad depends_on\r\n\r\n* nits\r\n\r\n* nits\r\n\r\n* Update main.tf\r\n\r\n* Update README.md\r\n\r\n* more cleanup\r\n\r\n* move latency-profile module to subdirectory\r\n\r\n* fmt\r\n\r\n* supports jetstream\r\n\r\n* Added comment\r\n\r\n* more accurate comment\r\n\r\n* readd container folder\r\n\r\n---------\r\n\r\nCo-authored-by: Brendan Slabe <slabe@google.com>\r\nCo-authored-by: Brendan Slabe <bslabe123@gmail.com>","shortMessageHtmlLink":"Add latency profile generator (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2461674599\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/775\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/775/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/775\">GoogleCloudPlatform#775</a>)"}},{"before":null,"after":"284ddeb0ae09d53dae96ca30021c95d4d5c8ee4e","ref":"refs/heads/update-pip","pushedAt":"2024-07-15T18:11:17.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Update pip in JetStream Pytorch and checkpoint Dockerfiles","shortMessageHtmlLink":"Update pip in JetStream Pytorch and checkpoint Dockerfiles"}},{"before":"cdb52c8c6d9a88875bf97753d95355e6d92b5e0e","after":"0fd14fd965d5ea191e66877e4f0a023a000bfd3c","ref":"refs/heads/main","pushedAt":"2024-07-15T18:07:42.000Z","pushType":"push","commitsCount":8,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add HuggingFace support for automated inference checkpoint conversion (#712)\n\n* Add HuggingFace support for automated inference checkpoint conversion\r\n\r\n* Add HuggingFace support for inference checkpoint conversion\r\n\r\n* fix llama checkpoint names\r\n\r\n* update containers to v0.2.3 / v0.2.2\r\n\r\n* update containers to v0.2.3 / v0.2.2","shortMessageHtmlLink":"Add HuggingFace support for automated inference checkpoint conversion (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2371301093\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/712\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/712/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/712\">…</a>"}},{"before":"eafa6e38e3013fe2da80b2a6e0b9266adbd1653e","after":"c83b13f17e745430042b699d0e0830ace13df8a7","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-07-15T18:04:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Update pip in JetStream Pytorch and checkpoint Dockerfiles","shortMessageHtmlLink":"Update pip in JetStream Pytorch and checkpoint Dockerfiles"}},{"before":"0a41d576acd560698d0f3dd7b346d3e8fb87a401","after":"eafa6e38e3013fe2da80b2a6e0b9266adbd1653e","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-07-11T08:27:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"update containers to v0.2.3 / v0.2.2","shortMessageHtmlLink":"update containers to v0.2.3 / v0.2.2"}},{"before":"02df9070fe33db56fecd2aec906a039efa473dc5","after":"0a41d576acd560698d0f3dd7b346d3e8fb87a401","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-07-11T08:17:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"update containers to v0.2.3 / v0.2.2","shortMessageHtmlLink":"update containers to v0.2.3 / v0.2.2"}},{"before":"01630c62fac8e5230c7cc0f8ff338e8fb3da8a5a","after":"cdb52c8c6d9a88875bf97753d95355e6d92b5e0e","ref":"refs/heads/main","pushedAt":"2024-07-01T21:00:50.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Move Ray TPU Webhook out of applications/ray folder (#603)\n\n* Move webhook folder to ray-on-gke/tpu\r\n\r\n* Change webhook path","shortMessageHtmlLink":"Move Ray TPU Webhook out of applications/ray folder (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2257313091\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/603\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/603/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/603\">GoogleCloudPlatf…</a>"}},{"before":"49035ecac449b75b130d0b1e3c252b2a6778d7d1","after":"02df9070fe33db56fecd2aec906a039efa473dc5","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-06-24T23:45:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"fix llama checkpoint names","shortMessageHtmlLink":"fix llama checkpoint names"}},{"before":"eff88c5cb32ae145b2f950622d2934f62df5d007","after":"49035ecac449b75b130d0b1e3c252b2a6778d7d1","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-06-24T23:33:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add HuggingFace support for inference checkpoint conversion","shortMessageHtmlLink":"Add HuggingFace support for inference checkpoint conversion"}},{"before":null,"after":"eff88c5cb32ae145b2f950622d2934f62df5d007","ref":"refs/heads/jet-pt-hf","pushedAt":"2024-06-24T23:11:59.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add HuggingFace support for automated inference checkpoint conversion","shortMessageHtmlLink":"Add HuggingFace support for automated inference checkpoint conversion"}},{"before":"20b802f315168f30eb0a9a59aebfddac2252bcb5","after":"01630c62fac8e5230c7cc0f8ff338e8fb3da8a5a","ref":"refs/heads/main","pushedAt":"2024-06-18T23:11:04.000Z","pushType":"push","commitsCount":52,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"add missing dcgm metrics (#710)","shortMessageHtmlLink":"add missing dcgm metrics (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2360715574\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/710\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/710/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/710\">GoogleCloudPlatform#710</a>)"}},{"before":"55878e910371f1c98a5cdd553e7e369fdeab1401","after":"5566c05a9ac9f348277e5d7089e813ab5230d959","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-05-02T21:40:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"fix script variables","shortMessageHtmlLink":"fix script variables"}},{"before":"fca7304dd955c74d5d9537bd3b62aec832336f0d","after":"55878e910371f1c98a5cdd553e7e369fdeab1401","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-05-02T21:18:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"use stable jetstream version for checkpoint conversion and jetstream-pytorch server","shortMessageHtmlLink":"use stable jetstream version for checkpoint conversion and jetstream-…"}},{"before":"dbc02885e1092e30969b19005526f9732574c77b","after":"fca7304dd955c74d5d9537bd3b62aec832336f0d","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-05-01T18:31:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"update arguments for checkpoint conversion job","shortMessageHtmlLink":"update arguments for checkpoint conversion job"}},{"before":"a57b07677c5a7c525a0c6b96a48da9942bcea900","after":"dbc02885e1092e30969b19005526f9732574c77b","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-05-01T16:50:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"add docker image for jetstream-pytorch-server","shortMessageHtmlLink":"add docker image for jetstream-pytorch-server"}},{"before":"74a89ad81f91af005a0834584739264ac73a0c68","after":"a57b07677c5a7c525a0c6b96a48da9942bcea900","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-04-30T23:32:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add XLA for Pytorch title","shortMessageHtmlLink":"Add XLA for Pytorch title"}},{"before":"9befebf00586367c878ea6a0d95d56c60ef203ad","after":"74a89ad81f91af005a0834584739264ac73a0c68","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-04-30T23:31:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add differentiation for model server arguments","shortMessageHtmlLink":"Add differentiation for model server arguments"}},{"before":null,"after":"9befebf00586367c878ea6a0d95d56c60ef203ad","ref":"refs/heads/jetstream-pt-ug","pushedAt":"2024-04-27T00:09:41.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add soruce files for Jestream Pytorch single host userguide","shortMessageHtmlLink":"Add soruce files for Jestream Pytorch single host userguide"}},{"before":null,"after":"20b802f315168f30eb0a9a59aebfddac2252bcb5","ref":"refs/heads/jetstream-pytorch-gke","pushedAt":"2024-04-26T23:33:15.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"TPU Provisioner reliability improvements (#614)\n\n* use jobset job-key label in node pool name instead of owner UID; track jobset that triggered creation of  node pool instead of pod\r\n\r\n* change node pool naming convention","shortMessageHtmlLink":"TPU Provisioner reliability improvements (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2262386934\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/614\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/614/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/614\">GoogleCloudPlatform#614</a>)"}},{"before":"b62f3c4f097a4dc2f79fb0eb9d3492f8895af3a9","after":"a97db99482b23b95972ed57b652f6df9ad3c3709","ref":"refs/heads/jetstream","pushedAt":"2024-04-26T23:29:56.000Z","pushType":"push","commitsCount":97,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Merge branch 'GoogleCloudPlatform:main' into jetstream","shortMessageHtmlLink":"Merge branch 'GoogleCloudPlatform:main' into jetstream"}},{"before":"b39827c96352ed86c6fe702dee49abb5e5d44e09","after":"2d86685abc9a59bcd7fab21a5846ba573308d61f","ref":"refs/heads/jetstream-pt","pushedAt":"2024-04-26T23:29:08.000Z","pushType":"push","commitsCount":97,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Merge branch 'GoogleCloudPlatform:main' into jetstream-pt","shortMessageHtmlLink":"Merge branch 'GoogleCloudPlatform:main' into jetstream-pt"}},{"before":"7c84726f23a95f53702a06f1c8c8d25139087f66","after":"20b802f315168f30eb0a9a59aebfddac2252bcb5","ref":"refs/heads/main","pushedAt":"2024-04-26T23:28:56.000Z","pushType":"push","commitsCount":96,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"TPU Provisioner reliability improvements (#614)\n\n* use jobset job-key label in node pool name instead of owner UID; track jobset that triggered creation of  node pool instead of pod\r\n\r\n* change node pool naming convention","shortMessageHtmlLink":"TPU Provisioner reliability improvements (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2262386934\" data-permission-text=\"Title is private\" data-url=\"https://github.com/GoogleCloudPlatform/ai-on-gke/issues/614\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/GoogleCloudPlatform/ai-on-gke/pull/614/hovercard\" href=\"https://github.com/GoogleCloudPlatform/ai-on-gke/pull/614\">GoogleCloudPlatform#614</a>)"}},{"before":"349e252b033a5285fc0015e983b02860c39955e6","after":"b39827c96352ed86c6fe702dee49abb5e5d44e09","ref":"refs/heads/jetstream-pt","pushedAt":"2024-04-26T23:26:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"edit http server description","shortMessageHtmlLink":"edit http server description"}},{"before":"b62f3c4f097a4dc2f79fb0eb9d3492f8895af3a9","after":"349e252b033a5285fc0015e983b02860c39955e6","ref":"refs/heads/jetstream-pt","pushedAt":"2024-04-26T23:21:42.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add single host Jetstream Pytorch on GKE user guide","shortMessageHtmlLink":"Add single host Jetstream Pytorch on GKE user guide"}},{"before":null,"after":"b62f3c4f097a4dc2f79fb0eb9d3492f8895af3a9","ref":"refs/heads/jetstream-pt","pushedAt":"2024-04-24T18:40:39.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"remove grpc specific deployment file for jetstream","shortMessageHtmlLink":"remove grpc specific deployment file for jetstream"}},{"before":"e03bf0fc7b9f76d465adb3e256f439b22bc395d0","after":"b62f3c4f097a4dc2f79fb0eb9d3492f8895af3a9","ref":"refs/heads/jetstream","pushedAt":"2024-04-23T20:31:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"remove grpc specific deployment file for jetstream","shortMessageHtmlLink":"remove grpc specific deployment file for jetstream"}},{"before":"7ebb6ce2f883b6f5316ca81645b003f317d9fce9","after":"e03bf0fc7b9f76d465adb3e256f439b22bc395d0","ref":"refs/heads/jetstream","pushedAt":"2024-04-23T17:58:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"rename conversion script and pass optional version argument","shortMessageHtmlLink":"rename conversion script and pass optional version argument"}},{"before":"7b114e540a00b87487301266dc1fcbf7869c7029","after":"7ebb6ce2f883b6f5316ca81645b003f317d9fce9","ref":"refs/heads/jetstream","pushedAt":"2024-04-16T22:52:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"modify checkpoint job and add deployment grpc instructions","shortMessageHtmlLink":"modify checkpoint job and add deployment grpc instructions"}},{"before":"cf4be8309b99e78edad04dfb2a0308a3a53b6a04","after":"7b114e540a00b87487301266dc1fcbf7869c7029","ref":"refs/heads/jetstream","pushedAt":"2024-04-02T16:57:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"edit model server logs","shortMessageHtmlLink":"edit model server logs"}},{"before":null,"after":"cf4be8309b99e78edad04dfb2a0308a3a53b6a04","ref":"refs/heads/jetstream","pushedAt":"2024-03-28T19:01:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"vivianrwu","name":null,"path":"/vivianrwu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135869712?s=80&v=4"},"commit":{"message":"Add checkpoint conversion script and argument descriptions","shortMessageHtmlLink":"Add checkpoint conversion script and argument descriptions"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEpJeGSgA","startCursor":null,"endCursor":null}},"title":"Activity · vivianrwu/ai-on-gke"}