Code

Introducing SkyServe#2458

Code

Merged

cblmemo merged 242 commits intomasterskypilot-org/skypilot:masterfrom serve-devskypilot-org/skypilot:serve-devCopy head branch name to clipboardNov 15, 2023

+6,630-682

Commits

Commits on Jul 13, 2023

• init

  infwinston

  committed
  9a645a4

  Copy full SHA for 9a645a4

• format

  infwinston

  committed
  4bb4420

  Copy full SHA for 4bb4420

• format

  infwinston

  committed
  d52c2b9

  Copy full SHA for d52c2b9

Commits on Jul 14, 2023

• reademe

  infwinston

  committed
  208bdf4

  Copy full SHA for 208bdf4

• update

  infwinston

  committed
  1fa6401

  Copy full SHA for 1fa6401

Commits on Aug 13, 2023

• [SkyServe] add http server example (#2260)

  Show description for c56ae22
  cblmemo

  committed
  c56ae22

  Copy full SHA for c56ae22

• [SkyServe] sky serve CLI prototype (#2276)

  Show description for f28ebbb
  cblmemo

  committed
  f28ebbb

  Copy full SHA for f28ebbb

• [SkyServe] Refactoring, Introducing multiprocess for provisioning and sky serve logs prototype (#2311)

  Show description for 8fa4323
  cblmemo

  committed
  8fa4323

  Copy full SHA for 8fa4323

• [SkyServe] Use SSH for Authentication, new replica status, sky serve logs for replica info (#2353)

  Show description for 05da33f
  

  cblmemo

  and

  infwinston

  committed
  05da33f

  Copy full SHA for 05da33f

• merge to master

  cblmemo

  committed
  c32e18d

  Copy full SHA for c32e18d

Commits on Aug 15, 2023

• [SkyServe] Final changes for v0 release (#2396)

  Show description for d6bd068
  

  cblmemo

  and

  infwinston

  authored
  d6bd068

  Copy full SHA for d6bd068

• Merge remote-tracking branch 'origin/master' into serve

  cblmemo

  committed
  cd2b44c

  Copy full SHA for cd2b44c

• fix serve example (#2406)

  Show description for 7968de9
  infwinston

  authored
  7968de9

  Copy full SHA for 7968de9

• surface debug msg (#2407)

  Show description for 23e7529
  infwinston

  authored
  23e7529

  Copy full SHA for 23e7529

Commits on Aug 16, 2023

• [SkyServe] Fix port failover (#2408)

  Show description for 57b3347
  cblmemo

  authored
  57b3347

  Copy full SHA for 57b3347

Commits on Aug 18, 2023

• [SkyServe] Introducing smoke test and fix bugs (#2411)

  Show description for 0a1a7de
  cblmemo

  authored
  0a1a7de

  Copy full SHA for 0a1a7de

Commits on Aug 20, 2023

• [SkyServe] Add cancel and gorilla example (#2417)

  Show description for f7f33e9
  

  cblmemo

  and

  infwinston

  authored
  f7f33e9

  Copy full SHA for f7f33e9

Commits on Aug 24, 2023

• [SkyServe] Fix interrupt process group and format (#2449)

  Show description for 8216e71
  cblmemo

  authored
  8216e71

  Copy full SHA for 8216e71

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  1c9e23f

  Copy full SHA for 1c9e23f

• add authentication init

  cblmemo

  committed
  d8aaf65

  Copy full SHA for d8aaf65

• typo fix & remove prehook

  cblmemo

  committed
  ede0cad

  Copy full SHA for ede0cad

• fix --no-follow in replica log and disable cancel log when skyserve down

  cblmemo

  committed
  4ace061

  Copy full SHA for 4ace061

Commits on Aug 25, 2023

• set controller task resources for when controller failed to provision best resources

  cblmemo

  committed
  14ddf2f

  Copy full SHA for 14ddf2f

• finish llm & interrupt test

  cblmemo

  committed
  8ce9c18

  Copy full SHA for 8ce9c18

• early check cluster name is valid

  cblmemo

  committed
  6fae8ac

  Copy full SHA for 6fae8ac

• add hint message for tailing replica job status

  cblmemo

  committed
  21c07cc

  Copy full SHA for 21c07cc

• make dict thread safe

  cblmemo

  committed
  377789b

  Copy full SHA for 377789b

• upd doc

  cblmemo

  committed
  b2f2388

  Copy full SHA for b2f2388

Commits on Aug 26, 2023

• rename redirector to lb

  cblmemo

  committed
  7bfeec9

  Copy full SHA for 7bfeec9

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  2d58994

  Copy full SHA for 2d58994

• rename sky serve controller prefix

  cblmemo

  committed
  082c88b

  Copy full SHA for 082c88b

• restore example

  cblmemo

  committed
  a4c8fc2

  Copy full SHA for a4c8fc2

• upd smoke test

  cblmemo

  committed
  63b2601

  Copy full SHA for 63b2601

Commits on Aug 27, 2023

• use asyncio

  cblmemo

  committed
  14621d3

  Copy full SHA for 14621d3

• change core with underlying function to avoid usage collection on status

  cblmemo

  committed
  55d3503

  Copy full SHA for 55d3503

• reatore comma

  cblmemo

  committed
  c9d2e28

  Copy full SHA for c9d2e28

• add comment

  cblmemo

  committed
  d236eec

  Copy full SHA for d236eec

Commits on Aug 28, 2023

• adopt comments in #2473

  cblmemo

  committed
  e3e698c

  Copy full SHA for e3e698c

Commits on Aug 31, 2023

• Apply suggestions from code review

  Show description for b288ba0
  

  cblmemo

  and

  infwinston

  committed
  b288ba0

  Copy full SHA for b288ba0

• Apply suggestions from code review

  cblmemo

  committed
  7fccb8f

  Copy full SHA for 7fccb8f

Commits on Sep 9, 2023

• fix example

  

  infwinston

  authored and

  cblmemo

  committed
  58a1122

  Copy full SHA for 58a1122

• Fix serve probe (#2513)

  Show description for 7aef306
  

  infwinston

  authored and

  cblmemo

  committed
  7aef306

  Copy full SHA for 7aef306

• [SkyServe] Add option to auto restart (#2518)

  Show description for d05b42f
  

  cblmemo

  and

  infwinston

  committed
  d05b42f

  Copy full SHA for d05b42f

• [SkyServe] Fix auto restart (#2521)

  Show description for 5200fbd
  

  cblmemo

  and

  infwinston

  committed
  5200fbd

  Copy full SHA for 5200fbd

• [SkyServe] Using Multi-service controller (#2489)

  Show description for 45e43c3
  

  cblmemo

  and

  infwinston

  committed
  45e43c3

  Copy full SHA for 45e43c3

Commits on Sep 10, 2023

• Update sky/cli.py

  Show description for fdd6332
  

  cblmemo

  and

  concretevitamin

  authored
  fdd6332

  Copy full SHA for fdd6332

• Update sky/serve/examples/stable_diffusion_service.yaml

  Show description for a93d9fa
  

  cblmemo

  and

  concretevitamin

  authored
  a93d9fa

  Copy full SHA for a93d9fa

• style for example

  cblmemo

  committed
  87b2079

  Copy full SHA for 87b2079

• format & add comments & rephrase

  cblmemo

  committed
  3dc4dac

  Copy full SHA for 3dc4dac

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  f585294

  Copy full SHA for f585294

• move serve_down to core and refactor

  cblmemo

  committed
  9850d40

  Copy full SHA for 9850d40

• Update sky/execution.py

  Show description for 2fb615d
  

  cblmemo

  and

  Michaelvll

  authored
  2fb615d

  Copy full SHA for 2fb615d

• apply suggestions from code review

  cblmemo

  committed
  aa4cda0

  Copy full SHA for aa4cda0

• move examples

  cblmemo

  committed
  3db51ca

  Copy full SHA for 3db51ca

• Update sky/cli.py

  Show description for 788c497
  

  cblmemo

  and

  Michaelvll

  authored
  788c497

  Copy full SHA for 788c497

• use _make_task_or_dag_from_entrypoint_with_overrides & minor

  cblmemo

  committed
  9bb4334

  Copy full SHA for 9bb4334

• make sky serve status accept multiple service names

  cblmemo

  committed
  bdef682

  Copy full SHA for bdef682

• minor

  cblmemo

  committed
  96419ae

  Copy full SHA for 96419ae

• minor

  cblmemo

  committed
  d0a3fb8

  Copy full SHA for d0a3fb8

• upd docstring

  cblmemo

  committed
  1eefc54

  Copy full SHA for 1eefc54

• fix

  cblmemo

  committed
  457c7a2

  Copy full SHA for 457c7a2

Commits on Sep 11, 2023

• better programmatic api

  cblmemo

  committed
  9a2d27e

  Copy full SHA for 9a2d27e

Commits on Sep 12, 2023

• ux

  cblmemo

  committed
  f4bdbdb

  Copy full SHA for f4bdbdb

Commits on Sep 13, 2023

• use flag to control logging

  cblmemo

  committed
  78d7342

  Copy full SHA for 78d7342

Commits on Sep 14, 2023

• combine reserved prefix & name

  cblmemo

  committed
  baf62f9

  Copy full SHA for baf62f9

• fix

  cblmemo

  committed
  4c52014

  Copy full SHA for 4c52014

• expand user

  cblmemo

  committed
  755114f

  Copy full SHA for 755114f

• better UX for auto restart

  cblmemo

  committed
  b547b19

  Copy full SHA for b547b19

Commits on Sep 15, 2023

• fix consecutive timeout threshold

  cblmemo

  committed
  f465e32

  Copy full SHA for f465e32

• minor

  cblmemo

  committed
  c773d70

  Copy full SHA for c773d70

Commits on Sep 16, 2023

• nnit

  cblmemo

  committed
  4eb1d44

  Copy full SHA for 4eb1d44

Commits on Sep 18, 2023

• temp remove

  cblmemo

  committed
  d83f9a2

  Copy full SHA for d83f9a2

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  ac3244b

  Copy full SHA for ac3244b

• add back

  cblmemo

  committed
  dd261d5

  Copy full SHA for dd261d5

• only open ports used

  cblmemo

  committed
  6f6d8e7

  Copy full SHA for 6f6d8e7

Commits on Sep 19, 2023

• remove redundant task yaml for load balancer

  cblmemo

  committed
  4037e7e

  Copy full SHA for 4037e7e

Commits on Sep 20, 2023

• move task ports handling to python API

  cblmemo

  committed
  0578487

  Copy full SHA for 0578487

Commits on Sep 26, 2023

• fix controller generation bug

  cblmemo

  committed
  a100433

  Copy full SHA for a100433

• UX nits

  cblmemo

  committed
  8f49ff9

  Copy full SHA for 8f49ff9

• nit

  cblmemo

  committed
  4dd0e8e

  Copy full SHA for 4dd0e8e

Commits on Sep 27, 2023

• Fix sky serve down --purge when storage cleanup failed

  cblmemo

  committed
  20dcd1b

  Copy full SHA for 20dcd1b

• ux

  cblmemo

  committed
  672840c

  Copy full SHA for 672840c

Commits on Sep 28, 2023

• reuse service handle

  cblmemo

  committed
  a8bec0d

  Copy full SHA for a8bec0d

• revert

  cblmemo

  committed
  7bb01f6

  Copy full SHA for 7bb01f6

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  9de419b

  Copy full SHA for 9de419b

• add todo

  cblmemo

  committed
  fbd2873

  Copy full SHA for fbd2873

• [SkyServe] Add Ray Serve example (#2621)

  Show description for fbde4aa
  iojw

  authored
  fbde4aa

  Copy full SHA for fbde4aa

Commits on Oct 3, 2023

• restore job id type

  cblmemo

  committed
  fa4981a

  Copy full SHA for fa4981a

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  f36cb42

  Copy full SHA for f36cb42

• Apply suggestions from code review

  Show description for 5704d05
  

  cblmemo

  and

  Michaelvll

  authored
  5704d05

  Copy full SHA for 5704d05

• lint

  cblmemo

  committed
  e47e005

  Copy full SHA for e47e005

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  3e81e8b

  Copy full SHA for 3e81e8b

• move service section to the top

  cblmemo

  committed
  a86523c

  Copy full SHA for a86523c

• add docstr

  cblmemo

  committed
  27a29b4

  Copy full SHA for 27a29b4

• make controller port not optinal

  cblmemo

  committed
  ecc0640

  Copy full SHA for ecc0640

• remove cpu demand for gpu workloads

  cblmemo

  committed
  9bf337b

  Copy full SHA for 9bf337b

• make ReservedClusterGroup.get_group accept none arg

  cblmemo

  committed
  b8ce4c4

  Copy full SHA for b8ce4c4

• nit

  cblmemo

  committed
  01bea22

  Copy full SHA for 01bea22

• remove yaml_only and task_only in _make_task_or_dag_from_entrypoint_with_overrides

  cblmemo

  committed
  d27dab8

  Copy full SHA for d27dab8

• cli nits

  cblmemo

  committed
  c00fcdf

  Copy full SHA for c00fcdf

• remove get_glob_service_names

  cblmemo

  committed
  2b43b83

  Copy full SHA for 2b43b83

Commits on Oct 4, 2023

• fix pop CPU

  cblmemo

  committed
  65b9bb2

  Copy full SHA for 65b9bb2

• remove CPU demand for job when presented in CLI

  cblmemo

  committed
  28f613d

  Copy full SHA for 28f613d

Commits on Oct 5, 2023

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  2b38cc6

  Copy full SHA for 2b38cc6

• remove cancel and use os.kill now

  cblmemo

  committed
  e973442

  Copy full SHA for e973442

• add db on controller VM, remove job id and use skylet to refresh service status

  cblmemo

  committed
  1b31110

  Copy full SHA for 1b31110

• minor

  cblmemo

  committed
  8799e09

  Copy full SHA for 8799e09

• merge controllers with normal clusters

  cblmemo

  committed
  849ba81

  Copy full SHA for 849ba81

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  e8160c7

  Copy full SHA for e8160c7

Commits on Oct 6, 2023

• deprecate controller port adn refresh in infra provider

  cblmemo

  committed
  4fa8aa0

  Copy full SHA for 4fa8aa0

Commits on Oct 10, 2023

• Apply suggestions from code review

  Show description for e0392c7
  

  3 peopleauthored
  e0392c7

  Copy full SHA for e0392c7

• use enum in serve logs + minor

  cblmemo

  committed
  b9b0a78

  Copy full SHA for b9b0a78

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  a4683bd

  Copy full SHA for a4683bd

• remove stop hint

  cblmemo

  committed
  82d01ea

  Copy full SHA for 82d01ea

• env vars & monir

  cblmemo

  committed
  e2aa2a2

  Copy full SHA for e2aa2a2

• use cluster regex and remove service regex

  cblmemo

  committed
  ef24cda

  Copy full SHA for ef24cda

• remove pylint hint & rename app_port -> replica_port

  cblmemo

  committed
  4870e73

  Copy full SHA for 4870e73

• change constants used in _maybe_translate_local_file_mounts_and_sync_up

  cblmemo

  committed
  f1406cf

  Copy full SHA for f1406cf

Commits on Oct 11, 2023

• add --endpoint and ux

  cblmemo

  committed
  686ebd9

  Copy full SHA for 686ebd9

• new termination of controller & lb; minor suggestions

  cblmemo

  committed
  9ee2cf0

  Copy full SHA for 9ee2cf0

• move statuses to serve_state, minors

  cblmemo

  committed
  ec3877a

  Copy full SHA for ec3877a

• minor

  cblmemo

  committed
  e97381e

  Copy full SHA for e97381e

• speedup terminate

  cblmemo

  committed
  e55958d

  Copy full SHA for e55958d

Commits on Oct 12, 2023

• replica db mypy & pylint passed

  cblmemo

  committed
  a952249

  Copy full SHA for a952249

• fix

  cblmemo

  committed
  688bb20

  Copy full SHA for 688bb20

• fix scale down & cleanup failed replica

  cblmemo

  committed
  09fd88e

  Copy full SHA for 09fd88e

• minor

  cblmemo

  committed
  f13e3ef

  Copy full SHA for f13e3ef

• move controller resources to config.yaml

  cblmemo

  committed
  aeca540

  Copy full SHA for aeca540

Commits on Oct 13, 2023

• fix smoke test

  cblmemo

  committed
  3155453

  Copy full SHA for 3155453

• refactor request information report

  cblmemo

  committed
  2afdfc3

  Copy full SHA for 2afdfc3

• architecture: autoscaler no longer talk with infra provider again

  cblmemo

  committed
  1fd1db5

  Copy full SHA for 1fd1db5

• fix auto restart

  cblmemo

  committed
  42e1f4a

  Copy full SHA for 42e1f4a

• sync down logs and then streaming

  cblmemo

  committed
  3f81cdb

  Copy full SHA for 3f81cdb

• terminate log streaming when service is downed

  cblmemo

  committed
  692d844

  Copy full SHA for 692d844

• refactor autoscaler & argument pass in controller

  cblmemo

  committed
  8d4f64d

  Copy full SHA for 8d4f64d

• move several var from local db

  cblmemo

  committed
  673c747

  Copy full SHA for 673c747

Commits on Oct 15, 2023

• use a control process to handle signal and terminate service

  cblmemo

  committed
  003c655

  Copy full SHA for 003c655

Commits on Oct 16, 2023

• move port selection to the controller VM

  cblmemo

  committed
  8d15ef0

  Copy full SHA for 8d15ef0

• minor

  cblmemo

  committed
  5668049

  Copy full SHA for 5668049

• refactor dataabse

  cblmemo

  committed
  2984996

  Copy full SHA for 2984996

• comments, docs and function reorder for infra providers

  cblmemo

  committed
  cf721a2

  Copy full SHA for cf721a2

• change launch/terminate replica to python API

  cblmemo

  committed
  dfcc373

  Copy full SHA for dfcc373

• fix pass task in multiprocessing

  cblmemo

  committed
  1fa207f

  Copy full SHA for 1fa207f

• minor & fix smoke test

  cblmemo

  committed
  e2365e7

  Copy full SHA for e2365e7

• rename infra_provider to replica_manager

  cblmemo

  committed
  1e7936d

  Copy full SHA for 1e7936d

• ux

  cblmemo

  committed
  1aba238

  Copy full SHA for 1aba238

Commits on Oct 17, 2023

• not count as failure if UP for more than initial_delay_seconds

  cblmemo

  committed
  6d646a6

  Copy full SHA for 6d646a6

Commits on Oct 18, 2023

• default auto restart to true

  cblmemo

  committed
  32aa294

  Copy full SHA for 32aa294

• add todo

  cblmemo

  committed
  fa4fdfa

  Copy full SHA for fa4fdfa

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  297f837

  Copy full SHA for 297f837

• upd test for auto_restart

  cblmemo

  committed
  756a669

  Copy full SHA for 756a669

Commits on Oct 21, 2023

• Use only one controller and remove local database. TODO: change to SERVICE_ID to avoid name conflict.

  cblmemo

  committed
  ea992a0

  Copy full SHA for ea992a0

• minor

  cblmemo

  committed
  6d590b4

  Copy full SHA for 6d590b4

• Apply suggestions from code review

  Show description for 8961e59
  

  cblmemo

  and

  concretevitamin

  authored
  8961e59

  Copy full SHA for 8961e59

• apply suggestion from code review

  cblmemo

  committed
  3320919

  Copy full SHA for 3320919

Commits on Oct 22, 2023

• mske sky status showing service as well

  cblmemo

  committed
  05a9f83

  Copy full SHA for 05a9f83

• fix

  cblmemo

  committed
  e2d103d

  Copy full SHA for e2d103d

• replica manager ux; use sky logger for uvicorn

  cblmemo

  committed
  0ab0dec

  Copy full SHA for 0ab0dec

Commits on Oct 23, 2023

• UX, refactoring

  cblmemo

  committed
  4ee5676

  Copy full SHA for 4ee5676

• rephrase hint after sky serve up

  cblmemo

  committed
  ce82675

  Copy full SHA for ce82675

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  a9e706a

  Copy full SHA for a9e706a

• Update sky/execution.py

  Show description for ce283f1
  

  cblmemo

  and

  concretevitamin

  authored
  ce283f1

  Copy full SHA for ce283f1

• comments

  cblmemo

  committed
  05aec69

  Copy full SHA for 05aec69

• add service name check before sky serve up

  cblmemo

  committed
  bd835d4

  Copy full SHA for bd835d4

Commits on Oct 24, 2023

• rename reserved cluster to controller

  cblmemo

  committed
  e17d789

  Copy full SHA for e17d789

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  743cabd

  Copy full SHA for 743cabd

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  5e07d5b

  Copy full SHA for 5e07d5b

• upd schema

  cblmemo

  committed
  cbfa389

  Copy full SHA for cbfa389

Commits on Oct 27, 2023

• change to async function for fastapi

  cblmemo

  committed
  3bd6c8c

  Copy full SHA for 3bd6c8c

Commits on Nov 1, 2023

• add multiple ports TODO

  cblmemo

  committed
  f97bd5b

  Copy full SHA for f97bd5b

Commits on Nov 2, 2023

• fix outdated example

  cblmemo

  committed
  8773d0c

  Copy full SHA for 8773d0c

• [SkyServe] Serving with Spot (#2749)

  Show description for 2008590
  MaoZiming

  authored
  2008590

  Copy full SHA for 2008590

Commits on Nov 3, 2023

• fix sky status pool wait

  cblmemo

  committed
  ad40472

  Copy full SHA for ad40472

• fix sync down logs failed

  cblmemo

  committed
  b5557bb

  Copy full SHA for b5557bb

Commits on Nov 4, 2023

• upd examples

  cblmemo

  committed
  8414ea7

  Copy full SHA for 8414ea7

• add gorilla notebook

  cblmemo

  committed
  f6c3d70

  Copy full SHA for f6c3d70

Commits on Nov 5, 2023

• add todo for customizable setup commands

  cblmemo

  committed
  d036560

  Copy full SHA for d036560

Commits on Nov 7, 2023

• add launch log to streaming

  cblmemo

  committed
  8327a2e

  Copy full SHA for 8327a2e

• move comment position

  cblmemo

  committed
  6f3f809

  Copy full SHA for 6f3f809

• catch error and print log

  cblmemo

  committed
  f52ebb0

  Copy full SHA for f52ebb0

• align output

  cblmemo

  committed
  8377b8a

  Copy full SHA for 8377b8a

• ux

  cblmemo

  committed
  114e751

  Copy full SHA for 114e751

• fix storage cleanup failure

  cblmemo

  committed
  30b36ba

  Copy full SHA for 30b36ba

Commits on Nov 8, 2023

• fix extra newline

  cblmemo

  committed
  74c83af

  Copy full SHA for 74c83af

• comments

  cblmemo

  committed
  d18badb

  Copy full SHA for d18badb

• Apply suggestions from code review

  Show description for c4b8b24
  

  cblmemo

  and

  concretevitamin

  authored
  c4b8b24

  Copy full SHA for c4b8b24

• rename

  cblmemo

  committed
  e241aff

  Copy full SHA for e241aff

• Update sky/core.py

  Show description for 6ba5c9f
  

  cblmemo

  and

  concretevitamin

  authored
  6ba5c9f

  Copy full SHA for 6ba5c9f

• apply suggestion from code review

  cblmemo

  committed
  8ffe0be

  Copy full SHA for 8ffe0be

Commits on Nov 9, 2023

• apply suggestion from code review

  cblmemo

  committed
  bb0542c

  Copy full SHA for bb0542c

• format

  cblmemo

  committed
  330b893

  Copy full SHA for 330b893

• move controller related functions/classes to controller_utils

  cblmemo

  committed
  2aa266b

  Copy full SHA for 2aa266b

• apply suggestion from code review

  cblmemo

  committed
  a521615

  Copy full SHA for a521615

• Update sky/exceptions.py

  Show description for 191d2ff
  

  cblmemo

  and

  Michaelvll

  authored
  191d2ff

  Copy full SHA for 191d2ff

• Update sky/serve/replica_managers.py

  Show description for 61774bc
  

  cblmemo

  and

  Michaelvll

  authored
  61774bc

  Copy full SHA for 61774bc

• import

  cblmemo

  committed
  e38fc17

  Copy full SHA for e38fc17

• Update sky/serve/autoscalers.py

  Show description for 01bbac7
  

  cblmemo

  and

  Michaelvll

  authored
  01bbac7

  Copy full SHA for 01bbac7

• move max #sky.launch to replica manager and limit total # across services

  cblmemo

  committed
  9a198b0

  Copy full SHA for 9a198b0

• refactor autoscaler

  cblmemo

  committed
  4ae8996

  Copy full SHA for 4ae8996

• pass json dict rather than pickle

  cblmemo

  committed
  84a4120

  Copy full SHA for 84a4120

• apply suggestion from code review

  cblmemo

  committed
  b6ef448

  Copy full SHA for b6ef448

• Apply suggestions from code review

  Show description for d598ed4
  

  cblmemo

  and

  Michaelvll

  authored
  d598ed4

  Copy full SHA for d598ed4

Commits on Nov 10, 2023

• apply suggestion from code review

  cblmemo

  committed
  5170225

  Copy full SHA for 5170225

• bug fix & apply suggestion from code review

  cblmemo

  committed
  8cea486

  Copy full SHA for 8cea486

• apply suggestions

  cblmemo

  committed
  8711f45

  Copy full SHA for 8711f45

• comments

  cblmemo

  committed
  6181497

  Copy full SHA for 6181497

• move port to resources

  cblmemo

  committed
  2c0f3c8

  Copy full SHA for 2c0f3c8

• add cancel test

  cblmemo

  committed
  f2b4c29

  Copy full SHA for f2b4c29

• fix controller resources cloud not specified

  cblmemo

  committed
  b68a1fd

  Copy full SHA for b68a1fd

• ux

  cblmemo

  committed
  81a88d2

  Copy full SHA for 81a88d2

• ux for down

  cblmemo

  committed
  3ba4f99

  Copy full SHA for 3ba4f99

• add smoke retry teardown

  cblmemo

  committed
  f68242c

  Copy full SHA for f68242c

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  c7183c7

  Copy full SHA for c7183c7

• resolve conflict

  cblmemo

  committed
  122de45

  Copy full SHA for 122de45

• add endpoint, move check for name conflict to _execute

  cblmemo

  committed
  33bd321

  Copy full SHA for 33bd321

Commits on Nov 11, 2023

• apply suggestion from code review

  cblmemo

  committed
  4ff9975

  Copy full SHA for 4ff9975

• fix jinja2 var

  cblmemo

  committed
  7cff543

  Copy full SHA for 7cff543

• rename reserved cluster, move controller_utils function back

  cblmemo

  committed
  aff8250

  Copy full SHA for aff8250

• stream logs

  cblmemo

  committed
  869eb75

  Copy full SHA for 869eb75

• fix not showing controller

  cblmemo

  committed
  9e5c69e

  Copy full SHA for 9e5c69e

Commits on Nov 12, 2023

• move controllers back to controller_utils

  cblmemo

  committed
  d14b5cf

  Copy full SHA for d14b5cf

• fix wrong controller resources when controller is exist

  cblmemo

  committed
  e0049bf

  Copy full SHA for e0049bf

• use return value to indicate success

  cblmemo

  committed
  f2eaabc

  Copy full SHA for f2eaabc

• default controller resources & better error handling

  cblmemo

  committed
  86f6d5f

  Copy full SHA for 86f6d5f

• stress test passed

  cblmemo

  committed
  9b812d2

  Copy full SHA for 9b812d2

Commits on Nov 13, 2023

• nits

  cblmemo

  committed
  78ac155

  Copy full SHA for 78ac155

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  d3ed24a

  Copy full SHA for d3ed24a

• fix examples

  cblmemo

  committed
  7a25afa

  Copy full SHA for 7a25afa

Commits on Nov 14, 2023

• Merge remote-tracking branch 'origin/master' into serve-dev

  cblmemo

  committed
  0a2d4bd

  Copy full SHA for 0a2d4bd

• refactor: moving some funcs in execution.py to controller_utils

  cblmemo

  committed
  8352aff

  Copy full SHA for 8352aff

• smoke test passed

  cblmemo

  committed
  0c8b734

  Copy full SHA for 0c8b734

• remove --target & minor

  cblmemo

  committed
  9c67cd0

  Copy full SHA for 9c67cd0

• teardown failed services with --purge flag

  cblmemo

  committed
  fa20443

  Copy full SHA for fa20443

• move core api to sky/serve/api.py

  cblmemo

  committed
  7793833

  Copy full SHA for 7793833

• resolve controller_utils circular import

  cblmemo

  committed
  e87042a

  Copy full SHA for e87042a

• fix spot config

  cblmemo

  committed
  a276a8f

  Copy full SHA for a276a8f

• minor ux

  cblmemo

  committed
  6889119

  Copy full SHA for 6889119

Commits on Nov 15, 2023

• add todo for default argument for sky serve logs

  cblmemo

  committed
  85a1bb0

  Copy full SHA for 85a1bb0

• resolve circular import.

  cblmemo

  committed
  bcc05ba

  Copy full SHA for bcc05ba

• fix all circular import

  cblmemo

  committed
  e3f1f33

  Copy full SHA for e3f1f33

• minor

  cblmemo

  committed
  e91b60e

  Copy full SHA for e91b60e

• apply suggestion from code review

  cblmemo

  committed
  a60be5a

  Copy full SHA for a60be5a