Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DTensor & DModule & DOptim] feature updates #20

Merged
merged 8 commits into from
Apr 3, 2024

Conversation

jc-bytedance
Copy link
Collaborator

@jc-bytedance jc-bytedance commented Apr 3, 2024

In this PR, we update some features in our DTensor & DModule & DOptim implementations, Yo~

DTensor Updates:

  1. Support more dtensor ops.
  2. Sharding Strategy Updates.

DModule Updates:

  1. Decouple uneven support and run check.
  2. Reduce some CPU overhead.

DOptim Updates:

  1. More fridenly API.
  2. Unit test updates.
  3. Reorder some communication for better results.

Other Updates/fixes:

  1. Some minor update on our nano GPT model and test results.

jc-bytedance and others added 7 commits April 2, 2024 11:59
Revert "update ci"

This reverts commit 027b231fa06e3e106cd585c9881ce0e62aa545da.

update ci

revert change

update ci.yaml

add docker and ci
This reverts commit a49acfd.
@jc-bytedance jc-bytedance marked this pull request as draft April 3, 2024 21:50
@jc-bytedance jc-bytedance added the enhancement New feature or request label Apr 3, 2024
@jc-bytedance jc-bytedance marked this pull request as ready for review April 3, 2024 23:08
@jc-bytedance jc-bytedance merged commit 364c3b2 into volcengine:main Apr 3, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants