Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature]: add embedding parallel #438

Merged
merged 69 commits into from
Jan 3, 2024
Merged

[feature]: add embedding parallel #438

merged 69 commits into from
Jan 3, 2024

Conversation

chengmengli06
Copy link
Collaborator

  1. add support for dense embedding parallel
  2. add support for sparse(sok) embedding parallel

杨熙 and others added 30 commits October 18, 2023 14:52
add support for keep model
54c9e9e
@chengmengli06
add adam_s
bd5bd02
@chengmengli06
add sok debug case2
ae74f18
@chengmengli06
add drop_remainder option as required by sok
bbfe530
@chengmengli06
add adam sparse
5477cb2
@chengmengli06
fix parquet input bugs
23a9fba
@chengmengli06
add all2all impl
4ce5229
@chengmengli06
add saver for sok
628674a
@chengmengli06
add missing files
a1032da
@chengmengli06
add support for eval
7f33ddb
@chengmengli06
add load kv embed op
5d858be
@chengmengli06
fix bug
b5a143e
@chengmengli06
add export sok embed
d0910e3
@chengmengli06
fix sok optimizer wrapper call _finish two times bug
e844169
@chengmengli06
no need to switch non slot
b60e3ba
@chengmengli06
add support for lookup only
4124a16
@chengmengli06
remove debug code
40fd1a7
@chengmengli06
fix dynamic partition bug
592f7bd
@chengmengli06
add load embed to whl package
a1909cb
@chengmengli06
optimize segment_ids performance
dc3e45b
@chengmengli06
add predictor files
528fa3b
@chengmengli06
fix predict bug
34938de
@chengmengli06
fix bug
03fb4d9
@chengmengli06
fix eval bug and dense grad bug
e3613f3
@chengmengli06
add support for dense lookup in distributed mode
3292707
@chengmengli06
refactor code style
bf0edb0
@chengmengli06
add support for finetune
76937dc
@chengmengli06
add support for ALL_COLUMNS in parquet predictor
e3b91a5
@chengmengli06
fix predict bug
62ef27d
@chengmengli06
fix numpy version
7c55ff7
@github-actions GitHub Actions
Copy link

Code Style Test Passed

@github-actions GitHub Actions
Copy link

Code Style Test Passed

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 2, 2024

Code Style Test Passed

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 3, 2024

Code Style Test Passed

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 3, 2024

Code Style Test Passed

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 3, 2024

Code Style Test Passed

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 3, 2024

Code Style Test Passed

tiankongdeguiji
tiankongdeguiji approved these changes Jan 3, 2024
View reviewed changes
Copy link
Collaborator

@tiankongdeguiji tiankongdeguiji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 3, 2024

Code Style Test Passed

@chengmengli06 chengmengli06 merged commit fddb73a into master Jan 3, 2024
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tiankongdeguiji tiankongdeguiji tiankongdeguiji approved these changes

@poson poson poson approved these changes

@yangxudong yangxudong Awaiting requested review from yangxudong

@dawn310826 dawn310826 Awaiting requested review from dawn310826

Assignees
No one assigned
Labels
code_style_test_passed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@chengmengli06 @CLAassistant @poson @tiankongdeguiji