如何在无监督任务中使用ColossalAI #1065
Unanswered
pigen01
asked this question in
Community | Q&A
Replies: 1 comment 1 reply
-
在 deepspeed 中可以通过 GatheredParameters 回收某一层的权重参数,colossalAI 中是否也存在类似的函数?如果有的话该如何实现?
|
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
无监督行人重识别任务中, 会出现如下将特征聚类中心写进分类器权值的操作,在ColossalAI中该如何实现?
model.module.classifier.weight.data[0:source_classes].copy_(source_centers.cuda())
Beta Was this translation helpful? Give feedback.
All reactions