You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Weights from pretrained model not used in BertForSequenceClassification: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.phrase_predictions.transform.dense.weight', 'cls.phrase_predictions.transform.dense.bias', 'cls.phrase_predictions.transform.LayerNorm.weight', 'cls.phrase_predictions.transform.LayerNorm.bias', 'cls.phrase_predictions.decoder.weight', 'cls.phrase_predictions.decoder.bias']
Are these weights essential during finetuning? Did you come across the same problem when implementing sentibert? If so, how did you solve it? The bin file and json file are downloaed from your link.
"这些参数没有加载成功是否会影响整体的准确率呀,您在实现的时候这些参数加载成功了么,模型文件和json文件是从您提供的链接下载的,应该没有问题"
The text was updated successfully, but these errors were encountered:
Weights from pretrained model not used in BertForSequenceClassification: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.phrase_predictions.transform.dense.weight', 'cls.phrase_predictions.transform.dense.bias', 'cls.phrase_predictions.transform.LayerNorm.weight', 'cls.phrase_predictions.transform.LayerNorm.bias', 'cls.phrase_predictions.decoder.weight', 'cls.phrase_predictions.decoder.bias']
Are these weights essential during finetuning? Did you come across the same problem when implementing sentibert? If so, how did you solve it? The bin file and json file are downloaed from your link.
"这些参数没有加载成功是否会影响整体的准确率呀,您在实现的时候这些参数加载成功了么,模型文件和json文件是从您提供的链接下载的,应该没有问题"
The text was updated successfully, but these errors were encountered: