Skip to content

Commit

Permalink
Fixed string literal error
Browse files Browse the repository at this point in the history
  • Loading branch information
SulRash authored Oct 6, 2024
1 parent c92a3bf commit eadf902
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion nemo_aligner/data/nlp/datasets.py
Original file line number Diff line number Diff line change
Expand Up @@ -454,7 +454,7 @@ class RegressionRewardModelDataset(RewardModelDataset):
we should set missing attributes to model.regression.loss_mask_val(according to training_rm.yaml)
in the dataset files so that their losses are masked. At least one attribute should be present for each sample.
WARNING: It's recommended to preprocess your data in advance to ensure all samples are within self.seq_length.
WARNING: It is recommended to preprocess your data in advance to ensure all samples are within self.seq_length.
Otherwise if all samples in a batch are longer than self.seq_length, you may get NaN loss.
"""

Expand Down

0 comments on commit eadf902

Please sign in to comment.