Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Migrate SpeechLM to NeMo 2.0 #10808

Draft
wants to merge 72 commits into
base: main
Choose a base branch
from
Draft

[WIP] Migrate SpeechLM to NeMo 2.0 #10808

wants to merge 72 commits into from

Conversation

stevehuang52
Copy link
Collaborator

What does this PR do ?

Migrate SpeechLM to NeMo 2.0

Collection: [asr,llm,slm,motimodal]

Changelog

  • Add models, datamodules, training scripts

stevehuang52 and others added 17 commits September 16, 2024 10:38
@stevehuang52
fix type bugs
d967c51 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Merge branch 'main' of https://github.com/NVIDIA/NeMo into main
84eaa59
@stevehuang52
Merge remote-tracking branch 'origin/main' into slm_v2
22217d0
@stevehuang52
Merge remote-tracking branch 'origin/main' into slm_v2
799a5ec
@stevehuang52
Update mixin.py
568f073 
add type hint

Signed-off-by: He Huang (Steve) <[email protected]>
@stevehuang52
Apply isort and black reformatting
f91030d 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Update mixin.py
c9256ca 
Signed-off-by: He Huang (Steve) <[email protected]>
@stevehuang52
Apply isort and black reformatting
e41e4f9 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Update mixin.py
2a70bd3 
Signed-off-by: He Huang (Steve) <[email protected]>
@stevehuang52
Merge branch 'main' into slm_v2
725fd88
@stevehuang52
add datamodule
de70200 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Merge remote-tracking branch 'origin/main' into slm_v2
98a2673
@stevehuang52
add speechlm peft train, continue train, validation and misc
a00e5dd 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Merge remote-tracking branch 'origin/main' into heh/speechlm_nemo2.0
52a1b0e
@stevehuang52
resolve merge confict
9d57bc6 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update datamodule
ae3c5be 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
Merge remote-tracking branch 'origin/main' into heh/speechlm_nemo2.0
c2ef987 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52 stevehuang52 requested a review from titu1994 October 8, 2024 18:58
@stevehuang52
add script
dc951e2 
Signed-off-by: stevehuang52 <[email protected]>
github-advanced-security[bot]
github-advanced-security bot found potential problems Oct 8, 2024
View reviewed changes
Copy link

@github-advanced-security github-advanced-security bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.

@stevehuang52
update data sampler
644c0b8 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update lhotse
cb2661b 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update lhotse
3db0764 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update lhotse dataset
a932673 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
debug
bd8e3e8 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
debug
44bfb2c 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
debug
43bb800 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
debug
08acb79 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
debug
ea538ed 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update
4045085 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update
108eb9d 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
add wandb to cfg yaml
7d9f855 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
add support for max_time_per_run
1338245 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
add debug info
1bc0210 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
add check
988e585 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update sampler
7a7052d 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update dataset
e8ea92f 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update dataset
b3b0f33 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
try fix peft resume
63590b3 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
try fix peft resume
e07d88a 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
clean up
bc1d434 
Signed-off-by: stevehuang52 <[email protected]>
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 4, 2024

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

Your code was analyzed with PyLint. The following annotations have been identified:

************* Module speechlm_train
examples/speechlm/speechlm_train.py:47:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.speechlm.api
nemo/collections/speechlm/api.py:64:0: C0301: Line too long (195/119) (line-too-long)
nemo/collections/speechlm/api.py:31:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/api.py:100:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/api.py:160:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.speechlm.data.audio_to_text_data
nemo/collections/speechlm/data/audio_to_text_data.py:79:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/speechlm/data/audio_to_text_data.py:348:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/speechlm/data/audio_to_text_data.py:378:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/speechlm/data/audio_to_text_data.py:385:0: C0301: Line too long (135/119) (line-too-long)
nemo/collections/speechlm/data/audio_to_text_data.py:43:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:56:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:90:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:95:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:283:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:292:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:305:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/data/audio_to_text_data.py:318:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.speechlm.models.base
nemo/collections/speechlm/models/base.py:132:0: C0301: Line too long (160/119) (line-too-long)
nemo/collections/speechlm/models/base.py:158:0: C0301: Line too long (136/119) (line-too-long)
nemo/collections/speechlm/models/base.py:177:0: C0301: Line too long (135/119) (line-too-long)
nemo/collections/speechlm/models/base.py:196:0: C0301: Line too long (135/119) (line-too-long)
nemo/collections/speechlm/models/base.py:208:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/speechlm/models/base.py:34:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/models/base.py:57:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/base.py:106:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/base.py:135:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/base.py:485:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/base.py:492:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/base.py:17:0: W0611: Unused Tuple imported from typing (unused-import)
nemo/collections/speechlm/models/base.py:17:0: W0611: Unused Union imported from typing (unused-import)
nemo/collections/speechlm/models/base.py:21:0: W0611: Unused torch.nn imported as nn (unused-import)
nemo/collections/speechlm/models/base.py:27:0: W0611: Unused model_utils imported from nemo.utils (unused-import)
nemo/collections/speechlm/models/base.py:29:0: W0611: Unused get_rank imported from nemo.utils.get_rank (unused-import)
nemo/collections/speechlm/models/base.py:29:0: W0611: Unused is_global_rank_zero imported from nemo.utils.get_rank (unused-import)
************* Module nemo.collections.speechlm.models.speech_to_text_llm_model
nemo/collections/speechlm/models/speech_to_text_llm_model.py:654:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:659:0: C0301: Line too long (135/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:668:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:675:0: C0301: Line too long (140/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:679:0: C0301: Line too long (159/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:735:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:872:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:890:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:949:0: C0301: Line too long (142/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1027:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1130:0: C0301: Line too long (142/119) (line-too-long)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:75:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:79:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:135:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:158:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:185:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:190:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:246:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:434:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:445:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:513:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:532:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:559:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:590:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:596:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:602:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:608:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:614:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:620:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:626:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:629:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:632:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:636:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:643:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:770:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:857:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:948:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1037:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1086:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1089:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1092:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1104:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1116:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:1129:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:26:0: W0611: Unused DistributedDataParallel imported from megatron.core.distributed as McoreDDP (unused-import)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:28:0: W0611: Unused get_micro_batch_size imported from megatron.core.num_microbatches_calculator (unused-import)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:37:0: W0611: Unused Float16Module imported from megatron.core.transformer.module as MCoreFloat16Module (unused-import)
nemo/collections/speechlm/models/speech_to_text_llm_model.py:39:0: W0611: Unused OmegaConf imported from omegaconf (unused-import)
************* Module nemo.collections.speechlm.modules.asr_module
nemo/collections/speechlm/modules/asr_module.py:32:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/modules/asr_module.py:44:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/modules/asr_module.py:66:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/modules/asr_module.py:86:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/modules/asr_module.py:97:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/modules/asr_module.py:23:0: W0611: Unused DictConfig imported from omegaconf (unused-import)
************* Module nemo.collections.speechlm.modules.modality_adapter
nemo/collections/speechlm/modules/modality_adapter.py:28:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/modules/modality_adapter.py:36:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/modules/modality_adapter.py:43:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/modules/modality_adapter.py:51:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.speechlm.utils.hydra_utils
nemo/collections/speechlm/utils/hydra_utils.py:46:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/hydra_utils.py:67:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/hydra_utils.py:18:0: W0611: Unused OptimizerConfig imported from megatron.core.optimizer (unused-import)
nemo/collections/speechlm/utils/hydra_utils.py:19:0: W0611: Unused OmegaConf imported from omegaconf (unused-import)
************* Module nemo.collections.speechlm.utils.model_transform
nemo/collections/speechlm/utils/model_transform.py:174:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/speechlm/utils/model_transform.py:41:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/utils/model_transform.py:121:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/utils/model_transform.py:18:0: W0611: Unused TYPE_CHECKING imported from typing (unused-import)
nemo/collections/speechlm/utils/model_transform.py:18:0: W0611: Unused Tuple imported from typing (unused-import)
nemo/collections/speechlm/utils/model_transform.py:36:0: W0611: Unused get_rank imported from nemo.utils.get_rank (unused-import)
nemo/collections/speechlm/utils/model_transform.py:36:0: W0611: Unused is_global_rank_zero imported from nemo.utils.get_rank (unused-import)
************* Module nemo.collections.speechlm.utils.text_generation.audio_text_generation_strategy
nemo/collections/speechlm/utils/text_generation/audio_text_generation_strategy.py:33:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_strategy.py:262:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_strategy.py:411:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_strategy.py:26:0: W0611: Unused build_position_ids imported from nemo.collections.nlp.modules.common.megatron.utils (unused-import)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_strategy.py:27:0: W0611: Unused logging imported from nemo.utils (unused-import)
************* Module nemo.collections.speechlm.utils.text_generation.audio_text_generation_utils
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:344:0: C0301: Line too long (173/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:350:0: C0301: Line too long (148/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:555:0: C0301: Line too long (166/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:558:0: C0301: Line too long (182/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:561:0: C0301: Line too long (177/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:622:0: C0301: Line too long (145/119) (line-too-long)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:61:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:78:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:227:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:520:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/speechlm/utils/text_generation/audio_text_generation_utils.py:525:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.modules.conv_asr
nemo/collections/asr/modules/conv_asr.py:197:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:239:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:399:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:459:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:503:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:507:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:603:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:677:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:689:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:758:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:858:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:881:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/conv_asr.py:900:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/conv_asr.py:945:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/conv_asr.py:969:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/conv_asr.py:983:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/conv_asr.py:992:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.common.data.lhotse.cutset
nemo/collections/common/data/lhotse/cutset.py:453:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/common/data/lhotse/cutset.py:483:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/common/data/lhotse/cutset.py:578:0: C0301: Line too long (139/119) (line-too-long)
nemo/collections/common/data/lhotse/cutset.py:160:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:204:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:215:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:230:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:241:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:256:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:262:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:307:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:386:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/cutset.py:434:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.common.data.lhotse.dataloader
nemo/collections/common/data/lhotse/dataloader.py:120:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:136:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:144:0: C0301: Line too long (148/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:310:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:407:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:408:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:409:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:732:0: C0301: Line too long (135/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:877:0: C0301: Line too long (213/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:884:0: C0301: Line too long (143/119) (line-too-long)
nemo/collections/common/data/lhotse/dataloader.py:176:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:382:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:574:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:625:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/dataloader.py:652:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:658:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:661:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:664:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:667:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:683:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/dataloader.py:685:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:688:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:694:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:722:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/dataloader.py:737:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:744:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:756:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/dataloader.py:20:0: W0611: Unused List imported from typing (unused-import)
nemo/collections/common/data/lhotse/dataloader.py:41:0: W0611: Unused ListConfig imported from omegaconf (unused-import)
************* Module nemo.collections.common.data.lhotse.nemo_adapters
nemo/collections/common/data/lhotse/nemo_adapters.py:49:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/common/data/lhotse/nemo_adapters.py:277:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/common/data/lhotse/nemo_adapters.py:278:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/common/data/lhotse/nemo_adapters.py:360:0: C0301: Line too long (127/119) (line-too-long)
nemo/collections/common/data/lhotse/nemo_adapters.py:369:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/common/data/lhotse/nemo_adapters.py:347:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:484:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:488:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:497:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:502:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:506:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:510:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:532:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:554:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:576:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/nemo_adapters.py:24:0: W0611: Unused import lhotse.serialization (unused-import)
************* Module nemo.collections.common.data.lhotse.text_adapters
nemo/collections/common/data/lhotse/text_adapters.py:167:0: C0301: Line too long (136/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:228:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:611:0: C0301: Line too long (144/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:642:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:651:0: C0301: Line too long (165/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:672:0: C0301: Line too long (169/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:726:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/common/data/lhotse/text_adapters.py:53:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:58:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:110:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:115:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:196:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:258:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:262:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:315:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:321:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:328:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:732:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/data/lhotse/text_adapters.py:35:0: W0611: Unused logging imported from nemo.utils (unused-import)
************* Module nemo.collections.common.prompts.llama
nemo/collections/common/prompts/llama.py:59:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/prompts/llama.py:127:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/prompts/llama.py:20:0: W0611: Unused ifnone imported from lhotse.utils (unused-import)
************* Module nemo.collections.common.tokenizers.aggregate_tokenizer
nemo/collections/common/tokenizers/aggregate_tokenizer.py:41:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:26:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:34:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:140:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:155:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:169:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:196:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:228:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:231:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:235:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/tokenizers/aggregate_tokenizer.py:239:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.llama
nemo/collections/llm/gpt/model/llama.py:493:0: C0301: Line too long (158/119) (line-too-long)
nemo/collections/llm/gpt/model/llama.py:42:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:62:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:71:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:80:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:89:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:111:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:132:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:142:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:154:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:164:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:175:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:186:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:196:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:202:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:208:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:219:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:223:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:235:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:255:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:269:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:275:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:312:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/llama.py:331:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:348:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:352:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/llama.py:485:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.multimodal.speech_llm.data.audio_text_dataset
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:200:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:213:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:218:0: C0301: Line too long (262/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:222:0: C0301: Line too long (173/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:223:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:229:0: C0301: Line too long (157/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:234:0: C0301: Line too long (147/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:235:0: C0301: Line too long (174/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:236:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:247:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:445:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:484:0: C0301: Line too long (157/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:551:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:629:0: C0301: Line too long (173/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:630:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:640:0: C0301: Line too long (147/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:641:0: C0301: Line too long (174/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:642:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:653:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:892:0: C0301: Line too long (175/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:938:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:999:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:1095:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:1141:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:338:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:496:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:512:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:845:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:867:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:956:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:1017:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:1067:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/audio_text_dataset.py:46:0: W0611: Unused logging_mode imported from nemo.utils (unused-import)
************* Module nemo.collections.multimodal.speech_llm.data.lhotse_dataset
nemo/collections/multimodal/speech_llm/data/lhotse_dataset.py:55:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/lhotse_dataset.py:56:0: C0301: Line too long (167/119) (line-too-long)
nemo/collections/multimodal/speech_llm/data/lhotse_dataset.py:28:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/data/lhotse_dataset.py:191:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.multimodal.speech_llm.modules.common.audio_text_generation_utils
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:344:0: C0301: Line too long (173/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:350:0: C0301: Line too long (148/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:555:0: C0301: Line too long (166/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:558:0: C0301: Line too long (182/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:561:0: C0301: Line too long (177/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:623:0: C0301: Line too long (145/119) (line-too-long)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:61:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:78:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:227:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:520:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/modules/common/audio_text_generation_utils.py:525:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.multimodal.speech_llm.parts.utils.data_utils
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:54:0: C0301: Line too long (134/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:55:0: C0301: Line too long (157/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:190:0: C0301: Line too long (173/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:191:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:196:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:198:0: C0301: Line too long (180/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:199:0: C0301: Line too long (145/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:264:0: C0301: Line too long (152/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:287:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:306:0: C0301: Line too long (201/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:423:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:26:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:32:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/multimodal/speech_llm/parts/utils/data_utils.py:36:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.nlp.modules.common.megatron.language_model
nemo/collections/nlp/modules/common/megatron/language_model.py:256:0: C0301: Line too long (128/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/language_model.py:577:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/language_model.py:589:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/language_model.py:714:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/language_model.py:229:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/language_model.py:349:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/language_model.py:729:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/language_model.py:744:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/language_model.py:16:0: W0611: Unused Mod imported from ast (unused-import)
nemo/collections/nlp/modules/common/megatron/language_model.py:39:0: W0611: Unused utils_funcs imported from nemo.collections.nlp.parts (unused-import)
************* Module nemo.collections.nlp.modules.common.megatron.utils
nemo/collections/nlp/modules/common/megatron/utils.py:436:0: C0301: Line too long (141/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/utils.py:456:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/nlp/modules/common/megatron/utils.py:130:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:137:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:154:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:174:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:185:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:191:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:267:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:276:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:281:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/nlp/modules/common/megatron/utils.py:310:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.core.classes.common
nemo/core/classes/common.py:688:0: C0301: Line too long (120/119) (line-too-long)
nemo/core/classes/common.py:814:0: C0301: Line too long (124/119) (line-too-long)
nemo/core/classes/common.py:921:0: C0301: Line too long (120/119) (line-too-long)
nemo/core/classes/common.py:471:0: C0115: Missing class docstring (missing-class-docstring)
nemo/core/classes/common.py:567:0: C0115: Missing class docstring (missing-class-docstring)
nemo/core/classes/common.py:642:0: C0115: Missing class docstring (missing-class-docstring)
nemo/core/classes/common.py:1021:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/core/classes/common.py:1136:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/core/classes/common.py:29:0: W0611: Unused Iterable imported from typing (unused-import)
************* Module nemo.lightning.io.mixin
nemo/lightning/io/mixin.py:65:0: C0301: Line too long (131/119) (line-too-long)
nemo/lightning/io/mixin.py:88:0: C0301: Line too long (122/119) (line-too-long)
nemo/lightning/io/mixin.py:719:0: C0301: Line too long (124/119) (line-too-long)
nemo/lightning/io/mixin.py:210:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.lightning.megatron_parallel
nemo/lightning/megatron_parallel.py:239:0: C0301: Line too long (127/119) (line-too-long)
nemo/lightning/megatron_parallel.py:240:0: C0301: Line too long (140/119) (line-too-long)
nemo/lightning/megatron_parallel.py:241:0: C0301: Line too long (130/119) (line-too-long)
nemo/lightning/megatron_parallel.py:547:0: C0301: Line too long (129/119) (line-too-long)
nemo/lightning/megatron_parallel.py:554:0: C0301: Line too long (135/119) (line-too-long)
nemo/lightning/megatron_parallel.py:813:0: C0301: Line too long (137/119) (line-too-long)
nemo/lightning/megatron_parallel.py:1043:0: C0301: Line too long (136/119) (line-too-long)
nemo/lightning/megatron_parallel.py:1617:0: C0301: Line too long (128/119) (line-too-long)
nemo/lightning/megatron_parallel.py:1656:0: C0301: Line too long (146/119) (line-too-long)
nemo/lightning/megatron_parallel.py:65:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:66:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:68:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:103:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:107:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:307:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:331:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:357:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:383:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:519:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:561:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:565:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:621:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:657:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:664:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:698:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:706:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:722:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:749:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:761:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:783:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1310:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1485:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:1491:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1497:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1501:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1506:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:1511:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:1539:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1585:8: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1607:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:1680:0: C0115: Missing class docstring (missing-class-docstring)
nemo/lightning/megatron_parallel.py:1719:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/megatron_parallel.py:1733:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.utils.callbacks.dist_ckpt_io
nemo/utils/callbacks/dist_ckpt_io.py:56:0: C0301: Line too long (141/119) (line-too-long)
nemo/utils/callbacks/dist_ckpt_io.py:80:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:165:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:168:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:171:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:350:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:383:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/utils/callbacks/dist_ckpt_io.py:15:0: W0611: Unused import os (unused-import)

-----------------------------------
Your code has been rated at 9.46/10

Thank you for improving NeMo's documentation!

@stevehuang52
refactor
354c2a9 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
refactor
811ac6c 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
fix val dl name
55d1bb8 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
fix val/test names/outputs
1425f82 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
fix lhotse name
d187a03 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
fix loss
1dc2d91 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update data statedict
47c07c9 
Signed-off-by: stevehuang52 <[email protected]>
@stevehuang52
update data module
ad35350 
Signed-off-by: stevehuang52 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@titu1994 titu1994 Awaiting requested review from titu1994

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
ASR common core Changes to NeMo Core Multi Modal NLP
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@stevehuang52 @artbataev