Code

Misc improvements#5

Code

Closed

chiragjn wants to merge 9 commits intomain-b1d2921truefoundry/axolotl:main-b1d2921from misc-improvementstruefoundry/axolotl:misc-improvementsCopy head branch name to clipboard

+164-28

Commits

Commits on Aug 19, 2024

• Fix memory leak from sigint signal and deepspeed

  chiragjn

  committed
  5fc501a

• Don't install the sigint handler

  chiragjn

  committed
  601e22a

• Add option to raise error on longer sequences + warn about number of dropped sequences

  chiragjn

  committed
  14029b8

• Add a chat template for mistral that supports system messages

  chiragjn

  committed
  51f2348

• Move the check for dataset len before sampler

  chiragjn

  committed
  a992afd

• Add choice to use tokenizer's default chat template if available

  Show description for bbe13cc
  chiragjn

  committed
  bbe13cc

• Drop sequences that do not have any outputs to learn

  chiragjn

  committed
  7a681e0

• Fix sample packing with multiple gpus and val set provided

  chiragjn

  committed
  6751269

• Turn off truncation in chat template strategy to do length checks correctly

  chiragjn

  committed
  294e909