Code

Support lazy model init#60

Code

Draft

linziyi96 wants to merge 5 commits intomainAlpha-VLLM/LLaMA2-Accessory:mainfrom lazy_initAlpha-VLLM/LLaMA2-Accessory:lazy_initCopy head branch name to clipboard

+751-298

Commits

Commits on Aug 28, 2023

• layer with reset_parameter implemented.

  linziyi96

  committed
  1dd80cf

Commits on Aug 29, 2023

• update peft modules.

  linziyi96

  committed
  a4d811e

Commits on Sep 1, 2023

• update utils for new tensor parallel layers

  linziyi96

  committed
  9852978

• default_tensor_type supports meta creation

  Show description for 4266554
  linziyi96

  committed
  4266554

• visual models disable meta creation

  linziyi96

  committed
  af37bbd