Skip to content
/ FiPS Public

Codebase for "LEARNING PARAMETER SHARING WITH TENSOR DECOMPOSITIONS AND SPARSITY"

Notifications You must be signed in to change notification settings

cemuyuk/FiPS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FiPS (Fine-grained Parameter Sharing)

Paper: Learning Parameter Sharing with Tensor Decompositions and Sparsity

Research on model compression via parameter sharing, sparsity, parameter sharing, and parameter efficient fine-tuning.

Getting Started

Installation

  1. Clone the repo
  2. Run git submodule init && git submodule update
  3. Run poetry config virtualenvs.in-project true && poetry install

Some Abbreviations

lrm: Low Rank Masked - Layer / Model

About

Codebase for "LEARNING PARAMETER SHARING WITH TENSOR DECOMPOSITIONS AND SPARSITY"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published