Skip to content

Commit

Permalink
lora alpha type switch (#111)
Browse files Browse the repository at this point in the history
should be an int rather than float

Signed-off-by: Charlie Doern <[email protected]>
  • Loading branch information
cdoern authored Jun 27, 2024
1 parent d9237f8 commit afb251d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/instructlab/training/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ class LoraOptions(BaseModel):
"""

rank: int = 4
alpha: float = 32
alpha: int = 32
dropout: float = 0.1
target_modules: list[str] = Field(
default_factory=lambda: ["q_proj", "k_proj", "v_proj", "o_proj"]
Expand Down

0 comments on commit afb251d

Please sign in to comment.