Skip to content

Commit

Permalink
Reorganize utils into specific directories
Browse files Browse the repository at this point in the history
Trying to get the root repo into fewer folders and move files in the
root into directories.
  • Loading branch information
gkielian committed Dec 19, 2024
1 parent 721db7b commit fa005ef
Show file tree
Hide file tree
Showing 11 changed files with 13 additions and 16 deletions.
File renamed without changes.
File renamed without changes.
8 changes: 0 additions & 8 deletions factorization_util/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,11 +72,3 @@ This example command will:

- If the matrix path is not provided, the script will generate a random matrix with a shape of `(50000, 384)` for factorization.
- Ensure that your environment is set up to access Vizier services.

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.

---

This `README.md` provides an overview of the script's functionality, instructions on how to install dependencies, details on command-line arguments, and example usage.
File renamed without changes.
File renamed without changes.
2 changes: 1 addition & 1 deletion sample.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
from collections import OrderedDict

from model import GPT, GPTConfig
from model_info_util.model_info import print_summary, print_module_structure, print_model_blocks
from utils.model_info import print_summary, print_module_structure, print_model_blocks
from variations.model_variations import model_variation_dictionary

def parse_args():
Expand Down
19 changes: 12 additions & 7 deletions train.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,18 @@
import sys
import time

from model_info_util.model_info import print_summary, print_module_structure, print_model_blocks, print_model_tree
from monitoring_util.gpu_monitoring import get_gpu_memory_info
from utils.gpu_monitoring import get_gpu_memory_info
from utils.model_info import (
print_summary,
print_module_structure,
print_model_blocks,
print_model_tree,
)
from utils.statistic_plots import (
initialize_statistics,
plot_statistics,
create_statistics,
)

from rich.progress import Progress

Expand All @@ -22,11 +32,6 @@
from torch.distributed import destroy_process_group, init_process_group
from torch.nn.parallel import DistributedDataParallel as DDP
from torch.utils.tensorboard import SummaryWriter
from statistics_util.statistic_plots import (
initialize_statistics,
plot_statistics,
create_statistics,
)
from variations.model_variations import model_variation_dictionary

from model import GPT, GPTConfig
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 comments on commit fa005ef

Please sign in to comment.