Organize benchmark, inspections, modules

Removed unused modules, moved benchmarks and ckpt inspections
ReaLLMASIC · Dec 19, 2024 · 6d78228 · 6d78228
1 parent fa005ef
commit 6d78228
Show file tree

Hide file tree

Showing 8 changed files with 3 additions and 11 deletions.
diff --git a/.gitmodules b/.gitmodules
@@ -1,9 +1,3 @@
 [submodule "data/template/whisper.cpp"]
 	path = data/template/whisper.cpp
 	url = https://github.com/ggerganov/whisper.cpp.git
-[submodule "modules/nanoGPT"]
-	path = modules/nanoGPT
-	url = https://github.com/karpathy/nanoGPT
-[submodule "modules/llm.c"]
-	path = modules/llm.c
-	url = https://github.com/karpathy/llm.c.git
diff --git a/README.md b/README.md
@@ -174,7 +174,7 @@ parent directory.
 
 Example usage:
 ```bash
-python3 inspect_ckpts.py --directory ./out --sort loss
+python3 checkpoint_analysis/inspect_ckpts.py --directory ./out --sort loss
 ```
 
 ![image](./images/inspect_ckpts.png)
@@ -183,7 +183,7 @@ This can be wrapped with color via the watch command for a realtime dashboard.
 
 For example to look at all checkpoint files in the out directory:
 ```bash
-watch --color 'python3 inspect_ckpts.py --directory ./out --sort loss'
+watch --color 'python3 checkpoint_analysis/inspect_ckpts.py --directory ./out --sort loss'
 ```
 
 As with remainder of the repo, this script is provided as a base to open up for
@@ -194,7 +194,7 @@ additional community contributions.
 If using tensorboard for logging, we have provided a convenience script:
 
 ```bash
-bash start_tensorboard.sh
+source ./logging/start_tensorboard.sh
 ```
 
 You can view live validation loss updates on url: [http://localhost:6006](http://localhost:6006)

diff --git a/bench.py → benchmarks/bench.py b/bench.py → benchmarks/bench.py
diff --git a/softmax_sweep.py → benchmarks/softmax_sweep.py b/softmax_sweep.py → benchmarks/softmax_sweep.py
diff --git a/inspect_ckpts.py → checkpoint_analysis/inspect_ckpts.py b/inspect_ckpts.py → checkpoint_analysis/inspect_ckpts.py
diff --git a/steering_vector_util/obtain_vector.sh → demos/obtain_vector.sh b/steering_vector_util/obtain_vector.sh → demos/obtain_vector.sh
diff --git a/modules/llm.c b/modules/llm.c
diff --git a/modules/nanoGPT b/modules/nanoGPT