Skip to content

Commit

Permalink
Update adamw.cpp
Browse files Browse the repository at this point in the history
  • Loading branch information
mspronesti committed Aug 5, 2024
1 parent 06d3c13 commit 8a0092f
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion dev/sycl/adamw.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@
#include <ctime>
#include "common.hpp"

// --
void adamw_cpu(float* params_memory, const float* grads_memory, float* m_memory, float* v_memory, int t, long num_parameters,
float learning_rate=1e-3, float beta1=0.9, float beta2=0.999, float eps=1e-8, float weight_decay=0.0) {
for (long i = 0; i < num_parameters; i++) {
Expand Down Expand Up @@ -192,4 +193,4 @@ int main(int argc, char** argv) {
delete[] v_memory;

return 0;
}
}

0 comments on commit 8a0092f

Please sign in to comment.