这个仓库是作为学习Karpathy老师的 https://github.com/karpathy/llm.c 项目的复现笔记，作者将尽可能尝试使用Cpp和CUDA C， 复现过程中可能会在Karpathy的基础上添加更详细的注释。 再次感谢llm.c项目激发了我的学习热情，本仓库没有任何令作者获利的目的，严格遵守MIT license，仅作为CUDA with C++编程学习使用。
This repository is intended as a leaning notebook for Karpathy's llm.c project， https://github.com/karpathy/llm. The author will try to implement the project using C++ and CUDA C as much as possible. And I hope to place more detailed annotations in the code. Again, thanks for the llm.c project for inspiring the author's learning passion. This repository is not intended to make any profit for the author. It strictly follows the MIT license and is intended for CUDA with C++ programming learning purposes only.
目前，根据llm.c的指引完成了layernorm.cpp的实现，位于layernormCpp目录下。-2024.6.18
At this moment, I completed the implementation of layernorm.cpp following the guidance of llm.c, which is located in the layernormCpp directory. -18th June, 2024