Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
liuxu77 committed Nov 1, 2024
1 parent 1e37bb9 commit 3735dce
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion project/moirai-moe-1/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Our paper [Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixt
The figure below presents the major difference between Moirai-MoE and Moirai. Compared to Moirai using multi-heuristic-defined input/output projection layers to model time series with different frequencies, Moirai-MoE utilizes a single input/output projection layer while delegating the task of capturing diverse time series patterns to the sparse mixture of experts Transformers. With these designs, the specialization of Moirai-MoE is achieved in a data-driven manner and operates at the token level.

<p align="center">
<img src="./img/framework.png" height="300" alt="" align=center />
<img src="./img/framework.png" width="700" alt="" align=center />
</p>


Expand Down

0 comments on commit 3735dce

Please sign in to comment.