fix: mid aux hidden layer id calculation in online mode

[Liu-Xue-Song]

Motivation

Based on a comparison between the original paper and this repository, the implementation of the auxiliary hidden layer in the online training mode appears to be inconsistent. The correct configuration should be [1, num_layer//2-1, num_layer-4].

Additionally, I noted that this layer_id was num_layer//2-1 in version v0.1.0, but it was modified in commit 94d6710.

Modifications

fix the mid aux hidden layer id from num_layer//2 to num_layer//2-1 ,in core/eagle3.py

Related Issues

Accuracy Test

Benchmark & Profiling

Checklist

• Format your code according to the Code Formatting with Pre-Commit.
• Add unit tests as outlined in the Running Unit Tests.
• Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
• Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
• For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
• Please feel free to join our Slack channel at https://sgl-fru7574.slack.com/archives/C09784E3EN6 to discuss your PR.

[gemini-code-assist]

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

[FrankLeeeee]

Thanks!