Calculation Procedure for GMACS

[krkrkrrk]

Hello

In #75, you stated, “We manually added a flops method to calculate FLOPs for each block in our network in a top-down manner.” Could you please explain the specific calculation procedure for GMACS?

[tzzcl]

For the specific code, we manually calculate the forward FLOPs of each module and accumulate into the final FLOPs.

[krkrkrrk]

Let me confirm again as I haven't fully understood. Did you calculate everything manually without using any programs? Or did you calculate most of it using a program and only calculate certain modules manually? If you used any program, could you share it with me?

[happyharrycn]

Our implementation is similar to most FLOPS/GMACS counters (e.g., here and the PyTorch version). It enumerates all modules within a given model and calculates the theoretical FLOPS/GMACS for each module based on factors such as input size and the number of parameters. For reference, we refer to the aforementioned code.