[Misc] Bugfix and improve simulator&&api_server performance

[ZeldaHuang]

1. fix typo in benchmark_serving.py.
2. Improve api server throughput.
3. Record inference latency in executor to improve simulator accuracy.
4. Use real profiling latency data by default(rather than estimated data) to improve simulator accuracy.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

---

智鸣 seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}