Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create dispatch system for executors #3263

Open
wants to merge 41 commits into
base: main
Choose a base branch
from
Open

Commits on Oct 20, 2024

  1. Configuration menu
    Copy the full SHA
    6aa977f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c23c38d View commit details
    Browse the repository at this point in the history
  3. Draft executor dispatch.

    csarofeen committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    bf835ec View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3d7f017 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    61f7cb5 View commit details
    Browse the repository at this point in the history
  6. Fix build with executor dispatch (still test failures). Make sure Fus…

    …ionExecutorCache instances are consistently named executor_cache.
    csarofeen committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    48fdaef View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Configuration menu
    Copy the full SHA
    a44018e View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Configuration menu
    Copy the full SHA
    0e10199 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Configuration menu
    Copy the full SHA
    8ed49a1 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Rename HostIrExecutor to HostIrEvaluator, move HostIRExecutor to mult…

    …idevice/executor.[cpp,h] and rename to HostIrExecutor.
    csarofeen committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    b8c3118 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    21340b4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    84c2332 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    075c293 View commit details
    Browse the repository at this point in the history
  5. Revert whitespace changes.

    csarofeen committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    9229abd View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    fc5d788 View commit details
    Browse the repository at this point in the history
  7. Fix merge conflicts.

    csarofeen committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    fe05a3a View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. Fix matmul tests.

    csarofeen committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    76a100d View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Fix executor in host ir evaluator for host unit, send it to KernelExe…

    …cutor through ExecutorDispatch.
    csarofeen committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    55b24f6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d372ae2 View commit details
    Browse the repository at this point in the history
  3. Merge fixes.

    csarofeen committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    097674d View commit details
    Browse the repository at this point in the history
  4. clang tidy

    csarofeen committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    c917725 View commit details
    Browse the repository at this point in the history
  5. profiler fix

    csarofeen committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    cb14bb9 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    88a58cd View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Configuration menu
    Copy the full SHA
    d829e41 View commit details
    Browse the repository at this point in the history
  2. Merge fixes.

    csarofeen committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    38cce1e View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Fix serialization errors in executor dispatch (#3353)

    During deserialization, iterate over all executors in `FusionKernelRuntime`. If it is a `KernelExecutor`, use the `group_id` for the `SegmentedGroup` to find the corresponding serialized `KernelExecutors` buffer. Then, use the buffer to deserialize the `KernelExecutor`. For `HostIrExecutor` and `ExprEvalExecutor` compile normally.
    rdspring1 authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    68e2692 View commit details
    Browse the repository at this point in the history
  2. PR Comments part 1.

    csarofeen committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    2749521 View commit details
    Browse the repository at this point in the history
  3. PR Comments part 2.

    csarofeen committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    198e6d4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f4acdb7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    6312789 View commit details
    Browse the repository at this point in the history
  6. Last PR Comment cleanup.

    csarofeen committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3f2503f View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Configuration menu
    Copy the full SHA
    8290e5c View commit details
    Browse the repository at this point in the history
  2. Avoid clang-tidy warning

    naoyam committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    dccaef0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9b1a4e4 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. cleanup

    naoyam committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    b33c8e1 View commit details
    Browse the repository at this point in the history
  2. cleanup

    naoyam committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    0c8043f View commit details
    Browse the repository at this point in the history
  3. cleanup

    naoyam committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    b1634f3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6df7ae1 View commit details
    Browse the repository at this point in the history
  5. cleanup

    naoyam committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    6ebc56f View commit details
    Browse the repository at this point in the history
  6. typo

    naoyam committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    f10c3af View commit details
    Browse the repository at this point in the history
  7. Set fusion_id and device_id of KernelExecutor in constructor fo…

    …r user scheduling. (#3357)
    
    The goal is to set `fusion_id` and `device_id` when creating
    `KernelExecutor` for `UserSchedule. Previously, it was set during
    `FusionExecutor::compileFusion`. This PR is stacked on
    `executor_dispatch`
    
    **Changes to `UserSchedule` cache system:**
    **Current:** The map key is the integer value of input arguments. The
    vector is of size `device id`.
    `std::unordered_map<size_t, std::vector<UserSchedule>>
    user_def_schedules;`
    
    **New:** The key to first map is the integer value of input arguments.
    The key to second map is of `device`.
    
    **Why?** We can set the the `fusion_id` and `device_id` in the
    constructor of `UserSchedule` and `KernelExecutor`.
    rdspring1 authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    5e24332 View commit details
    Browse the repository at this point in the history