Find 2.0 design

[daniellowell]

Let's begin the planning for Find 2.0.

Some preliminary requirements:

1. Find 2.0 should unify the perf data structure of Findv1.0 and immediate mode
2. Find 2.0 should be able to accept the uint64 solver ID

[atamazov]

Clarifications/Rationale/Plan

• (100) Find 2.0 API.
  • The main goal is interoperability between Find and Immediate modes.
  • Simplification/robustness of MIOpen code.
  • (100.1) Find-db: Change structure to better suit Immediate mode
    • Why: Currently find-db "mirrors" requirements imposed by Find 1.0 API. It is able to hold only one set of metrics per algorithm; if more than one Solver is available within algorithm, then only the "fastest" metrics are stored. In other words, the fastest Solver may "hide" other fast Solvers of the same algorithm, and Immediate Mode does not return the full information to the caller. We need to store metrics from all applicable Solvers.
    • This would also resolve Updating fdb to have multiple solvers #1987 at once.
    • 🛠️ Implemented in Restructure find-db to match Find2.0 requirements #2033
  • (100.10) Make sure that Find 2.0 API returns miopenConvSolution_t (or information compatible with it) and can be used as a replacement of Find 1.0 API.
    • 🛠️ Implemented in [API] Solver id getter from a solution and solver id to algo converter #2104
    • Partially described at Using different handles for miopenFindConvolutionForwardAlgorithm and miopenConvolutionForward  #2082 (comment)
  • (100.20) Announce deprecation of Find 1.0 API.
  • (100.30) Dismiss miopenConvAlgoPerf_t and finally turn algorithm from a base value denoting the found convolution into an attribute of it.
  • (100.40) Remove Find 1.0 API and its rudiments (from the invoker cache etc). Announce final removal of Find 1.0 API.
• (110) Expose solver_id string <-> uint64 conversions. Write tests for those.
  • Partially described at Using different handles for miopenFindConvolutionForwardAlgorithm and miopenConvolutionForward  #2082 (comment)
  • Note: This plus bullet (100) allows us to implement https://github.com/AMDComputeLibraries/MLOpen/issues/426 (outdated?)

Origins:

• https://github.com/AMDComputeLibraries/MLOpen/issues/1938 "Architectural improvements", bullet (100)
• https://github.com/AMDComputeLibraries/MLOpen/issues/2093 "Find 2.0"

[atamazov]

Another specific requirement (from #424):

/// \todo Extend miopenConvSolution_t with an attribute indicating
/// how the solution was obtained (benchmarked on the current system,
/// taken from the System find-db, heuristically estimated, produced by
/// MLP classifier...) and then remove the fallbackPathTaken out param.
void ConvolutionDescriptor::GetForwardSolutions(Handle& handle,
                                                ...
                                                bool* const fallbackPathTaken) const

[atamazov]

#374 (comment) updated. @DrizztDoUrden Please assign yourself to this ticket.

[atamazov]

#374 (comment) updated.