[WIP] Clean up 'Direct' usage in resource config

[maqiuyujoyce]

Change description

Fixes #

Tests you have done

• Run make ready-pr to ensure this PR is ready for review.
• Perform necessary E2E testing for changed resources.

[google-oss-prow]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from maqiuyujoyce. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[yuwenma]

I like the big improvements this PR does. Though the PR size scares me (and it's still WIP 😆 ). Can we start splitting them into smaller PRs if any of those improvements are ready to go before it grows too big?