Fix FlyteFS

[pingsutw]

Tracking issue

NA

Why are the changes needed?

Failed to upload the FlyteFile to ABFS

What changes were proposed in this pull request?

Add additional metadata to the request header

How was this patch tested?

pyflyte --verbose run --remote test2.py wf --f test/test.csv --d test

import pandas as pd

from flytekit import task, workflow
from flytekit.types.directory import FlyteDirectory
from flytekit.types.file import FlyteFile


@task()
def print_data_directory(f: FlyteFile, d: FlyteDirectory):
    df = pd.read_csv(f)
    print(d)
    print(df.head())


@workflow
def wf(f: FlyteFile, d: FlyteDirectory):
    print_data_directory(f=f, d=d)

Setup process

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

Blocked by flyteorg/flyte#4971

Docs link

NA

[codecov]

Codecov Report

Attention: Patch coverage is 60.00000% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 83.31%. Comparing base (d7c6029) to head (88614ff).
Report is 22 commits behind head on master.

Files	Patch %	Lines
flytekit/remote/remote_fs.py	0.00%	4 Missing ⚠️
flytekit/clients/friendly.py	75.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2208      +/-   ##
==========================================
- Coverage   85.99%   83.31%   -2.68%     
==========================================
  Files         320      309      -11     
  Lines       24246    24011     -235     
  Branches     3666     3478     -188     
==========================================
- Hits        20850    20005     -845     
- Misses       2745     3384     +639     
+ Partials      651      622      -29     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[eapolinario]

This solution looks like it's papering over the problem. Why is this specific to Azure? I have a feeling that either stow is not returning the etag in https://github.com/flyteorg/flyte/blob/6f5c47154549dd9f697f4a44547eda5197d40a52/flyteadmin/dataproxy/service.go#L83 or Azure is not returning the etag in that specific case (a HEAD request to fill metadata).

[wild-endeavor]

thanks!