[BUG] Getting started: FlyteScopedUserException

[mmathys]

Describe the bug

I ran all the instructions in the getting started guide. However, I encountered the following error when running pyflyte run example.py training_workflow --hyperparameters '{"C": 0.1}'

FlyteScopedUserException: 'target'                                                                                                                                                                                                                                           
Failed with Unknown Exception <class 'KeyError'> Reason: 'Encountered error while executing workflow \'example.training_workflow\':\n  "Error encountered while executing \'training_workflow\':\\n  \'target\'"'
'Encountered error while executing workflow \'example.training_workflow\':\n  "Error encountered while executing \'training_workflow\':\\n  \'target\'"'

I also applied the fsspec hotfix as described in #4414:

pip install fsspec<2023.10.0

Expected behavior

I expected the getting started example to run without errors when running the command:

pyflyte run example.py training_workflow --hyperparameters '{"C": 0.1}'

Additional context to reproduce

Code from getting started for reference

import pandas as pd
from sklearn.datasets import load_wine
from sklearn.linear_model import LogisticRegression

import flytekit.extras.sklearn
from flytekit import task, workflow


@task
def get_data() -> pd.DataFrame:
    """Get the wine dataset."""
    return pd.DataFrame()

@task
def process_data(data: pd.DataFrame) -> pd.DataFrame:
    """Simplify the task from a 3-class to a binary classification problem."""
    return data.assign(target=lambda x: x["target"].where(x["target"] == 0, 1))

@task
def train_model(data: pd.DataFrame, hyperparameters: dict) -> LogisticRegression:
    """Train a model on the wine dataset."""
    features = data.drop("target", axis="columns")
    target = data["target"]
    return LogisticRegression(max_iter=3000, **hyperparameters).fit(features, target)

@workflow
def training_workflow(hyperparameters: dict) -> LogisticRegression:
    """Put all of the steps together into a single workflow."""
    data = get_data()
    processed_data = process_data(data=data)
    return train_model(
        data=processed_data,
        hyperparameters=hyperparameters,
    )

Screenshots

No response

Are you sure this issue hasn't been raised already?

• Yes

Have you read the Code of Conduct?

• Yes

[davidmirror-ops]

Hi @mmathys

I haven't been able to repro this issue. Would you mind sharing what version of flytekit are you using?

[mmathys]

@davidmirror-ops I am using flytekit==1.10.0

[mmathys]

I just upgraded and retested this with flytekit==1.10.1, still the same error.

[mmathys]

Hi there! Is there any news to this issue?

[davidmirror-ops]

@mmathys what Python version are you running? I'm curious about the 'Target' error.

[eapolinario]

I'm not able to repro this. @mmathys , can you run pip freeze and also share the python version and architecture you're seeing this on?

[mmathys]

Hi! We decided to move on to another solution. Therefore I am closing this issue. Thanks for following up.