Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When using dask distributed : AttributeError: type object 'Sentinel1Meta' has no attribute 'reader' #176

Open
Skealz opened this issue Aug 7, 2023 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@Skealz
Copy link
Collaborator

Skealz commented Aug 7, 2023

I followed this guide : https://cyclobs.ifremer.fr/static/sarwing_datarmor/xsar/examples/xsar_batch_datarmor.html
but without using a notebook. (basically, using :
res = ddf_l1.map_partitions(batch_processing, meta=('foo', str))
res.persist()
)

I end up getting this error : AttributeError: type object 'Sentinel1Meta' has no attribute 'reader'

It seems that the BlockingActorProxy() class doesn't work correctly.
In BlockingActorProxy init function, when I change a part of the code to :

        if False: #self._dask_client is not None:
            logger.debug('submit new actor')
            self._actor_future = self._dask_client.submit(self._cls, *args, **kwargs, actors=True)
            self._actor = self._actor_future.result()
        elif self._actor is None:
            # transparent proxy: no future
            self._actor = self._cls(*args, **kwargs)

I no longer get the error and the code works as expected.

@agrouaze agrouaze self-assigned this Oct 26, 2023
@agrouaze agrouaze added the bug Something isn't working label Oct 26, 2023
@agrouaze
Copy link
Member

I have to dig in the code to understood why we have this BlockingActorProxy. If it appears that it is no more needed I would be happy to remove it. @Skealz Do you want to propose a pull request?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants