Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory error or something else? #16

Open
kkakosim opened this issue Feb 28, 2021 · 4 comments
Open

Memory error or something else? #16

kkakosim opened this issue Feb 28, 2021 · 4 comments

Comments

@kkakosim
Copy link

Hi,
I am fitting a baseline in a large dataset (52k points) with a memory error:

....julia\packages\PyCall\tqyST\src\pyfncall.jl:43 =# @pysym(:PyObject_Call), PyPtr, (PyPtr, PyPtr, PyPtr), o, pyargsptr, kw))))) <class 'MemoryError'>
MemoryError((51752, 51752), dtype('float64'))...

the function call and arguments seem to be ok because it completes with way less data (~1k). Because of large gradients (sharp peaks) I would like to avoid decimating or smoothing the data. Is this a memory issue or something else?
(Julia v1.5.1, Win10: 16GB RAM)

@kkakosim
Copy link
Author

to add on it.
the baseline function seems to be working fine when the same dataset is resampled to any of the tested sizes (1k-52k). There might be something wrong with the data, but then what is it with "MemoryError"

@charlesll
Copy link
Owner

This seems unrelated to rampy per se... Which type of baseline were you using when this happened?

@kkakosim
Copy link
Author

kkakosim commented Mar 6, 2021

I tried all of them. Currently, all but the gcvspline work after resampling the data (Something might have gone wrong during the gcvspline installation; later I will try with a fresh build/install) .

The MemoryError is not an issue for my anymore, because of the resampling. I brought it forward because of the misleading message. If you have any ideas how to investigate it let me know. Alternatively, I can share the dataset and my implementation if you want to investigate it yourself.

@charlesll
Copy link
Owner

Yes, this would help because I don't understand the origin of this error. You can send that on my email maybe, [email protected]

Thanks in advance !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants