Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reanalysis of 1-second data sets which are NOT new #8

Open
leonro opened this issue Jan 30, 2023 · 3 comments
Open

Reanalysis of 1-second data sets which are NOT new #8

leonro opened this issue Jan 30, 2023 · 3 comments

Comments

@leonro
Copy link
Contributor

leonro commented Jan 30, 2023

year 2020 anaylsis:
new uploads: ['NGK', 'PPT', 'TTB', 'VSS', 'WNG']
Problem1: neither NGK nor TTB, VSS or WNG are new (actually they are from July 2022)
PPT from 24.01.2023
Probelm2: NGK producing strange report

@leonro
Copy link
Contributor Author

leonro commented Jan 30, 2023

The "new" data sets has parameters as follows:
{'amount': 366, 'type': '.cdf', 'lastmodified': 1658880000.0, 'obscode': 'NGK', 'rootdir': '/mnt/second/step120S/2020_step1/NGK', 'flag': None, 'moddict': {'NGK_20200101_000000_pt1s_4.cdf': 1658880000.0, 'NGK_20200102_000000_pt1s_4.cdf': 1658880000.0, 'NGK_20200103_000000_pt1s_4.cdf': 1658880000.0, 'NGK_20200104_000000_pt1s_4.cdf': ...

The previoulsy uploaded data set looks like:
{'amount': 366, 'type': '.cdf', 'lastmodified': 1658924760.0, 'obscode': 'NGK', 'rootdir': '/mnt/second/step120S/2020_step1/NGK', 'flag': None, 'moddict': {'NGK_20200101_000000_pt1s_4.cdf': 1658924100.0, 'NGK_20200102_000000_pt1s_4.cdf': 1658924100.0, 'NGK_20200103_000000_pt1s_4.cdf': 1658924100.0, 'NGK_20200104_000000_pt1s_4.cdf': ....

Converting the UNIX timestamps shows something like:
datetime.fromtimestamp(1658924100.0)
datetime.datetime(2022, 7, 27, 14, 15)
datetime.fromtimestamp(1658880000.0)
datetime.datetime(2022, 7, 27, 2, 0)

So there is a ~12hour difference and I have no idea where it comes from. The "modification" happened around 26.01.2023, but neither the Observatory nor me changed anything, which would also be difficult without changing the modification time towards January 2023. Unlike other files from other observatories, files from NGK dont have creation times (only hours). Is it a server issue?

@leonro
Copy link
Contributor Author

leonro commented Jan 30, 2023

The strange report is actually not strange but not understandable as is. This has been changed for version 1.0.7.
Before:
Issue : did not meet criteria
After:
Warning: IMOS41 confirmed but no F values provided

@leonro
Copy link
Contributor Author

leonro commented Jan 30, 2023

In order to mask this issue, file comparison will be done only on daily accuracy, active since 30.01.2023. Close this issue if no further problems occur...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant