-
Notifications
You must be signed in to change notification settings - Fork 27
/
CHANGES.txt
651 lines (486 loc) · 22.1 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
MagPy provides a tool set for geomagnetic data analysis.
Installation instructions can be found on the main download page.
-------------------------------------------------
####v<1.1.8>, <2024-10-23> --
1.1.8 general:
- speed issues
1.1.8 additions:
- csv import more flexible regarding header
- tsf file support with channels
1.1.8 fixes:
- json format library supports GFZ index data and DSCVR, conflict solved
- resample method - indexing
- format iaga write method failed if DataSamplingRate could not be interpreted
- deprecate error
####v<1.1.7>, <2023-11-30> --
1.1.7 additions:
+ drop_nans method extended to time column
+ better y axis range options for plotting routine
+ added subdirectory option to stream.write (automatically create year, month or doy subdirectories)
+ improved WDC reader to obtain DST index directly from Kyoto webservice
1.1.7 important fixes:
+ format libraries: corrected object in array declaration - files are readable again with scipy > 1.10
####v<1.1.6>, <2023-07-19> --
1.1.6 fixes:
+ updated cdf format libraries to correctly use cdflib > 1.0.0
+ fixed minor issues in test routines
+ fixed issues for python 3.11 compatibility
####v<1.1.5>, <2023-07-10> --
1.1.5 general:
+ updated tags and version numbers
+ available on pypi
1.1.5 additions:
+ added option to set fluxgate orientation for DI flux analysis in options (inverts sign)
+ test set for AutoDIF measurements
1.1.5 fixes:
+ circle selection in DI flux fixed (might lead to a 270 deg error)
+ variometer correction range for XYZ baselines
####v<1.1.4>, <2023-07-10> --
1.1.4 general:
+ same additions and fixes as 1.1.5
####v<1.1.3>, <2023-05-20> --
1.1.3 general:
+ removed some deprecated issues
+ added functionality previously only available in backend to xmagpy (BLV and IYFV export)
1.1.3 additions:
+ XMagPy: added selection flag when exporting IYFV flag (all, quiet, disturbed, incomplete)
+ XMagPy: added additional selection window for BLV export regarding delta F values and adopted scalar baseline
+ added support for basevalue calculation with XYZ variometers
+ added possibility to write XYZ baseline files
+ added description of basevalue determination method into README (section 2.11.7)
1.1.3 fixes:
+ IYFV files can be exported even if less than 90% of data is available for one year
+ IYFV files with less then 90% data are listed with incomplete flag (if not quiet or disturbed days)
+ resample method: improved recognition of nan values in source data (speed and accuracy)
+ analysis of single DI file now possible
+ fixed baseline correction method for non-quasi-absolute HEZ variometer data in DI-flux measurements
####v<1.1.2>, <2023-04-25> --
1.1.2 general:
+ temporary files (i.e. unzip) are now deleted after reading
+ added IAF read/write descriptions to README
1.1.2 additions:
+ IAF export will calculate K values if not provided
+ improved debug function of ImagCDF import for more detailed error analysis
+ added a new flagging class to replace old flagging methods (will be fully integrated in 1.2)
+ IAF export will write README, and in case of one year, DKA files
+ improved AutoDIF library and added support for new versions
1.1.2 fixes:
+ definitive data check has been corrected and updated (full analysis)
+ IAF export will not abort in case of meta data issues
+ IAF export will not modify the original data header for further use
+ ImagCDF import and export now supports F AND temperature columns of different lengths
+ Filtering of HF signals (> 50 Hz) working
####v<1.1.1>, <2022-09-19> --
1.1.1 fixes:
+ corrected simple baseline adoption function (simplebaseline)
+ updated backend tests to select appropriate matplotlib backends
####v<1.1.0>, <2022-09-01> --
1.1.0 general:
+ updated xmagpy manual
+ updated cdf libraries to account for cdflib 1.0.0 changes
1.1.0 additions:
+ added library support for new GFZ index webservices
+ added multiple baseline features
+ added direct baseline calculation option for "baseline" button
+ added load, save and clear options for baseline parameters
+ added load and save options for fitting parameters
1.1.0 fixes:
+ IMPORTANT: corrected baseline adoption function (bc)
correction of of hdz data previously used x component instead of h
####v<1.0.6>, <2022-07-26> --
1.0.6 additions:
+ added progress information to merge, subtract and other stream combination methods
1.0.6 fixes:
+ fixed rotation method in stream and absolute treatment to correctly use beta
+ fixed CheckAngle Button in DI input sheet
####v<1.0.5>, <2022-05-16> --
1.0.5 general:
+ removed locale modifications for interpreting months
+ basevalue data: when removing flagged data and adding data to memory,
this "new" data can be selected for baeline analysis
previously always the original/uncorrected data was used
+ new Docker image available
1.0.5 additions:
+ func2header allows to add functions as header info - can be saved with pycdf format
+ func2header is used in GUI if fit functions are calculated, popup asks user
+ added support for PREDSTORM data format
1.0.5 fixes:
+ correct usage of datetime in fitting options of GUI
+ GUI time issues mainly affecting windows
+ alphabetic sorting of files when loading from directory
+ no popup when canceling file opening
+ AutoDIF files accepted even with only two azimuth measurements
+ correct conversion of strings to integers (baseline adoption)
####v<1.0.4>, <2022-03-15> --
1.0.4 additions:
+ support for tilt data files
1.0.4 fixes:
+ some datetime issues in GUI
####v<1.0.3>, <2022-01-06> --
1.0.3 general:
+ ready for newest wx4
+ tested on windows 10 with newest winpython 3.9
+ ready for creating new windows installer
####v<1.0.4>, <2022-03-10> --
1.0.4 general:
+ IMAGCDF issues - elevation as float, F versus S
+ removed further ndarray decrepation warnings
1.0.4 additions:
+ supporting new propritary data format used for tilt measurements
####v<1.0.3>, <2022-01-06> --
1.0.3 general:
+ ready for newest wx4
+ tested on windows 10 with newest winpython 3.9
+ ready for creating new windows installer
1.0.3 additions:
+ update of conrad webservice defaults
+ ssl exceptions for BGS INTERMAGNET access allowed (affected access from win)
1.0.3 fixes:
+ IAF publication date issue solved (some IAF files could not be read)
+ Deprecation warnings for dtype=object in array definitions
+ several fixes regarding newest versions of matplotlib and wxpython
####v<1.0.2>, <2021-07-31> --
1.0.2 general:
+ cdf_tmp errors when traing to read non-cdf data
+ wx warnings
+ IMAGCDF 1.3 support including flags
+ minor warning fixes and db optimization
1.0.2 additions:
+ basic support for simple CSV files (read/write)
1.0.2 fixes:
+ march31 time stamp error for IAGA2002 files
+ basevalue data in XYZ in addition to HDZ
+ when reading zipped files with time ranges: no unpacking of all existing files any more
+ BLV file reading - ignoring non-interpretable 'd' markers
####v<1.0.1>, <2021-06-30> --
1.0.1 general:
+ minor bug fixes
1.0.1 additions:
+ accepting basevalue data in XYZ in addition to HDZ
+ added webservice support for INTERMAGNET
1.0.1 fixes:
+ exporting IAF in combination with k values (py3 issue)
+ exporting yearmean files (IYFV) (py3 issue)
+ updated webservice addresses for USGS and Conrad Observatory
####v<1.0.0>, <2020-12-22> --
1.0.0 general:
+ version 1.0.0 is the newest version of magpy and based on version 0.4.7
+ Python3 compatible (tested with 3.7), including graphical user interface
+ still Python2 compatible (tested with 2.7)
+ supports wx4.0
+ CDF (data format) support either by cdflib (recommended) or NasaCDF
+ Tested on all platforms (Windows10, Linux (Ubuntu18.04), MacOS (vxx)
+ new LISENCE
+ Updated Installation instructions
+ Manual for XMagPy included
+ temporary versions 0.9.3 to 0.9.7 include transformation steps towards a full py3 compatibility
- 0.9.6 -> included basic support for IAF data format
- 0.9.7 -> full IAF support and IMAGCDF with combinations
of vectorial and scalar data of different resolution
- 0.9.8 -> new cdflib supported, di zero offset on southern hemisphere
- 0.9.9 -> corrected rotation and di calculation issues, added travis CI,
definitive data analysis support for daily cdf files,
added new subdirectory core for future work on flagging
1.0.0 fixes:
+ dialog methods (on all platforms) - solved e.g. merge data issue on MacOS
+ flagging inaccuracies due to platform and system depended rounding uncertainites in time conversion
+ monitor options for MAGPY based acquisition systems like MARTAS (MQTT)
+ flagging outlier: 'markall' option is now working correctly
+ IYFV format now correctly interpreted (as good as possible for free form)
+ subsecond resolution for IAGA-2002 file now possible
1.0.0 additions:
+ input filter for GFZ ascii format
+ new cdf input and output libraries based on cdflib
+ coverage json support
+ scroll bars in GUI panels
+ general webservice support (currently for usgs and zamg)
####v<0.4.7>, <2019-05-16> --
v0.4.7 general:
+ version 0.4.7 was used to obtain and test the validity of one second and mintute data
of the Conrad Observatory 2018. All below mentioned bug fixes and additions were
considered for this purpose.
v0.4.7 fixes:
+ reading all generations of NASA CDF with correct interpretetion of archived Epoch variable
and leap seconds tables
+ database: error in applyDeltas method corrected (used for offset determination, delta F,
compensation fields)
+ database: sorting of input data corrected
+ flagging outlier: 'markall' option is now working correctly
+ format lib: improved GSM19 support - base nmeasurements
####v<0.4.6>, <2019-02-01> --
v0.4.6 general:
+ PYCDF format - changed time format from EPOCH to TT2000
v0.4.6 fixes:
+ writeDB - resolution in timecolumns changeable by roundtime variable
+ GUI - polynomial fit now working in GUI
+ writeDB: method will now work even for very large datasets
+ GUI: freezing error when double clicking solved
+ writeDB: treatment of columns with only nan values has been corrected
+ GUI: when opening multiple data set: sorting by time column
+ FlagOutlier: combination of susequent time steps corrected -
previously some flags were lost when saving and reloading
+ database: understandable error messages
+ trim: corrections if stream outside the timerange
+ python3 import of IYFV files now possible
v0.4.6 additions:
+ added method 'cut' to extract lines from a stream from the beginning or end
+ updated import library for ionometer
+ GUI: added better names + dates to Streamlist operations
+ GUI: streamlist is now scrollable
-------------------------------------------------
####v<0.4.5>, <2018-11-15> --
v0.4.5 fixes:
+ readDB - fixed possible error with None in timecolumns
+ added improved MARTAS methods to acquisition support
+ updated some transfer methods mainly used by MARTAS
-------------------------------------------------
####v<0.4.4>, <2018-08-10> --
v0.4.4 fixes:
+ fixed rounding of microseconds in writeDB
+ fixed database selection in GUI in windows
-------------------------------------------------
####v<0.4.3>, <2018-07-27> --
v0.4.3 additions:
+ added help on scripts to manual (section 3)
+ added instructions for second to minute conversion to "mpconvert"
v0.4.3 fixes:
+ fixed blocking overwrite dialog in DI input sheet for Windows and MacOS
-------------------------------------------------
####v<0.4.02>, <2018-07-03> --
v0.4.02 additions:
+ "mpconvert" conversion enabled for windows
v0.4.02 fixes:
+ added paho-mqtt requirement to setup
-------------------------------------------------
####v<0.4.01>, <2018-07-01> --
v0.4.01 general:
+ added suggestion from IAGA workshop
v0.4.01 fixes:
+ IAF export and read updated - more stable when f ot k missing
+ IYFV import - corrected error when importing hdz,dhz data types
v0.4.01 additions:
+ added filter option to script mpconvert:
allows to directly convert IMAGCDF second to IAF/IAGA2002 minute
+ added QSpin library
+ adding improved POS1 library - now supporting pmb format
-------------------------------------------------
####v<0.4.00>, <2018-06-13> --
v0.4.00 general:
+ removed capital letters from package title in pypi: GeomagPy -> geomagpy
+ switched to readme.md for all package providers
+ increased time step accuracy in database acquisition methods max 1 microsecond
(requires MARTAS-mqtt) (previously 1 millisec)
+ moved flagging methods to a separate panel -> improves accessablility for small screens/MacOS
+ improved extend method - speeding up
+ added information dialogs to GUI
v0.4.00 fixes:
+ updated flaglist2db and db2flaglist methods - considerably faster now and more reliable
+ CheckData in GUI: check for filename compliance, speed up read if not ok, relax checks with
numerical uncertainties, add optional flag for non-required information,
updated all texts to comply with IM rules,
+ reading yearly mean format IYFV: less sensitive to slight variations in data format
+ improved speed of flagging methods in general
+ gui: outlier flagging is not applied twice any more
+ remove_flagged: shape issue solved
+ flags: saving flags to database create correct timesteps, 'replace' set to default
+ cdfpath returns NONE: illegal operation -> solved
+ corrected invalid GridSizeres in panels
+ corrected unicode issues
v0.4.00 additions:
+ added script: mptest -> test method to check magpy compatibility
- check: mptest -h for options
+ added script: addcred -> password method fro MARTAS/MARCOS
- check: addcred -h for options
+ added script: mpconvert -> application to easily convert between different formats
- check: mpconvert -h for options
+ added full acquisition support for MARTAS, in particular mqtt support
+ added mqtt broker support
+ database: added Station coordinates and system with epsg code
+ database: DataAcquistionLat and Longs can be lists (useful for gradiometer etc)
+ database: added column DataDeltaValuesApplied (0,1)
+ database: added column DataTimezone (e.g. UTC)
+ database: added dbinfo method to get version and size
+ database+gui: try to reconnect to DB if connection has been lost e.g. due to time limit
+ gui: added flag info button
+ gui: added option to calculate F values from x,y,z
+ gui: added option to mark all shown components when using outlier detection
+ absolutes: added option compensation to apply compensation fields to variometer data
- use option skipvariodb=True to avoid
+ saveflags: creates directory if not yet existing
+ added compensation method for applying fluxgates compensation fields when available in the header
+ added Clear Flags button to remove all flags
+ updated monitor panel: full mqtt support to view broker data (e.g. MARTAS) plus authentication
+ modified spectral plot options and its default colorscale
+ moved most runtime information to debug
v0.4.00 removals:
+ cleaned up logs and removed unnecessary log info
-------------------------------------------------
####v<0.3.98>, <2017-12-15> -- On the way to beta.
v0.3.98 general:
v0.3.98 fixes:
+ stream2flaglist: float error - converted to strings
+ database: writeDB - numerical times problem solved
+ database: dbdatainfo - int values treated as int now
+ database: dbdatainfo - improved new revision numbering
+ stream: logging - removed write permission failure when different users access they same log
+ gui: hotkey for MagPy log changed to ctrl y
+ stream: samplingrate is rounded to 2 digits
v0.3.98 additions:
+ added basic acquisition support for new MARTAS, in particular mqtt support
v0.3.98 removals:
None
-------------------------------------------------
####v<0.3.97>, <2017-09-15> -- On the way to beta.
v0.3.97 general:
+++++ numerous additions, fixes and improvements in GUI (flagging, value)
v0.3.97 fixes:
+ absolute analysis: long file names are now correctly supported
+ Leap seconds in IAGA files are now considered like (2015-06-30T23:59:60 -> 2015-07-01T00:00:00)
while reading
+ reading multiple files in windows is now working
+ corrected stream subtraction method for similar, but non-identical time steps in both timeseries
+ output format for IAGA 2002 files: corrected several issues with header and compatibility
v0.3.97 additions:
+ GUI: IMAGCDF export - flagging information can be attached
+ absolute analysis GUI: notificatzion for missing Azimuth of AutoDIF
+ absolute analysis GUI: Log window now scrollable in WinXP and more recent
+ preliminary module for mqtt support included in monitoring
+ better documentation of write method
v0.3.97 removals:
None
v0.3.97 other changes:
+ updated windows installer and fixed some installation issues
-------------------------------------------------
####v<0.3.96>, <2017-08-26> -- On the way to beta.
v0.3.96 fixes:
+ Flags always stored with comment 'unknown reason' in data base - fixed
+ BLV read: all values from one day stored at the same time step - was problematic for duplicate identification
+ fixed colatitude of IYFV output
+ GUI: fixed end time input in load files
v0.3.96 additions:
+ GUI: added menu item for data checkers and definitive data check option
Data check currently supports minute (IAF) and one second (ImagCDF/IAGA02) data
+ Added preliminary MQTT acquisition and collection support
+ GUI: added power spectrum and spectrogram plots - preliminary - options not yet available
+ GUI: DI sheet - added possibility to load F data from file
+ added JSON format support for DI measurements (preliminary)
v0.3.96 removals:
None
v0.3.96 other changes:
None
-------------------------------------------------
####v<0.3.95>, <2017-07-28> -- On the way to beta.
v0.3.95 fixes:
DI analysis:
GUI: tab order corrected in DI sheet
GUI: DI sheet - times saved correctly for single digit inputs
General:
GUI: small screen fixes - large dialogs are resizeable
GUI: large ComboBox issues on Mac removed
GUI: cmd+C won't close DI entry sheet dialog on Mac any more
GUI: selecting components corrected
v0.3.95 additions:
DI analysis:
GUI: added additional fields to DI input sheet (Comments)
DI pier location will be used (if provided) after baselione correction
GUI: updated feedback information on DI sheet
GUI: overwrite warnings
IBFV2.00 export supports multiple baselinelines and jumps inbetween
IBFV2.00 export supports adopted scalar baseline techniques
when opening IBFV2.00 data, adopted baseline are imported and displayed as functions
General:
multiple functions can be fitted to one stream
v0.3.95 removals:
None
v0.3.95 other changes:
README updated
-------------------------------------------------
####v<0.3.94>, <2017-07-12> -- On the way to beta.
v0.3.94 fixes:
IAF export can include k values in correct format
updated examples
error message if selected time range does not contain data
minor bug fixes
v0.3.94 additions:
examples 2 and 3 now included, added DI example file
v0.3.94 removals:
None
v0.3.94 other changes:
None
-------------------------------------------------
####v<0.3.81>, <2017-02-16> -- On the way to beta.
v0.3.8.1 fixes:
corrections on mergeStreams method and Unicode conversion in database methods
v0.3.8.1 additions:
None
v0.3.8.1 removals:
None
v0.3.8.1 other changes:
None
-------------------------------------------------
####v<0.3.8>, <2017-02-01> -- On the way to beta.
v0.3.8 fixes:
corrections on mergeStreams method
v0.3.8 additions:
added fluxgate orientation selection for residual correction in xmagpy
v0.3.8 removals:
None
v0.3.8 other changes:
None
-------------------------------------------------
####v<0.3.7>, <2017-01-10> -- On the way to beta.
v0.3.7 fixes:
serveral format issus
many additions for flagging and flag treatment
speeded up flag operations
improvements on database methods
v0.3.7 additions:
added MARCOS support for live streaming and real time submission
v0.3.7 removals:
removed old invalid/unused acquisition libraries
v0.3.7 other changes:
None
-------------------------------------------------
####v<0.3.6>, <2016-12-16> -- On the way to beta.
v0.3.6 additions:
MagPy is now Python 3 compatible !
An Exception is the GUI as this is based on wx, which is not properly supported on py3.
If you are using the graphical user interface, then you should run MagPy with Py2.7
Minor adds:
- added a analysis monitoring method for logging information on automated analyses
- added database initialization on GUI
v0.3.6 fixes:
IMAG CDF: added "S" variable for independent scalar data ("F" before)
Improvments on corrections on flagging particulary affecting GUI
several minor enhancements for speed and stability
v0.3.6 removals:
None
v0.3.6 other changes:
None
-------------------------------------------------
####v<0.3.5>, <2016-10-08> -- On the way to beta.
v0.3.5 fixes:
MySQL requirements removed from setup.py
PM/AM issues in GUI
format issues in CDF, JSON corrected
MARCOS monitoring improved
several minor enhancements for speed and stability
v0.3.5 additions:
added support for GWR-SG5 TSF files
v0.3.5 removals:
None
v0.3.5 other changes:
None
-------------------------------------------------
####v<0.3.4>, <2016-09-17> -- On the way to beta.
v0.3.4 fixes:
meta data changes related to sensors and stations are now accepted
GUI initialization file is automatically updated
v0.3.4 additions:
None
v0.3.4 removals:
None
v0.3.4 other changes:
None
-------------------------------------------------
####v<0.1.0>, <2013-06-06> -- Initial release.