1.2.2

What's Changed

• Hotfix: Crashing archive_database_update by @BradleySappington in #1425
• Increase MAST query limit. by @bhilbert4 in #1427

Full Changelog: 1.2.1...1.2.2

1.2.1

What's Changed

• Stop storing absolute paths in the database by @york-stsci in #1394
• Visit Filter on query and archive thumbnails pages by @BradleySappington in #1412
• NIRCam Claw Monitor by @bsunnquist in #1152

Full Changelog: 1.2.0...1.2.1

1.2.0

What's Changed

• Release [develop] by @mfixstsci in #915
• Release [develop] by @bhilbert4 in #917
• Make Readnoise Monitor less memory-intensive by @bsunnquist in #922
• Updating JWST Pipeline Version Number by @mfixstsci in #923
• verify/create monitor_cron_job dir by @BradleySappington in #929
• Hover over proposal thumbnails by @shanosborne in #927
• Remove savefig overwrite call to avoid future deprecation error by @bsunnquist in #937
• Delete unnecessary files created by dark and bad pixel monitors by @bhilbert4 in #933
• Remove unnecessary output files from bias/readnoise monitors by @bsunnquist in #936
• removed unused auth keys, fixed lint errors in corresponding files by @BradleySappington in #932
• Speed up MAST queries by @bhilbert4 in #942
• fix ignore of original and stream suffixes for generate_preview_images by @BradleySappington in #946
• Fix bug with pyvo output by @bhilbert4 in #947
• Fix call to pyvo for all instruments by @bhilbert4 in #951
• Not found images replaced with default image by @BradleySappington in #949
• Lock python by @BradleySappington in #955
• Updating Packages to Match by @mfixstsci in #939
• Reduce memory usage by the dark monitor by @bhilbert4 in #908
• Remove second set of colorbar tick labels from preview images by @bhilbert4 in #963
• Add entry in filename_parser for segmented guider files by @bhilbert4 in #962
• Split program page by obsnum by @bhilbert4 in #948
• Interactive preview images by @BradleySappington in #965
• fix view proposal button href by @BradleySappington in #976
• Allow -seg in view_image filename by @bhilbert4 in #991
• Update About page with new developers by @bhilbert4 in #995
• Alert user to non-existant proposal number by @bhilbert4 in #994
• Ignore 1d spectrum files by @bhilbert4 in #977
• Turn off thumbnail creation for all but rate files by @bhilbert4 in #968
• Fix bad thumbnails by @bhilbert4 in #997
• Explore by group type by @BradleySappington in #1000
• Allow more guide star attempts in filename parser by @bhilbert4 in #1005
• Default scaling params for preview images where all pix are NaN by @bhilbert4 in #1006
• Fix clipping logic in preview image scaling by @bhilbert4 in #1011
• Add script to remove inventory entries by @bhilbert4 in #1012
• Update constants.py with new MIRI anomalies by @mengesser in #1016
• Explore int grp difference by @BradleySappington in #1020
• Fix radio buttons with e.g. o001 by @bhilbert4 in #996
• fix axis values in explorer mode by @BradleySappington in #1026
• Add inst select home search by @mengesser in #1010
• Allow proposal thumbnails to come from dark thumbnails by @bhilbert4 in #1001
• Cosmic ray monitor (via mengesser:develop) by @bourque in #700
• nirspec TA monitors: wata and msata by @penaguerrero in #888
• Adding Next and Previous Buttons by @mfixstsci in #978
• Build archive page from database by @bhilbert4 in #1030
• Add missing MAST_QUERY_LIMIT import by @bhilbert4 in #1045
• Add overwrite option when generating preview images by @bhilbert4 in #1032
• allow per-instrument database table reset by @york-stsci in #1031
• Scaling tweaks for preview images/thumbnails by @bhilbert4 in #1024
• Celery monitors by @york-stsci in #921
• Fixing having PID as an integer rather than a string by @york-stsci in #1056
• Raise the upper limit on number of returned Mast entries by @bhilbert4 in #1048
• Select anomaly name formatting by @rcooper295 in #1053
• added back type casting because otherwise we get int64 by @york-stsci in #1057
• Cr database bigint by @york-stsci in #1058
• Initial session update with "rough" sorting by @BradleySappington in #1052
• Implement "Viewed" Button and Filtering by @BradleySappington in #1049
• Proposal thumbnail search includes only proposal subdirectories by @bhilbert4 in #1054
• fixes for no data found on server by @penaguerrero in #1042
• Add function to remove all but rate thumbnails by @bhilbert4 in #1061
• Allow thumbnail files with multiple substrings to be kept by @bhilbert4 in #1064
• Added chunked iteration to CR monitor by @york-stsci in #1066
• Removed the initial copy of all input data to the internal directory by @york-stsci in #1067
• Fixed the input file name by @york-stsci in #1068
• Now explicitly take the first bunch of characters from the file name … by @york-stsci in #1069
• Multi entry model fix by @BradleySappington in #1070
• reintroduce line from bad merge by @BradleySappington in #1075
• Filter archive page by @BradleySappington in #1065
• Make log from generate_preview_images less verbose by @bhilbert4 in #1076
• Fixed cosmic ray monitor chunk iteration by @york-stsci in #1077
• Updated pipeline task by @york-stsci in #1081
• Update Common Monitor Scripts by @york-stsci in #1079
• Created a clone_tables script by @york-stsci in #1059
• Add missing shebang line to archive_database_update by @bhilbert4 in #1086
• New try at updating 3.8 env by @bhilbert4 in #1082
• Fixes for crashes in the cosmic ray and bad pixel monitors by @york-stsci in #1089
• Fix typo in shebang line of archive_database_update.py by @bhilbert4 in #1091
• Make scripts executable by @bhilbert4 in #1095
• Edb mnemonic monitor rebase by @bhilbert4 in #1060
• [WIP]: Add EDB telemetry monitor by @bhilbert4 in #832
• fix no_data_found error for WATA and MSATA monitors by @penaguerrero in #1096
• Exposure page: Default to show rate img, keep order of radio buttons constant by @bhilbert4 in #1111
• Filter type by @BradleySappington in #1092
• Sort obs date by @BradleySappington in #1113
• Utilize ignored suffixes in homepage search by @BradleySappington in #1114
• Hot Fix for JWQLDB View by @mfixstsci in #1085
• minor grammar fixes in docs by @snoyes in #1035
• Tweaks to mnemonics queried by the EDB monitor by @bhilbert4 in #1115
• Fix failing MIRI dark montior by @bhilbert4 in #1129
• Clarify reset_database.py statement by @bhilbert4 in #1127
• added scattered light, light saber anomalies for niriss by @rcooper295 in #1133
• Update actions version to move from node12 to node16 by @bhilbert4 ...

v1.1.1

• Correction of bad wheel file in version 1.1.0

1.1.0

1.1.0 (2022-04-04)

New Features

Project & API Documentation

• Adding RTD Requirements file and yml
• Updated JDOX links so they don't produce 404 errors
• Updates to About page

Web Application

• Speed up Webapp loading
• Stripped code for creating mosaic preview images
• Ignoring unuseful pipeline products
• Updated feature description on EDB page
• Closed all open sessions to db explicitly
• Fix/Modify Integration Number slider
• Switch filesystem and astroquery.mast to point to OPS
• Updates to BANDIT CI
• Made plotting limits robust to missing data
• Removing reliance on jwst-dms-edb
• Updated MIRI Readout Patterns
• Updated "Filter By" Dropdown in Archive View
• Plot non-numerical mnemonic dataset

jwql Repository

• Removed python 3.7 support
• Added python 3.9 environment
• Updated README to reflect changes in environment files.

1.0.0

New Features

Project & API Documentation

• Included documentation describing the algorithms used for instrument monitors
• Included templates for bug reports and feature requests as well as a link to submit issues on the home page
• Included Documentation option on instrument drop down menu in the navigation bar

Web Application

• All relevant instruments (NIRCam, NIRISS, NIRSpec) are incorporated into the Bias Monitor
• The generalized pipeline function from pipeline_tools.py is used for image calibration
• For exposures containing multiple integrations, created thumbnail image for only a single integration
• Implemented tests for all Monitor webpages

jwql Repository

• Modified filesystem to reflect MAST-like organizational structure
• Implemented application security tools into GitHub Actions builds
• Switched filesystem to use latest DMS build
• Improved configuration file handling

Bug Fixes

Project & API Documentation

• Include API Docs for all modules, classes, and functions in ReadTheDocs

Web Application

• Included various fixes and improvements suggested during stakeholder demonstrations
• Fixed View Image, View Proposal, and View Header buttons
• Updated dashboard such that NULL Monitor Status values were fixed
• Updated options that users can select for general image queries
• Eliminated pop-up warning when viewing fits file headers in the web app
• Removed login button on homepage and supporting authentication code and replaced with SSO authentication

jwql Repository

• Fixed Dark Monitor failure due to dither point keyword values in data
• Addressed Dark Monitor failure with data including 64-bit integers
• Resolved the NIRSpec amp boundary issue
• Fixed missing reference file error handling with latest DMS build in Readnoise Monitor
• Ensured Dark, Bias, and Readnoise Monitors complete successfully with latest DMS build
• Included read permissions for database tables
• Performed flake8 sweep of the code repository
• Updated software to support the latest versions of bokeh and pysiaf
• Removed dependencies on the astroconda channel

0.26.0

New Features

Project & API Documentation

• Included badges for GitHub Actions in README.md
• Replaced Jenkins support with GitHub Actions for CI testing
• Removed Python 3.6 support

Web Application

• Allow local developers to bypass auth.mast authentication
• Added cosmic ray monitor, unit test code, and relevant database files
• Removed unsupported options including image anomalies, unlooked images and monitors that haven't been implemented
• Improved loading times for web app archive pages by generating a representative thumbnail with generate_proposal_thumbnail.py, using astroquery.Mast rather than scraping filesystem, adding optional checks that file paths exist
• Implemented JWQL Dashboard View

jwql Repository

• Updated the call to the JWST pipeline RSCD step
• Added GitHub Actions

Bug Fixes

Web Application

• Improved loading times of readnoise monitor webpage
• Fixed broken bokeh CDN links

jwql Repository

• Dark monitor exits gracefully when there are not enough files in the filesystem
• Fixed filename parsing for WFS&C and AMI products
• Adjusted generation of preview images such that images are created for all file types
• Update ops naming convention in log directory

0.25.0

New Features

Project & API Documentation

• Added project citation information to README, along with a Zenodo badge
• Added API Documentation for bokeh templating software

Web Application

• Reorganized and made aesthetic improvements to instrument landing pages to be more user-friendly
• Enabled more dynamic search options and aesthetic improvements for anomaly query webpage
• Added web app view for displaying a particular table of the jwqldb database
• Added webpage for displaying Bias Monitor results with bokeh plots

jwql Repository

• Changed utils.credentials.py to always authenticate a MAST user with a user-identified token in the config.json file, instead of using a cached token, which was sometimes causes errors
• Updated software to support the latest versions of django and bokeh
• Removed affected_tables column of monitor database table, as it stored redundant information
• Updated the Readnoise Monitor to work for all JWST instruments

Bug Fixes

Web Application

• Fixed bug in Readnoise Monitor webpage that was causing the web app and jwql database to hang

jwql Repository

• Fixed bug that was causing the test_amplifier_info() test in test_instrument_properties.py to fail; truth values were updated to reflect a change in the format of the returned dictionaries from the amplifier_info() function
• Fixed bug in get_header_info() that was causing test_data_containers.py to fail; the function expected the filename without the FITS extension, and the returned header info is in a dictionary (not a string)
• Fixed bug in test_utils.py, and changed utils.py to make it robust in matching upper and lowercase detector names
• Updated utils.instrument_properties fix MIRI amplifier bounds calculation when omitting reference pixels

0.24.0

New Features

Project & API Documentation

• Added API documentation for Bias, Bad Pixel, and Readnoise Monitors

Web Application

• Added webpage that describes how to use the JWQL web app API
• Added webpage that enables a user to query the jwqldb database contents
• Enabled more search options and aesthetic improvements for anomaly query webpage

jwql Repository

• Added support for Python versions 3.7 and 3.8
• Added unit tests for Readnoise Monitor
• Added unit tests for Bias Monitor
• Added unit tests for Bad Pixel Monitor
• Added unit tests for bokeh templating library
• Added webpage for displaying Readnoise Monitor results with bokeh plots
• Added webpage for displaying Bad Pixel Monitor results with bokeh plots

Bug Fixes

Project & API Documentation

• Updated broken links to JWST instrument JDox pages

Web Application

• Fixed various issues that was cuasing authentication through auth.mast to fail

jwql Repository

• Fixed bug that was causing Dark Monitor to crash on recently added apertures from pysiaf
• Fixed several bugs in bokeh templating library
• Fixed bug that was causing unit tests for permissions.py to fail
• Fixed bug that was causing most_recent_search function in Dark Monitor to fail

0.23.0

New Features

Project & API Documentation

• The jwql_web_app PowerPoint presentation has been updated
• The bokeh templating software now has full API documentation
• Updated README and About webpage to reflect changes to development team members

Web Application

• Added webpage to view FITS headers of each extension for a given dataset
• Added webpage for displaying Dark Monitor results with bokeh plots
• Added webpage for viewing contents of a given JWQL database table
• Added webpage for querying and displaying anomaly results
• Added slider bar for easily navigating through integrations in preview image display
• The list of anomalies one can flag in a preview image is now instrument specific

jwql Repository

• The jwql-3.6 conda environment now uses the astroconda channel instead of astroconda-dev
• Added Bias Monitor module, which currently monitors the bias levels for NIRCam
• Added Readnoise Monitor module, which monitors readnoise for all instruments except FGS
• Added Bad Pixel Monitor module, which tracks bad pixels for all instruments
• Cron job logs now include a print out of the complete conda environment being used

Bug Fixes

Project & API Documentation

• Fixed broken link to numpydoc docstring convention in Style Guide