0.17.0 (unreleased)

align_refs

Add bad pixel replacement for target and psf images [#4973]

assign_mtwcs

Skip the step if any input MT_RA/DEC keyword values are missing. [#5015]

assign_wcs

Enabled filteroffset correction for NIRISS and NIRCAM imaging modes. [#5018, #5027]
Pass an optional input_frame parameter in assign_wcs.util.wcs_from_footprintss. [#5120]
Improved calculation of bounding boxes in grism images. [#5122]
Added two new optional parameters to utils.cerate_grism_bbox - wfss_extract_half_height and wavelength_range. [#5140]
Shifted the bounding box of a resampled WCS by - 0.5 px to account for the center of the pixel. [#5241]

associations

Update diagrams in documentation to change sloper to detector1. [#4986]
Update level-3 rules to exclude IFU exposures from calwebb_tso3 associations. [#5202]
Fix formatting error in Asn_IFUGrating product name construction. [#5231]

barshadow

Correct bar shadow parity bug for yslit. [#5095]

combine_1d

Skip spectra that are degenerate when combining [#5037]

cube_build

Fixed formatting of NIRSpec s3d output product names. [#5231]
Modified NIRSpec blotting to the find min and max ra and dec for each slice and only invert those values on slice that fall in range [#5144]
Changed default weighting back to 'msm' until NIRSPEC cube pars ref file contains emsm info [#5134]
Added checks read from cube pars reference file that parameters have valid data [#5134]
Change the name of default cube type from world to skyalign [#4974]
Add ifualign cubes to be cubes rotated on sky to align with ifu instrument plane [#4974]
Change the name of MIRI alpha-beta cube type to internal_cal [#4974]
Add ability to make NIRSpec internal_cal ifu cubes aligned with slicer plane [#4974]
Change default weighting from msm to emsm [#4974]
NIRSpec IFU cubes built from all wavelengths rather than those defined in cube par ref file [#4974]
Removed wavelength planes that contained only 0 data. These planes are edge cases [#4974]

datamodels

Add iscopy to ModelContainer init [#5256]
Re-enable FITS-hash by default. [#5191]
Add blend rule for keywords DETECTOR and MODULE. [#4998]
Add methods Model.info and Model.search. [#4660]
Trim MT_RA, MT_DEC keyword comments to fit within FITS record. [#4994]
Add enum list and default value of 'NONE' for meta.instrument.lamp_mode [#5022]
Add TIMEUNIT keyword to schemas. [#5109]
Split pathloss object into pathloss_ps and pathloss_un in schemas. [#5112]
Add "PERSISTENCE" DQ flag definition. [#5137]
Fix nonsensical premature closing of FITS file of a DataModel. [#4930]
Add a hash set/check to DataModel I/O to check whether schema traversal is necessary. [#5110]
Update underlying MultiExposureModel from the SourceModelContainer models. [#5154]
Add new MIRI LRS dither patterns to PATTTYPE enum list. [#5254]

extract_1d

Implement aperture corrections in the Extract1dStep. [#4902]
Fix bug in creating a polynomial fit used in background extraction. [#4970]
Recheck the input model container in run_extract1d to select the correct processing [#5076]
Rework/refactor many functions for style and readability. [#5079]
Checks subwcs and new_slit variables exist before trying to delete them. [#5093]
Parameter mmag_extract is now propagated to the extraction routine. [#5122]
Updated the logic for when and how to use the source position to offset the location of the extraction regions specified in the EXTRACT1D reference file. [#5157]
Fixed the conversion of flux to surface brightness for IFU extended source case [#5201]

extract_2d

Check that subwcs and new_slit variables exist before trying to delete them [#5093]
Move NIRSpec wavecorr routines to the wavecorr step. [#5133]
Added a new optional integer parameter to extract_2d (wfss_extract_half_height) which allows a user to specify the extraction height in the cross-dispersion direction for WFSS mode. [#5140]

fringe

Update the fringe step to handle 3D inputs for MIRI MRS TSO mode. [#5202]

master_background

Fix open files bug [#4995]
Update to include pathloss corrections to NIRSpec IFU background [#5125]

mrs_imatch

MRSIMatchStep to create its ModelContainers with iscopy=True [#5256]

outlier_detection

Update median filter to use numpy's nanmedian. [#5114]
Fix outlier_detection bug when saving intermediate results. [#5108]
Update logic to correctly handle input CubeModel that have only 1 integration. [#5211]

pathloss

Fix bug in NIRSpec IFU data that causes valid pixel dq flags to set to NON-SCIENCE in the region of an overlapping bounding box slice [#5047]
Update to save both point source and uniform source 2D pathloss correction arrays to output. [#5112]

persistence

Flag pixels with high persistence using "PERSISTENCE" DQ flag instead of "DO_NOT_USE". [#5137]

pipeline

Refactor the Image3Pipeline to use stpipe infrastructure. [#4990]
Fix Coron3Pipeline to blend headers just from each input science model, not every integration. [#5007]
Fix open files bug in get_config_from_reference class method, and in Spec2Pipeline, Spec3Pipeline and tso3. [#4995]
Update calwebb_tso3 to do more robust checking of input data type. [#5107]
Update the Spec2Pipeline to include the new wavecorr step and put srctype before wavecorr. [#5133]
Update the Spec2Pipeline to skip extract_1d for IFU data that have not had a cube built (e.g. MIRI MRS TSO), and update the calwebb_tso-spec2.cfg configuration to turn on the fringe step and turn off cube_build for MIRI MRS TSO. [#5202]
Update the Coron3Pipeline logic to correctly handle inputs that have only 1 integration. [#5211]
Refactor Spec2Pipeline for execution logic and step flow isolation [#5214]
Update Ami3Pipeline to only process psf and science members from the input ASN. [#5243]

photom

Fix bug in NIRSpec IFU data that causes valid pixel dq flags to set to NON-SCIENCE in the region of an overlapping bounding box slice [#5047]

ramp_fitting

Add multi-processing capability. [#4815]
Fix crash when DRPFRMS1 is not set [#5096]
Update to always create the rateints product, even when NINTS=1. [#5211]

resample_spec

Fix artifacts in resampled NIRSpec slit data caused by NaNs in the WCS [#5217]

source_catalog

Use gwcs.WCS instead of FITS WCS. [#5120]
Changed the type of column is_star from float to bool. [#5140]
Implemented algorithm for determining whether a source is a star. [#5234]

stpipe

Limit reference file prefetch to the first "science" exptype when a pipeline has an association as input. [#5031]
Remove further sloper references. [#4989]
Enable prefetch of pars reference files for associations. [#5249]

wavecorr

Implemented the wavecorr step by pulling routines from the extract_2d step. [#5133]

0.16.2 (2020-06-10)

Fixed packaging dependency installation issue. [#4977]

0.16.1 (2020-05-19)

assign_wcs

Update keyword and attribute usage around SkyObject to reflect updated keywords. [#4943]
Refactor PPS origin of NIRSpec MOS shutters from top left to bottom left. [#4959]

associations

Modify NIRSpec IFU level-3 ASN rules to include only one grating per association [#4926]

calwebb_coron3

Update coron3 for new outlier detection application [#4968]

datamodels

Add to_container to CubeModel to convert a cube to a list of images [#4968]
Add getarray_noinit to DataModel to access arrays without causing initialization [#4968]
Limit looping over HDU's while resolving arrays in schema [#4951]
Relax asdf requirement and use validator flag when asdf 2.6.x is installed [#4905]
Updated core schema to include recent Keyword Dictionary changes (remove TIME-END; add TDB-BEG, TDB-MID, TDB-END, XPOSURE, TELAPSE) [#4925]
Populate meta.asn.table_name when an association is loaded into a ModelContainer. [#4873]

extract_1d

Add aperture correction in extract_1d processing. [#4902]

lib

Update SkyObject keys. [#4943]

mrs_imatch

Fix mrs_imatch to avoid calls to sigma_clipped_stats with all-zero arrays. [#4944]

photom

Fix flux units in photom for MultiSlit cases. [#4958]

pipeline

Updated calwebb_image3 pipeline to only load science and background member types from an input ASN. [#4937]
Updated the calwebb_spec2 pipeline to only use the basename of the source catalog file when updating the source_catalogue keyword for WFSS inputs. [#4940]

rscd

Fixed bug when the READPATT/SUBARRAY data is not found in RSCD reference file [#4934]

source_catalog

Add more concentration indices and update step docs. [#4906, #4908]
Added fallback background estimation method to make background estimation moare robust. [#4929]
Fixed the nearest-neighbor code to handle the case of exactly one detected source. [#4929]
Update abmag error calculation. [#4945]
Exit gracefully if APCORR ref file is missing. [#4948]

tweakreg

Added align_to_gaia processing as an option [#4599]

0.16.0 (2020-05-04)

ami

Reorganized step documentation [#4697]

assign_wcs

Updated MIRI imaging distortion to use new filteroffset file format [#4776]

associations

Update asn_from_list to have default values in the asn header [#4720]
Update rules so exclude dark files from associations [#4668]
Update association rules so that nodded observations procduce level 3 asn's [#4675]

cmdline

Re-enable exeption tracebacks from strun for issues outside step processing [#4761]

coron

Reorganized step documentation [#4697]

datamodels

Update schemas to add moving_target_position and cheby tables to the level1b schema [#4760]
Deprecate DrizProductModel and MultiProductModel and replace with updated versions of ImageModel and SlitModel that include "CON" and "WHT" arrays for resampled data. [#4552]
Remove lev3_prod schema and move resample-related keywords to core schema. [#4552]
Add data models for spectroscopic mode APCORR reference files. [#4770]
Added pupil to the FilteroffsetModel to support NIRCAM and NIRISS WCS. [#4750]
Removed old MIRI-specific filteroffset schema. [#4776]
Added FASTGRPAVG[8,16,32,64] to the READPATT keyword allowed values. [#4818]
Added the SRCTYAPT keyword and moved SRCTYPE to the SCI extension header of all applicable data model schemas. [#4885]

exp_to_source

Resulting MultiExposureModels are now updated with header information from the inputs. [#4771]

extract_1d

Updates for handling resampled input data as ImageModel, SlitModel, and MultiSlitModel, instead of DrizProductModel and MultiProductModel, which are deprecated. [#4552]
Remove pixel-by-pixel calls to wcs; copy input keywords to output for more types of input data. [#4685]
Updated to create a single x1d product per source for WFSS data, containing all extracted spectra for a given source, instead of multiple x1d files per source. [#4846]

extract_2d

Change the source type for NIRSpec MOS sources with stellarity = -1 from UNKOWN to POINT. [#4686]

master_background

Updated step arguments in the documentation. [#4723]
Fix issue with files left open at end of step [#4775]

mrs_imatch

Updated step to use EMSM cube weighting, and to perform iterative sigma rejection of sources prior to running the background solver. [#4732]

outlier_detection

Updated step arguments in the documentation. [#4723]
Change outlier and resample DQ bit usage. [#4726] Default value of good_bits now includes all DQ flags except DO_NOT_USE. Also, newly flagged outliers are flagged with DO_NOT_USE + OUTLIER.
Added a hardcoded declaration of a reasonable scale parameter for MIRI MRS as a stopgap measure until a parameter reference file can pass one more cleanly. [#4778]

pipeline

Update calwebb_detector1 to reduce the memory used in processing. [#4643]
Update calwebb_coron3 to return ImageModel instead of DrizProductModel, when necessary. [#4552]
Fix issue with files left open at end of calwebb_spec2 [#4775]
Update calwebb_spec3 to use suffix c1d for combine_1d products. [#4846]
Update calwebb_spec3 to update the ASNTABLE keyword in all output products, to reflect the name of the spec3 ASN used as input. [#4865]

resample

Update to return resampled data in an ImageModel, instead of DrizProductModel. [#4552]
Updated documentation to include step arguments and reference file description. [#4723]
Change outlier and resample DQ bit usage. [#4726] The parameter good_bits has been removed in favor of allowing all DQ flags except for DO_NOT_USE
Updated to reject pixels with DQ flag NON_SCIENCE, in addition to DO_NOT_USE. [#4851]

resample_spec

Update to return resampled data in a SlitModel or MultiSlitModel, instead of DrizProductModel or MultiProductModel. [#4552]
Fix bug that was causing resampled MIRI LRS fixed-slit data to be all zero. [#4552]
Enable model metadata blending [#4765]

rscd

Added baseline algorithm that flags groups [#4669]

set_telescope_pointing

Update to add moving target coords to the header [#4760]

source_catalog

Update to use ImageModel for resampled input data, instead of DrizProductModel. [#4552]
Updated step arguments in the documentation. [#4723]
Updated to include aperture photometry and aperture corrections. [#4819]
Rename AB-to-Vega reference file type to ABVEGAOFFSET. [#4872]

srctype

Change default source type for NRS_IFU from POINT to EXTENDED. Change the source type for NIRSpec MOS sources with stellarity = -1 from UNKNOWN to POINT. [#4686]
Modified the step to use the SRCTYAPT keyword to get the user input value from the APT and store the derived source type in the SRCTYPE keyword. [#4885]

stpipe

Unhide exceptions during CRDS steppars retrieval [#4691]
Add command line and environmental options to not retrieve steppars references [#4676]
Use only a single member of an association for CRDS STEPPARS checking [#4684]
Fix handling of the boolean-like environmental variables PASS_INVALID_VALUES and STRICT_VALIDATION [#4842]

strun

Re-enable exeption tracebacks from strun for issues outside step processing [#4761]

tweakreg

Updated step arguments in the documentation. [#4723]

wfs_combine

Update the value of the ASNTABLE keyword in the output wfscmb product. [#4849]

0.15.1 (2020-03-10)

assign_wcs

Fix NIRISS WFSS FWPOS angle bugs [#4653]
Replaced FITS WCS transforms with GWCS transforms in computing bounding boxes of grisms slits. [#4665]

datamodels

Update schema-editor to match documentation and clarify execution [#4587]
Remove the init file usage. Way too confusing [#4645]

mrs_imatch

If the background polynomial contains any Nan Values the mrs_imatch step is skipped [#4642]

stpipe

Revert "JP-1090: Remove setLevel calls (#4621)" [#4667]

0.15.0 (2020-02-28)

assign_wcs

A ValueError is now raised if input data is missing xref_sci or yref_sci keywords. [#4561]

associations

Cull Association tests [#4610]
Correct PATTTYPE values in ASN level 3 rules [#4570]
Update act_id format to allow base 36 values in product name [#4282]
Refactor association logging configuration [#4510]

combine_1d

Check output pixel numbers for NaN [#4409]

datamodels

Update schema-editor to match documentation and clarify execution [#4578]
Force data model type setting on save [#4318]
Deprecate MIRIRampModel [#4328]
Make memmap=False be the default in datamodels [#4445]
Update schemas to add the id field and switch relative references from filesystem paths to URIs. Make schema_url absolute to facilitate subclassing DataModel with schemas from other asdf extensions. [#4435]
Update core.schema.yaml to include new allowed values for PATTTYPE [#4475, 4517, 4564]
DataModel.update() now has extra_fits=False kwarg that controls whether an update happens from the extra_fits section of the datamodel. Default is to stop doing this by default, i.e. False. [#4593]
Add units to filteroffset schema. [#4595]
Updated slitdata.schema.yaml to include SRCRA and SRCDEC for MOS slitlets to FITS SCI headers. These values are taken from the MOS metadata file. [#4613]
Many keyword updates to bring us in-sync with KWD. [#4602, #4627]
Update schemas to use transform-1.2.0. [#4604]
Allow FileNotFoundError to be raised. [#4605]

extract_1d

Updated to work with the current output from photom [#4369]
Fixed bug regarding background for NIRSpec or NIRISS (SOSS) point source spectra. [#4459]

extract_2d

For GRISM data, the variance arrays and INT_TIMES table are copied to output, and keywords SLTSTRT1 and SLTSTRT2 are set to the pixel location of the cutout in the input file. [#4504]
A ValueError is now raised if the input data is missing xref_sci or yref_sci keywords. [#4561]
Fix the WCS subarray offsets for NIRCam TSGRISM cutouts [#4573]
Added source_ra and source_dec to MSA Slit with values from the MSA metadata file. [#4613]

master_background

Updated to fill the asn table and asn pool names. [#4240]

model_blender

Do not overwrite rules with defaults. [#4521]

outlier_detection

Check for a zero array before sigma clipping [#4598]
Fix bug and logic pertaining to detecting if the background has been subtracted or not. [#4523]

pipeline

Hardwire required pipeline outputs in the pipeline. [#4578]
Added FGS_IMAGE to the exposure types to apply resampling in calwebb_image2.py [#4421]
Make the naming and writing out of the resampled results to an i2d file in Image2Pipeline consistent between config and class invocations [#4333]
Don't try to save the cube_build result if the step is skipped in the calwebb_spec2 pipeline. [#4478]
Use the overwrite option when saving the white-light photometry catalog in the calwebb_tso3 pipeline. [#4493]
Fixed error in formatting of example ASN file contents in the documents for the calwebb_coron3 and calwebb_ami3 pipelines. [#4496]
Fixed the calwebb_tso3 calculation of the number_of_integrations recorded in the photometric table product to avoid astropy.table merge conflicts. [#4502]

photom

Added spectral_order to the fields matching the photom reference files for NIRCAM WFSS and TSGRISM modes. [#4538, 4558]

refpix

Interchanged alpha and beta reference arrays; use the DQ extension [#4575]
Fixed bugs in PR #4575; added unit tests [#4596]
Changed the data type of columns OUTPUT and ODD_EVEN in the section of the schema for the DQ table in the NIRSpec IRS2 refpix reference file [#4618]

set_telescope_pointing

Round S_REGION values in set_telescope_pointing [#4476]

source_catalog

Remove directory path when populating SCATFILE keyword. [#4597]

srctype

Updated logic to populate SRCTYPE in all slit instances of slit-based data models. [#4541]

stpipe

Fix sub-step nesting in parameter reference files [#4488]

transforms

Removed TPCorr WCS correction model as it is now defined in tweakwcs as a compound model of elementary astropy and gwcs models. [#4790]
Refactored the WFSS transforms to improve performance. [#4603]
Added source_ra and source_dec to the Slit namedtuple with default values of 0.0. These are populated from the MSA metadata file. [#4613]

tweakreg

Improved code to be more resilient to the case when none of the image groups has valid sources that can be used for image alignment. Now the code will gracefully skip the tweakreg step altogether in such situations. [#4299]

wfs_combine

Use float64 data types internally in wfs_combine so as not to cause an error in scipy.signal.convolve. [#4432]

tso_photometry

A ValueError is now raised if the input data for call is missing crpix1 or crpix2 keywords. [#4561]

0.14.2 (2019-11-18)

associations

Refactor target acquistion handling [#4254]

emission

Removed the emission step, documentation, and tests from the jwst package. [#4253]

photom

Fixed a bug so that the reference table column "PHOTMJ" is used for NIRSpec IFU exposures. [#4263]
The pixel area is now gotten from the photom reference file. [#4270]

white_light

Fixed bug which produces NaN results when only some input has NaN [#4256]

0.14.1 (2019-11-11)

associations

Updated level 3 rules so that target acquisitions in the pool files are listed as exp_type = 'target_acquisition', not as science exposures. [#4223]

datamodels

Updated the list of allowed NIRCam CORONMSK values in model schemas. [#4234]

flat_field

Updated handling of error arrays for FGS Guider data, which has not been run through ramp fitting [#4309]

lib

Updated the EngDB web service url in engdb_tools. [#4187]

photom

Updated unit tests to use proper names for the MIRI LRS fixedslit subarray. [#4205]

pipeline

Updated calwebb_spec3 to allow for processing of non-TSO NIRISS SOSS exposures. [#4194]

resample_spec

Updated unit tests for new name of MIRI LRS slitless subarray ('SUBPRISM' -> 'SLITLESSPRISM'). [#4205]

rscd

Updated to handle science data and reference files that use the old 'SUBPRISM' name for the MIRI LRS slitless subarray and update the values to 'SLITLESSPRISM'. [#4205]

stpipe

Only allow science members in step parameter reference call [#4236]
get_pars returns all available parameters for a step and all sub-steps [#4215]

tests_nightly

Added a set_telescope_pointing test for a NIRCam TSGRISM exposure. [#4187]

transforms

Updated all transforms to be consistent with astropy v 4.0. Transform classes define now two class variables - n_inputs and n_outputs`. The variables inputs and outputs are now instance variables (previously they were class variables). [#4216]

0.14.0 (2019-10-25)

Remove references to deprecated collections.* ABCs that will be removed in Python 3.8. [#3732]
Remove jwpsf module. [#3791]
Update dependencies python>=3.6 and numpy>=1.16. [#4134]

ami

Unit tests were added for the ami_analyze pipeline. [#4176]

assign_wcs

This step populates keyword DISPAXIS. [#3799]
For NIRISS WFSS data, the wavelengths were incorrect because the function for horizontally oriented spectra was called for GR150R, and the function for vertically oriented spectra was called for GR150C. [#3891]

associations

Update level 3 rules to create image3 associations for FGS_IMAGE exposures [#3920]
Add mir_taconfirm to the target acquisition exp_types [#4135]
Exclude mir_lrs-slitless calibration data from level 3 processing [#3990]
Fix in load_as_asn for UTF-8 errors [#3942]
Update association rules so that MIMF exposures are processed as WFS observations [#4034]
asn_from_list fills the level2 member exptype correctly if the input is a tuple [#2942]
Update rules to make level 3 associations for slitless LRS mode [#3940]
Update rules so that nOPS5 observations with "ALONG-SLIT-NOD" dither

pattern generates level 3 associations [#3912]
Update rules to have NRS_IFU backgrounds in science associations [#3824]
Return filename with extensions based on file type [#2671]
Ensured that all target acqs are processed by Level 2 [#3765]
Add a check that backgrounds are included in level 3 associations [#3678]
Will not constrain on uniqueness of the MSACONFIG keyword [#3770]
Process non-science exposures taken during WFS&C observations [#3947]

barshadow

Update barshadow position [#3897]
Unit tests were added. [#3930]

combine_1d

Fixed the number of inputs to the spectral WCS - one expetced, two were passed. [#3827]

calwebb_tso3

Update to exclude target_acquisitions from processing in the calwebb_tso3 pipeline [#3759]

cube_build

Schema for the WAVE-TAB WCS no longer requires fixed-length arrays for the wavelength "coordinates". The 'nelem' field therefore is no longer necessary and has been removed. [#3976]
To support outlier detection the blotting from the sky back to the detector was improved [#4301]

datamodels

Update to prevent target_acquisitions from processing in the spec3 pipeline [#3777]
Use public API of jsonschema to ease upgrade to 3.x. [#3705]
Fixed corruption of FITS tables with unsigned int columns. [#3736]
Fixed missing TUNITn keywords caused by changes for unsigned int columns. [#3753]
Write siaf_xref_sci and siaf_yref_sci to FITS keywords XREF_SCI and YREF_SCI for NRC_TSGRISM exposures. [#3766]
Updated multiexposure.schema to just import slitdata.schema instead of explicitly specifying all of its attributes. [#3809]
Improved properties._cast() to be able to handle structured arrays schemas without a specified (in schema) shape. In addition, ndim can be used to constrain the dimensionality of data in structured array fields. [#3976]
Fixed an issue with the fix from [#3976] that was affecting "casting" to data types defined by schema of structured arrays when input values are not native Python types (tuples). [#3995]
Fixed an issue with the fix from [#3995] that was affecting "casting" to data types defined by schema of structured arrays when input values are already structured arrays. [#4030]
Added "MIR_TACONFIRM" to the list of allowed EXP_TYPE values in the keyword schemas. [#4039]
Added new imaging-specific photom reference file data models FgsImgPhotomModel, MirImgPhotomModel, NrcImgPhotomModel, and NisImgPhotomModel. [#4052]
Add EXP_TYPE and P_EXP_TY keywords to new imaging photom reference file data model schemas. [#4068]
Introduced a flag ignore_missing_extensions=True to the DataModel initializer which is propagated to the asdf.open function. It allows control over a warning asdf issues when opening files written with an extension version older than the extension version the file was written with. An example message is

asdf/asdf.py:202: UserWarning: File was created with extension 'astropy.io.misc.asdf.extension.AstropyAsdfExtension' from package astropy-4.0.dev24515, but older version astropy-3.2.1 is installed. [#4070]
Added new spectroscopic mode photom reference file data models. [#4096]
Added new imaging mode aperture correction (apcorr) reference file data models FgsImgApcorrModel, MirImgApcorrModel, NrcImgApcorrModel, and NisImgApcorrModel. [#4168]
Removed old photom reference file data models. [#4173]
Add support for streaming reference files directly from S3. [#4170]

exp_to_source

Updated the documentation and added some logging to the step. [#3803]
Close input files after creating the new outputs. [#3828]

extract_1d

Parameters were added to ExtractBase.__init__, and most of the initialization is done there rather than in the subclasses. [#3714]
This step uses keyword DISPAXIS. [#3799]
Fixed a bug in pixel_area when the input is a CubeModel. [#3827]
Computing the solid angle of a pixel is only done for the first integration of a multi-integration exposure, and it's not done at all for WFSS data [#3863]

extract_2d

For grism data, this step copies keyword DISPAXIS from input to output. [#3799]
For NIRCam TSO data, wavelengths are computed and assigned to the wavelength attribute. [#3863]
Improved the computation of S_REGION of a slit. [#4111]

flat_field

For NIRSpec spectroscopic data, the flat_field step needs the dispersion direction. The step now gets that information from keyword DISPAXIS. [#3799, #3807]
The test_flatfield_step_interface unit test in test_flatfield.py has been temporarily disabled. [#3997]

gain_scale

Updated to apply gain factor to variance arrays. [#3794]

group_scale

Updates to documentation and log messages. [#3738]

ipc

Function is_irs2 has been removed from x_irs2.py. The version of this funtion that is now in lib/pipe_utils.py is used instead. [#4054]

lib

A function to determine the dispersion direction has been added. [#3756]
Function is_irs2 has been added to pipe_utils.py, and unit tests were added to tests/test_pipe_utils.py. [#4054]

master_background

Updated the documentation to include more details. [#3776]

photom

Add unit tests [#4022]
The code was modified to work with the new photom reference files. [#4118]
Two bugs were fixed. For NIRSpec IFU data the code was trying to access an attribute of a "slit", but there were no slits for this type of data. For NIRISS extended-source data, the code tried to divide by the pixel area, but the pixel area was undefined. [#4174]
NRS_BRIGHTOBJ data were incorrectly treated the same as fixed-slit, but the data models are actually not the same. Also, the logic for pixel area for fixed-slit data was incorrect. [#4179]

refpix

Call is_irs2 from lib/pipe_utils.py instead of using PATTTYPE keyword to check for IRS2 readout mode. [#4054]

resample_spec

This step uses keyword DISPAXIS and also copies it to output. [#3799]

saturation

Function is_irs2 has been removed from x_irs2.py. The version of this funtion that is now in lib/pipe_utils.py is used instead. [#4054]

stpipe

Fix Step.print_configspec() method. Add test. [#3768]
Integrate retrieval of Step parameters from CRDS. [#4090]
Change properties Step.pars and Step.pars_model to methods. [#4117]
Fix bug in Step.call() where a config file referencing another config file was not merged into the final spec properly. [#4161]
Set Step.skip = True in Step.record_step_status() if success == False. [#4165]

tests_nightly

Some tests in general/nirspec/ were marked as "expected to fail" because the new reference files are not being selected. [#4180]

tso_photometry

Unit tests were added to tso_photometry. [#3909]

tweakreg

Fixed a bug in a try-except block in the tweakreg step. [#4133]
removed original jwst.tweakreg alignment code and changed step's code to call similar functionality from tweakwcs package. [#3689]
Fix deprecated call to photutils.detect_threshold [#3982]

0.13.7 (2019-06-21)

datamodels

Reverted #3680 and #3709. [#3717, #3718]

flatfield

Three new unit tests were added. Two existing files were modified to split the tests into separate functions. [#3704]

0.13.6 (2019-06-20)

associations

Fixed constraints on WFSC processing. [#3710]

datamodels

Fixed corruption of FITS tables with unsigned int columns. [#3680]

0.13.5 (2019-06-19)

associations

Reverted over-restrictive constraints on WFSC processing. [#3691]
Removed the rule creating associations for NIRSpec LAMP exposures in image modes. [#3693]

0.13.4 (2019-06-17)

assign_wcs

A unique integer source_id is now assigned to all MOS background slitlets and NRS Fixed Slits. [#3584]

associations

MIRI MRS dedicated background exposures are now listed as science observations in a new association. [#3542]
Generate will no longer merge Level2 associations by default [#3631]
Prevent inclusion of data files with exp_type="NIS_EXTCAL" in the association files [#3611]
Implemented Level 2 re-sequencing to prevent overwriting of associations [#3674]
Implemented Level 2 background exposure reprocessing [#3675]

combine_1d

The input DQ column is temporarily replaced by a zero-filled array of the right data type. [#3666]

datamodels

Changed PATTSIZE keyword data type from float to string. [#3606]
Added enumeration of allowed values of FXD_SLIT to the core schema. [#3584]
Changed WHT_TYPE keyword to RESWHT. [#3653]
Add missing pattern/enum values to keyword_pband, keyword_pfilter, keyword_channel [#3653]
New keywords [#3653]
- DSETSTRT
- NUMDSETS
- DITHDIRC
- DITHOPFR
- DITHPNTS
- MRSPRCHN
- NDITHPTS
- DWTSCL
- DOUTUN
- RESBITS
- DFVAL
- DPIXFR
- DKERN
- SCIEXT
- CONEXT
- WHTEXT

extract_1d

Checks for input from a SourceModelContainer. [#3649]

exp_to_source

Changed exp_to_source` to use source_id to group exposures. [#3584]
Removed the enum list for the SUBPXPAT keyword to allow validation of any value. [#3616]

extract_1d

Checks for input from a SourceModelContainer. [#3649]

extract_2d

Nircam TSGRISM extraction uses now wcsinfo.siaf_x(y)ref_sci as the source position on the detector. [#3646]
For grism data, a wavelength array is computed and saved, and the variance arrays are extracted and copied to output. [#3664]

lib

set_telescope_pointing now retrieves CRPIX1/2 from the SIAF for Nircam TSGRISM observations and saves the values as meta.wcsinfo.siaf_x(y)ref_sci. These are used by extract_2d as the source position on the detector. [#3646]

outlier_detection

Changed default value of good_pixel from 4 to 6 [#3638]
Don't use NaNs or masked values in weight image for blotting. [#3651]
When calling cube_build for IFU data fixed selecting correct channels (MIRI) or correct grating (NIRSPEC) [#4301]

pipeline

calwebb_spec2 was changed to allow processing of exposures with EXP_TYPE=NRS_LAMP. [#3603]
calwebb_tso3 was changed to allow processing of exposures with EXP_TYPE=MIR_IMAGE. [#3633]
- calwebb_tso3 was changed to allow tso photometry processing of exposures
with (EXP_TYPE=MIR_IMAGE and tsovisit = True) or with (EXP_TYPE=MIR_IMAGE) [#3650]
Changed the default value of good_pixel from 4 to 6 for all outlier detection steps and both resample steps [#3638]

resample

Changed default value of good_pixel from 4 to 6 [#3638]

wfs_combine

Allow handling of non-science members in input associations [#3947]

0.13.3 (2019-06-04)

ami

Fixed indentation bug in ami_analyze, so now all results are sufficiently close to the results of the stand-alone prototype. Other modifications include minor tweaks to more closely match those in the prototype code: changed some of initial values of the estimation parameters, and the filtering routine arguments. [#3487]
Updated ami_analyze.cfg to use default value of zero for rotation. [#3520]
ami_analyze now emits a RuntimeError if the input is _calints or if a throughput reference file cannot be found. [#3567]
Remove change to filtering routine arguments of #3487. [#3612]

assign_wcs

Fix a one pixel off problem with the NIRSpec NRS2 WCS transforms. [#3473]
Raise a ValueError if the FWCPOS keyword isn't found in input NIRISS WFSS images. [#3574]

associations

Added the fxd_slit keyword as the third optical component [#3607]
Orders the elements in Level3 naming in alphabetical order [#3614]
Ensured that higher-order candidates only exist for Level2 associations [#3629]
Improve member checking and removed duplicate product names [#3647]

combine_1d

Unit tests were added to combine_1d. [#3490]

datamodels

Datamodels schemas should now be referenced with http://stsci.edu/schemas/jwst_datamodel/image.schema instead of http://jwst.stsci.edu/schemas/image.schema.yaml. The datamodels BaseExtension is renamed internally to DataModelExtension. [#3437]
Added the new column "relresperror" to the "MiriImgPhotomModel" data model schema. [#3512]
Added all SlitModel data arrays to MultiExposureModel, so that all input arrays appear in the output of exp_to_source. [#3572]

extract_1d

An indexing bug was fixed. [#3497]
Pixels with wavelength = NaN are no longer used. [#3539]

flatfield

Remove flatfield step parameter flat_suffix. Add boolean step parameter save_interpolated_flat. Refactor flatfield internals. [#3493]
Propagate uncertainty from FFLAT, SFLAT and DFLAT flat fields into science ERR array and VAR_FLAT array for NIRSpec spectroscopic modes. [#3538]

jump

Add multiprocessing capability to JumpStep [#3440]

extract_2d

Replaced a white space in the names of grism objects with an underscore. [#3517]
Update WFSS slit names to use simple integer value, and add accompanying unit test for NIRCAM grism extract_2d [#3632].

master_background

Fix bug in master_background where the flux from the input x1d files was being combined instead of the background columns. [#3468]
Use the surf_bright column instead of flux in master_background. [#3476]

model_blender

Allow blendmodels to ignore attributes in asdf tree not in schema [#3480]
Add new rules for dates and times [#3554]

photom

Updated to zero-out pixels outside the wavelength range of flux calibration and set DQ=DO_NOT_USE. [#3475, #3489]

pipeline

calwebb_spec3 was changed to allow processing of WFSS modes. [#3517]
calwebb_image2 was changed to prevent 3D data from being sent to resample. [#3544]
calwebb_spec2 was changed to check for an error in assign_wcs processing before executing the background step. [#3574]

refpix

Fixed a bug where pixeldq arrays were being transformed from DMS to detector coordinates for every group instead of just once

skymatch

Improved reliability when matching sky in images with very close sky footprints. [#3557]

stpipe

Capability to define reference overrides using a DataModel instead of a file path was added. [#3514]

tweakreg

Mask and do not use NON-SCIENCE regions in tweakreg source detection. [#3461]

0.13.2 (2019-05-14)

assign_wcs

The MIRI LRS WCS was updated to include an nverse transform. [#3106, #3360]
The MIRI LRS spectral distortion is implemented now using a spline model. [#3106]
Both dither_point_index and metadata_id are used now to match rows into the MSA meta file. [#3448]
MissingMSAFileError was renamed to MSAFileError [#3448]
Added two parameters to assign_wcs, slit_y_low and slit_y_high, to allow changing the lower and upper limit of a Nirspec slit in the instrument model. [#2819]

background

Verify the exposures to be used as background have the same NIRSpec GWA tilt values as the science exposures. If the background and science exposures do not have matching GWA tilt values, then skip the background subtraction step in calspec2. [#3252]

barshadow

Updated to apply the correction to the science data arrays, in addition to attaching as an extension. [#3319]
Updated to apply the square of the correction to VAR_FLAT [#3427]

calwebb_spec3

Add the master_background subtraction step to the pipeline. [#3296]

combine_1d

Fix call to wcs.invert, and don't weight flux by sensitivity if the net column is all zeros. [#3274]
Modified to use the same columns as now written by extract_1d. The background parameter has been removed, since dividing by npixels is now done in extract_1d. [#3412]

datamodels

Fix url_mapper for fits-schema to allow URLs with of the format http://stsci.edu/schemas/fits-schema/ to map to the correct location in the jwst package. [#3239]
Change ModelContainer to load and instantiate datamodels from an association on init. This reverts #1027. [#3264]
Keyword updates to data model schemas, including OBSFOLDR, MIRNGRPS, MIRNFRMS, and new PATTTYPE values. [#3266]
Keyword updates to remove GS_STATE and change GUIDESTA to string type. [#3314]
Added BUNIT keyword to gain and readnoise reference file schemas. [#3322]
Update dq_def.schema, group.schema and int_times.schema to comply with ASDF standard. Remove unused extract1d.schema. [#3386]
Update schemas to add new READPATT and BAND allowed values. [#3463]

extract_1d

This step can now use a reference image for IFU data. The reference image (for IFU) may be either 2-D or 3-D. When using a reference image for non-IFU data, background smoothing is now done after scaling the background count rate. [#3258]
Unit tests were added for IFU data. [#3285]
The target coordinates are used (for some modes) to determine the extraction location, i.e. correcting for nod/dither offset. For IFU, the areas of the source aperture and background annulus are computed differently. [#3362
For IFU data for an extended source, the extraction parameters are assigned values so that the entire image will be extracted, with no background subtraction. For non-IFU data, a try/except block was added to check for a WCS that does not have an inverse. Some code (but not all) for the now-obsolete RELSENS extension has been deleted. [#3390]
This now writes columns SURF_BRIGHT and SB_ERROR instead of NET and NERROR. The BACKGROUND column is divided by NPIXELS, so the units will be surface brightness. This step no longer looks for a RELSENS extension. [#3412]
The keywords that describe the units for the FLUX and ERROR columns have been corrected; the units are now specified as "Jy". [#3447]

extract_2d

An attribute dither_point was added to each slit in a MultiSlitModel for MOS observations. [#3448]

flatfield

Propagate uncertainty from flat field into science ERR array and new VAR_FLAT array which holds the variance due to the flat field. [#3384]

master_background

Modified the unit tests for expand_to_2d. [#3242]
Modified MasterBackgroundStep to be skipped if BackgroundStep was already run on the data. A new force_subtract parameter is added to override this logic. [#3263]
MasterBackgroundStep now can handle BACKGROUND association members that come from nodded exposures of the source. [#3311]
Updated the DQFlags of the background subtracted data to be DO_NOT_USE for the pixels that have wavelenghts outside the master background [#3326]
Modified expand_to_2d to loop over pixels for WFSS data. [#3408]

outlier_detection

Fixed a bug that was causing the step to crash when calling the cube_build step for MIRI MRS data. [#3296]

pathloss

Updated to apply the correction to the science data and err arrays. [#3323]
Updated to apply the square of the correction to VAR_FLAT [#3427]

photom

Updated to apply the flux calibration to the science data and err arrays. [#3359]
Updated to compute a wavelength array for NIRISS SOSS exposures using spectral order 1. [#3387]
Updated to apply the square of the correction to VAR_FLAT [#3427]

reffile_utils

Improved error messages when problems are encountered in extracting subarrays from reference files. [#3268]

resample_spec

Fixed an issue with the spatial component of the WCS where the inverse transform gave different results for negative RA and 360 + RA. [#3404]

set_telescope_pointing

Fix populate_model_from_siaf to convert SIAF pixel scale from arcsec to degress for CDELTn keywords. [#3248]
Updates to prevent crashes when SIAF values needed for crpix or cdelt keywords are missing. [#3316]
Convert FSM correction values from arcsec to radians. [#3367]

srctype

Updated logic for background targets and nodded exposures. [#3310]

transforms

A field dither_point was added to the Slit structure. [#3448]

tweakreg

Bug fix: Improved 2D Histogram (pre-match shift) algorithm in Python. [#3281]
Fixed a bug in handling situations when no useable sources are detected in any of the input images. [#3286]
Enhanced source catalog extraction algorithm to filter out sources outside the WCS domain of definition (when available). [#3292]
Changed the type of exception raised when input has incorrect type. [#3297]

0.13.1 (2019-03-07)

combine_1d

Added parameter background; for background data, scale the flux, error, and net by 1 / NPIXELS, and include NPIXELS in the weight; changed the default for exptime_key to "exposure_time". [#3180]
There is now a direct interface for calling the step. This function, combine_1d_spectra, may be passed either a ModelContainer or a MultiSpecModel object. Previously this function expected the name of an association file. [#3220]

datamodels

Add back BaseExtension class so url-to-schema mapping works again [#3227]

extract_1d

If flux conversion is done, the FLUX is now set to zero (instead of copying the NET) if the wavelength of a pixel is outside the range of the RELSENS array. [#3190]
Added a parameter subtract_background to extract_1d indicating whether the local background should be subtracted. If None, the value in the extract_1d reference file is used. [#3157, #3186]
extract_1d can be run by calling extract.do_extract1d and passing a dictionary of reference file information. [#3202]
ref_dict was None in run_extract1d, and a check for that was missing. [#3233]

master_background

Added unit tests for expand_to_2d. Support CombinedSpecModel data for the 1-D user-supplied background spectrum. [#3188]

set_bary_helio_times

Raise an exception when unable to compute converted times. [#3197]

set_telescope_pointing

Added population of CDELTn keywords based on SIAF values and fixed bug in calculation of S_REGION corners. [#3184]

0.13.0 (2019-02-15)

ami

assign_wcs

Removed transform_bbox_from_datamodels in favor of transform_bbox_from_shape which now works by using last two dimensions in the shape. [#3040]
Added velocity correction model to the WFSS and TSGRISM wcs pipelines. [#2801]
Refactored how the pipeline handles subarrays in the WCS. Fixed a bug where the bounding box was overwritten in full frame mode. [#2980]
Rename several functions dealing with calculating bounding boxes for clarity. [#3014]
The bounding box of the MIRI LRS WCS is now in "image" coordinates, not full frame. [#3063]
FITS WCS keywords are written out only if the observation is one of the IMAGING_MODES. [#3066]

associations

Updated docstrings and written documentation. [#2856, #2862]
Fixed NIRISS WFSS catalog naming and implement NIRCam WFSS [#3515]
Fixed treating non-science as TSO [#3601]

background

barshadow

combine_1d

coron

Updated the stack_refs routine to update the output data model with metadata from the first input model. [#3111]

csv_tools

cube_build

Added dq flagging [#3804]

cube_skymatch

dark_current

datamodels

dq_init

emission

engdblog

exp_to_source

Updated SourceContainer to wrap each exposure of a MultiExposure in a SlitModel, allowing pipeline code to simply treat each as DataModel. [#3438]

extract_1d

Updated to recognize NRC_TSGRISM as WFSS data. SlitDataModel schema now specifies that the wavelength attribute should be 2-D, with a default value of 0. [#2911]
Reverse order of RELSENS wavelength and response if the wavelengths are not increasing. [#3005]
Add a test for constant wavelengths (or constant slope). [#3032]
Fix issue regarding mixing of the syntax for Boolean arrays and for integer index arrays. [#3045]
Changed the names of time-related keywords for extracted spectra. [#3058]
A new NPIXELS column has been added to the output table. [#3108]

extract_2d

Moved the update of meta information to the MultiSlitModel instead of the SlitModels that compose it. [#2988]

firstframe

fits_generator

flatfield

Updated to not extrapolate for wavelengths that are out of bounds, either due to the WCS, or the wavelengths for a flat-field image cube, or the wavelengths for the fast-variation component. [#2775]

fringe

gain_scale

group_scale

guider_cds

imprint

ipc

Updated the docstrings [#2822]

jump

Updated twopoint_difference.py to not use groups with groupdq set to DO_NOT_USE [#3495]

jwpsf

lastframe

lib

set_telescope_pointing now populates WCS keywords from the SIAF file. [#3066]

linearity

master_background

Implement the basic step scaffolding for MasterBackgroundStep. [#3090]
Record user-supplied master background in MSTRBKGD keyword [#3101]
Add step documentation for master background subtraction [#3102]
Make master background step actually work [#3110]

model_blender

msaflagopen

outlier_detection

pathloss

persistence

photom

pipeline

ramp_fitting

Ramp-fitting returning zero for all background pixels; Issue #2848, JP-453.
MIRI ramps with jumps flagged at group 2 result in slopes of 0 in the rate image; Issue #2233,
Processing pixels in ramp fitting in which all groups are saturated; Issue #2885.
Ramp Fit fails when only two groups are in a segment after cosmic ray hits.; Issue #2832, JP-450.
Fixed a bug in which the keywords from the input were not included in the OPT output header.
Simplified and clarified classification of segment types based on DQ flags.
Added handling of ramps ending in 2 saturated groups.
Fix units for Read Noise Variance in ramp_fit (PR #2767). This may needed to revised based on Mike Regan's comment when he closed this PR.
Added check to handle integration-specific variances for too short segments.
More robust handling of ramps flagged as DO_NOT_USE (PR #3016)

refpix

Added a description of processing for IRS2 readout mode data. [#2889]
Fixed a mistake in the time to read one pixel. [#2923]

resample

reset

rscd

saturation

skymatch

source_catalog

srctype

scripts

stpipe

Add Step.record_step_status() method for use by this step (and any other pipeline or pipeline step) [#3110]

straylight

superbias

timeconversion

Updated the docstrings [#3020]

transforms

The LRSWavelength model was removed as obsolete. Instead a spline is used for the wavelength solution. [#3106]

tso_photometry

tweakreg

Use a more numerically stable numpy.linalg.inv instead of own matrix inversion. [#3033]
Bug fix: Use integer division in Python 3. [#3072]

wfs_combine

white_light

wiimatch

0.12.3 (2019-01-10)

scripts

set_telescope_pointing.py: Update method of choosing pointing parameters. [#2900, #3008, #3022]
set_telescope_pointing.py: Allow undefined SIAF. [#3002, #3006]

0.12.2 (2018-11-15)

associations

Updated rules based on actual OTB phasing data. [#2831]

wfs_combine

Renamed the configuration from wfs_combine to calwebb_wfs-image3. [#2831]

0.12.1 (2018-10-30)

The 0.12.0 release is highlighted by the completion of updates for level-2b WFSS processing, support for non-linear wavelength sampling in IFU cubes, and several Associations updates to support WFS&C observations and background nodding. This release had 53 issues closed and a number of pull requests to improve PEP8 compliance, improve performance, enhance the testing, and remove all python2 dependencies. The release also included updated documentation of CRDS reference files.

ami

assign_wcs

The bounding box for NIRSpec WCS objects was modified to include the edges of the pixels. [#2491]
Updated assign_wcs to compute the sky footprint of MIRI MRS and NIRSpec IFU observations. [#2474]
Fixed minor bug in catalog.utl.get_object_info [#2550]
Fixed bug in bounding_box_from_shape function [#2558]
Make GrismObject.partial_order a lookup dict on order and fix partial_order logic [#2643]
Added unit tests for grism modes [#2649]
Augmented the logic for choosing a Nirspec WCS mode to include a check for the value of GRATING. If GRATING=MIRROR imaging mode is chosen reegardless of EXP_TYPE. [#2761]
Added new NIRSpec target acq exposure types NRS_WATA and NRS_MSATA to be assigned an imaging WCS. Removed NRS_BOTA. [#2781]

associations

Updated Level2 product naming to use pipeline's remove_suffix. [#2481]
Added rule Asn_Lv2NRSIFUNod to handle nod backgrounds for NIRSpec IFU [#2532]
Changed deprecated logger.warn to logger.warning. [#2519]
Made NIRISS WFSS Level2 associations exclusive. [#2555]
Added new rule Asn_Lv2WFSC and new association type wfs-image2, including a new configuration file "calwebb_wfs-image2.cfg" [#2599]
Added new rule Asn_Lv2MIRLRSFixedSlitNod to handle LRS Fixed-slit nodding. [#2663]
Updated MIRI Dark and Flat exposure keywords. [#2698, #2710]
Updated coronagraphy associations to be integrations-based. [#2773]
Updated NIRSpec Lamp calibrations to be grating-specific. [#2780]
Added new NIRSpec target acq exposure types NRS_WATA and NRS_MSATA. [#2780]

background

barshadow

combine_1d

coron

csv_tools

cube_build

Added support for creating IFU Cubes with non-linear wavelength sampling, including use of FITS WCS "WAVE-TAB" standard. [#2598]
Correctly writing TDIM2 to WCS-TABLE extension [#2719]
Fixed error when making IFUCubes with weighting='miripsf' [#2719]

cube_skymatch

dark_current

datamodels

Initialize arrays and tables from function args in model_base [#2502]
Updated guidestar centroid table column data type [#2526]
Updated BAND keyword allowed values to include cross-dichroic combinations [#2530]
Truncate long schema validation error messages to 2000 characters [#2657]
Various keyword changes, including new EXP_ONLY keyword [#2414]
Added validate_required_fields to datamodels base, so that "fits_required" is checked when writing a model to a file [#2589]
Added new keywords PWFSEET, NWFSEST, DATE-BEG and made updates to conform to FITS convention for units included in keyword comments [#2595]
Updated allowed SUBARRAY names for FGS and NIRCam [#2667]
Fixed bug in default value when schema contains combiner [#2668]
Updates for python 2 to 3 conversion [#2678]
Updated EXP_TYPE allowed values to include "MIR_DARKALL", "MIR_DARKIMG", "MIR_DARKMRS", "MIR_FLATALL", "MIR_FLATIMAGE-EXT", and "MIR_FLATMRS-EXT" [#2709]
Updated the MiriResolutionModel schema to have column names match the actual reference files [#2757]
Updated EXP_TYPE allowed values to remove NRS_BOTA and replace with NRS_MSATA and NRS_WATA [#2772]

documentation

Clarifications of input and output file naming. [#2727]

dq_init

Added ValueError check when loading the input into a data model [#2543]

emission

engdblog

exp_to_source

extract_1d

Added or modified docstrings [#2769]

extract_2d

WFSS modes updated to only extract specific orders, including delivery of updated wavelengthrange reference file [#1801]
Fixed NIRSpec cutout size bug related to FITS 1-indexing [#2541]
Added bounding box to WFSS output SlitModel [#2643]
Added unit tests for grism modes [#2649]
Bounding box sizes in extracted WFSS exposures now correctly cover entire extraction [#2799]

firstframe

fits_generator

NIRSpec data now automatically sanitizes the GWA_TILT keyword. [#2494]

flatfield

Modified the code to find the dispersion direction. [#2492]
Changed the handling of zero wavelengths for NIRSpec data. [#2659]

fringe

gain_scale

group_scale

guider_cds

imprint

ipc

jump

Updated step docs, as well as gain and readnoise reference file docs [#2689]

jwpsf

lastframe

lib

Updated reffiles_utils to no longer issue warnings about mismatch in data array size params for NIRSpec IRS2 readouts. [#2664]
Updated reffiles_utils to regard IRS2 science exposures as a match with normal sized reference files. [#2755]

linearity

model_blender

mrs_imatch

msaflagopen

outlier_detection

pathloss

persistence

photom

pipeline

Added new Image2Pipeline configuration calwebb_wfs-image2.cfg for WFS&C processing [#2599]
Renamed calwebb_tso_image2, calwebb_tso_spec2, and calwebb_nrslamp_spec2 configuration files to calwebb_tso-image2.cfg, calwebb_tso-spec2.cfg, and calwebb_nrslamp-spec2.cfg [#2639]
Updated the order of MIRI steps in calwebb_detector1 and calwebb_dark. [#2669]
Updated Image2Pipeline and Spec2Pipeline to properly return "cal" results. [#2676]

ramp_fitting

Improved memory management; Corrected handling of groups in which all pixels have insufficient data for a first difference; Corrected handling of ramps whose initial group is saturated; Corrected handling of ramps whose single good segment is a single group. [#2464]
Updated gain and readnoise reference file docs [#2689]
Fixed bug so that an integration-specific (_rateints) product is only created when NINTS>1; Skip MIRI first and/or last groups when flagged as DO_NOT_USE. [#2760]
Fixed bug in which the number of segments returned exceeds the number of groups, which had occurred for a MIRI dataset in which the first or last group was flagged as DO_NOT_USE and also flagged as a jump. [#2834]

refpix

resample

Made finding the dispersion axis more robust [#2644]

reset

rscd

saturation

Updated step docs, as well as saturation reference file docs [#2689]

skymatch

Made skymatch to not fail in 'match' mode when images do not overlap [#2803]

source_catalog

srctype

scripts

Fixed bug in logging configuration for set_telescope_pointing.py. [#2521]

stpipe

straylight

superbias

timeconversion

transforms

NIRISS models updated to allow for negative filter wheel rotations [#1801]
Made partial_order attribute of GrismObject as lookup dict on order [#2643]

tso_photometry

tweakreg

Modified default configuration settings: increased "kernel_fwhm" from 2.0 to 2.5, increased "snr_threshold" from 3 to 10, and changed "enforce_user_order" from True to False. [#2510]
Updated tweakreg to use wcs.available_frames to get the names of the frames in a WCS pipeline. [#2590, #2594, #2629]
Made the code more robust with images without sources [#2796]
Made the logic for computations of footprints more reliable for the case of 1 or 2 sources in a catalog. [#2797]
Added two new parameters: brightest to keep the top brightest (based on the flux) objects in the object catalog after all other filtering has been applied and peakmax to exclude sources with peak pixel values larger or equal to peakmax. brightest can be used to eliminate false detections and peakmax can be used to filter out saturated sources (instrument-specific value).[#2706]

wfs_combine

wiimatch

0.11.0 (2018-09-10)

The 0.11.0 release is highlighted by the inclusion of steps for resampling spectral images and time series grism observations. In addition, this release had 39 issues closed and a number of pull requests to improve PEP8 compliance, improve performance, and enhance the testing. The release also included updated documentation for acessing CRDS when running the JWST pipeline and updates to the reference file documentation.

ami

assign_wcs

Fixed a bug in get_msa_open_slits which prevented the code from finding the msa metafile. [#2322]
Fixed a bug in computing the slit_y locations for Nirspec MSA slitlets with more than one shutter. [#2325]
Added a wavelength correction for the effective velocity of JWST relative to the barycenter. [#2359, #2406]
Updated NRC_TSGRISM to assign source location to set pixel [#2286]
Fixed bug in assign_wcs for ordering of slits for NIRSPEC MSA data [#2366]
Implemented support for reading and writing WCS information in the WAVE-TAB format [#2350]
Fixed bug in the ording of cube footprint [#2371]

associations

Implemented Rule for Level 2 Nirspec Fixed Slit background. [#2307]
Included Handling of both numeric and named slits for Level3 products. [#2330]
Removed MIR_LRS-SLITLESS and NIS_SOSS from the permanent TSO list. [#2330]
Implemented new Level2a rule Asn_Lv2NRSLAMP. [#2177]
Allowed "N/A" as a valid, but False, value in association pools. [#2334]
Implemented new association types tso_image2 and tso_spec2. [#2431]
Synced code version with jwst package version. [#2458]
Implemented source naming for NIRISS WFSS Level3 associations [#2443]

background

barshadow

Fixed a bug in bar_shadow.py interpolate() that caused array index to be nan [#2384]

combine_1d

coron

csv_tools

cube_build

Removed spaxel.py and replace class with set of arrays [#2472]
reworked in mapping of the detector pixel to the sky spaxel so that consistent code can be used for both MIRI and NIRSPEC data [#2472]
Removed some loops in cube_cloud.py for finding which pixels fall in roi of spaxels [#2472]
In a test with MIRI data there was a 13% improvement in the speed of making IFUcubes. In the NIRSPEC case there was a 40% improvment in the speed of creating IFUCubes.
Fixed bug in cube_build.blot_images that was failing for NIRSPEC IFU images with the slide position defined in the WCS [#2345]
Updated the construction of cube footprint [#2371, #2364, #2327]

cube_skymatch

dark_current

datamodels

Initialize arrays and tables from function args in model_base [#2351]
Added a new info method, similar to the method in astropy fits [#2268]
The DataModel __hasattr__ method has been replaced by hasattr. The former created the attribute when it was accessed. [#2275]
Improved error messaging when loading fits files into data models. [#2298]
New warning message when opening a file without DATAMODL keyword. [#2248]
Included the ability to handle 'allOf' when reading in schemas [#2407]
Removed BaseExtension class, it was not being used [#2430]

dq_init

emission

engdblog

exp_to_source

extract_1d

extract_2d

NRC_TSGRISM implemented with set source location and extraction options [#1710, #1235]
Fixed step calling error for unreferenced attribute [#2463]
Fixed type specification for optional grism mode inputs [#2467]
NRC_TSGRISM extract_height honored, bounding box fixed [#2643]

firstframe

Unit tests added to the first frame step [#2365]

fits_generator

Updated pyparsing to v 2.2.0 [#2382]
Updated fits_generator to ignore files begining with '.' [#2333]

flatfield

fringe

gain_scale

group_scale

guider_cds

imprint

ipc

jump

jwpsf

lastframe

Unit tests added for lastframe [#2412]

lib

linearity

model_blender

mrs_imatch

msaflagopen

outlier_detection

pathloss

Added support for correcting NIRISS SOSS mode exposures [#2588]

persistence

photom

pipeline

Fixed a typo in calspec2 which prevented the srctype step from running. [#2318]
Enabled resample_spec to run on MIRI fixed slit data in calspec2 [#2424]
Implemented new Spec2Pipeline configuration for NIRSpec LAMP exposures [#2174]
Implemented specific exit status for "no science on detector" [#2336]
Enabled extract_2d for NRC_TSGRISM [#2460]
Turn off resample in Spec2Pipeline for multi-integration cube data [#2456]

ramp_fitting

refpix

The memory performance of refpix was improved [#2315]

resample

Fixed spectral resampling so the 2D output for MIRI LRS and NIRSpec MSA has the correct orientation and a dispersion that matches the input, i.e. non-linear if a prism is in the optical path. [#2348]
Fixed bug in spectral resampling of MIRI LRS where the interpolation of the dispersion was failing. [#2422]

reset

rscd

saturation

skymatch

source_catalog

srctype

scripts

Added a new script for adding or removing files from an association [#2468]

stpipe

Fixed bug to allow not being able to find a default input file name [#2461]
Removed python2-3 dependency in crds_client [#2593]

straylight

superbias

timeconversion

Updated the utc_to_tdb module to compute the radial velocity (m / s) of JWST with respect to the solar-system barycenter, and to assign that value to keyword VELOSYS in the SCI header of the specified FITS file. [#2359]

transforms

tso_photometry

Updated tso_photometry step for SUB64P/WLP8 mode #2358

tweakreg

Fixed the coordinate frames in the output of tweakreg. [#2404]
Updated TPCorr to work with V2, V3 in arcseconds instead of degrees [#2342]

wfs_combine

white_light

wiimatch

0.10.0 (2018-07-30)

The 0.10.0 release is a snapshot release for DMS testing. The release is highlighted by the inclusion of steps for time series observations. This release had 39 closed issues included a number of improvements to the wavelength calibration for NIRSPEC observations.

ami

assign_wcs

Improved the error handling for missing entries in the wavelengthrange reference file [#2213]
Fix to correctly calculate the wavelength for NIRSPEC Prism observations [#2163]
process NRS_AUTOFLAT as a MOS observation [#2166]
fix wavelength units of inverse transform [#2158]
fix input units to meters when filter=OPAQUE [#2134]

associations

Implement NIRSpec MSA Background Nod rules #2249

background

barshadow

combine_1d

coron

csv_tools

cube_build

cube_skymatch

dark_current

datamodels

When reference files are validated, they can either throw a warning or an error if strict validation is set. [#2210]
Update schema enum lists for keywords FILTER, PUPIL, READPATT, and EXP_TYPE [#2226]
Enable and improved tests for datamodel schemas using the ASDF schema checker [#2240, #2241]
Update IRS2 data model and add regredssion tests [#2295]

dq_init

emission

engdblog

exp_to_source

extract_1d

extract_2d

firstframe

fits_generator

flatfield

fringe

gain_scale

group_scale

guider_cds

imprint

ipc

jump

jwpsf

lastframe

lib

linearity

model_blender

An example has been added to the model_blener documentation for how to blend meta information [#2206]

mrs_imatch

msaflagopen

Added documentation for the msaflagopen step [#2283]

outlier_detection

pathloss

persistence

photom

pipeline

Update the calwebb_tso1 cfg file to skip the firstframe step and save the corrected ramp product. [#2280]
Implement TSO-specific Level2 configurations [#2297]

ramp_fitting

Corrected handling of ramps whose first differences are all NaNs (such as ramps with all groups saturated) [#2289]

refpix

Refpix has been updated to handle subarray exposures [#2207]

resample

Fixed update_fits_wcs() to work on DrizProductModels [#2222]
A major re-factoring of the resampling code to allow for spectroscopic resampling [#2245]

reset

rscd

The performance of the RSCD step was improved by a factor of 20 [#2247]
Update to the RSCD documentation [#2211]

saturation

skymatch

source_catalog

srctype

scripts

stpipe

straylight

superbias

timeconversion

A script was written to read the UTC columns (at the start, middle, and end of each integration) from the INT_TIMES table, call the timeconversion module to compute the corresponding times at the solar-system barycenter (TDB), and update the columns in the INT_TIMES table. [#2285]
Fix the problem in timeconversion that was caused by a recent addition of a new field to the ephemeris by retrieving only the fields needed. [#2296]

Files

CHANGES.rst

Latest commit

History

CHANGES.rst

File metadata and controls

0.17.0 (unreleased)

align_refs

assign_mtwcs

assign_wcs

associations

barshadow

combine_1d

cube_build

datamodels

extract_1d

extract_2d

fringe

master_background

mrs_imatch

outlier_detection

pathloss

persistence

pipeline

photom

ramp_fitting

resample_spec

source_catalog

stpipe

wavecorr

0.16.2 (2020-06-10)

0.16.1 (2020-05-19)

assign_wcs

associations

calwebb_coron3

datamodels

extract_1d

lib

mrs_imatch

photom

pipeline

rscd

source_catalog

tweakreg

0.16.0 (2020-05-04)

ami

assign_wcs

associations

cmdline

coron

datamodels

exp_to_source

extract_1d

extract_2d

master_background

mrs_imatch

outlier_detection

pipeline

resample

resample_spec

rscd

set_telescope_pointing

source_catalog

srctype

stpipe

strun

tweakreg

wfs_combine

0.15.1 (2020-03-10)

assign_wcs

datamodels

mrs_imatch

stpipe

0.15.0 (2020-02-28)

assign_wcs

associations

combine_1d

datamodels

extract_1d

extract_2d