Wavelength Adjustments for Running the Hubble Advanced Spectral Products (HASP) Script#
This Notebook is designed to walk you through making wavelength adjustments to COS & STIS data when running the Hubble Advanced Spectral Products (HASP) coadd script.#
Learning Goals:#
By the end of this tutorial, you will learn how to:
Determine if you must make wavelength adjustments based on your coadded product
Perform cross-correlation on
X1DandSX1files to determine the wavelength offset between datasetsPerform wavelength shifts on COS and STIS data using each instrument’s adjustment methods
Run the coadd code on new data and compare pre- and post-shift coadded spectra
Table of Contents#
0. Introduction
1. Performing Wavelength Adjustments on COS Data
- 1.1 Downloading and Organizing COS Data using Astroquery
- 1.2 Running the HASP Script on COS Data
- 1.3 Identifying a Wavelength Shift in COS Data
- 1.4 Performing Cross-Correlation on X1D COS data and Calculating Lag
- 1.5 Applying Shifts to COS data and Re-creating Coadd
- 1.6 Comparing Non-Shifted and Shifted COS Coadds
2. Performing Wavelength Adjustments on STIS data
- 2.1 Downloading and Organizing STIS Data using Astroquery
- 2.2 Running the HASP Script on STIS Data
- 2.3 Performing Cross-Correlation on STIS data and Calculating Lag
- 2.4 Applying Shifts to Raw STIS data and Re-creating Coadd
- 2.5 Comparing Non-Adjusted and Adjusted STIS Coadds
0. Introduction#
The Hubble Advanced Spectral Products (HASP) coadd code is a script that coadds spectra of the same target within a program. This software can coadd data taken with the spectrographs onboard the Hubble Space Telescope (HST): the Space Telescope Imaging Spectrograph (STIS) and the Cosmic Origins Spectrograph (COS). The Hubble Spectroscopic Legacy Archive (HSLA) uses this script to coadd these instruments’ data from The Mikulski Archive for Space Telescopes (MAST) to create high-quality spectra with a broad wavelength coverage that is publicly available for the scientific community. The script first coadds the observations for each grating for a given visit, then it combines all gratings for the observation set. Finally, it coadds the spectra of each observation set in the program to produce a fully coadded spectrum for each target in a program. Check out the COS 2024-1 ISR for more information about the HASP script and products.
Wavelength alignment between exposures is crucial for performing accurate spectroscopic analysis on your data. Wavelength offsets can occur for a variety of reasons, such as poor centering during target acquisition or thermal fluctuations in between exposures. In addition to inaccurate measurements and the misidentification of spectral features, incorrect wavelength registration can result in the wrong flux sensitivity being applied at each wavelength. For COS in particular, the wavelength throughput decreases for low-resolution spectra and rapidly at shorter wavelengths, thus being more affected by incorrect flux sensitivity applications. It is sometimes necessary for users to manually apply shifts to their raw data to ensure wavelength alignment between files. More information about the wavelength accuracies for the instruments can be found in Chapter 5 of the COS Instrument Handbook and Chapter 4 in the STIS Instrument Handbook.
This notebook will show users how to recognize if their data needs wavelength adjustments, and how to perform these corrections for both COS and STIS data. The example datasets that are used in this tutorial are abnormal – most cases of wavelength shifts are small. It assumes that the user knows how to download MAST data and how to run the coadd code. Check out our CoaddTutorial.ipynb notebook for a detailed explanation of how to do both of these things.
Please check out our Setup.ipynb notebook before running this tutorial to learn how to install and run the coadd code.
Imports#
We will be using multiple libraries to retrieve and analyze data. We will use:
os,shutil,Path.pathlib, andglobto work with our system’s directories and filepathsmatplotlib.pyplotto plot our data and shiftsnumpyto perform analysis on our dataastroquery.mastto download our STIS and COS datasets for the exercisesastropy.io fitsto read the correspondingFITSfilescalcosandstistoolsto run the COS and STIS calibration pipelines, respectivelyscipy.optimizeto fit a Gaussian when determining the radial velocityastropy.modelingandscipy.signalto help us fit a quadratic when calculating our shifts
We recommend creating a HASP-specific conda environment when coadding spectra. You can check out our Setup.ipynb notebook to create such an environment. Alternatively, you can also download the required dependencies to run this notebook with the terminal command:
pip install -r requirements.txt
This will download the dependencies that are necessary to run this current notebook. You will also need to install hstcal to run the STIS portion of this notebook. You can run the command below in your terminal after you’ve activated your conda environment:
conda install -y -c conda-forge hstcal==3.0.3
Or, similar to the requirements.txt file, you can run:
bash pre-requirements.sh
Let’s import all of the packages that we will use in this notebook and print our conda environment by running the next cell:
import os
import shutil
from pathlib import Path
import matplotlib.pyplot as plt
import numpy as np
from astroquery.mast import Observations
from astropy.io import fits
import calcos
import stistools
from astropy.modeling import fitting
from astropy.modeling.models import Polynomial1D
from scipy.signal import correlate
from scipy.signal import correlation_lags
from scipy import optimize
print("Currently active conda environment:", os.environ.get("CONDA_PREFIX"))
The following tasks in the stistools package can be run with TEAL:
basic2d calstis ocrreject wavecal x1d x2d
Currently active conda environment: /usr/share/miniconda/envs/hstcal
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/stsci/tools/nmpfit.py:8: UserWarning: NMPFIT is deprecated - stsci.tools v 3.5 is the last version to contain it.
warnings.warn("NMPFIT is deprecated - stsci.tools v 3.5 is the last version to contain it.")
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/stsci/tools/gfit.py:18: UserWarning: GFIT is deprecated - stsci.tools v 3.4.12 is the last version to contain it.Use astropy.modeling instead.
warnings.warn("GFIT is deprecated - stsci.tools v 3.4.12 is the last version to contain it."
Since we will be running both CalCOS and CalSTIS, we will need to set up environment variables for when we use the Calibration Reference Data System. Much of this is gone in detail in the COS notebook, Setup.ipynb notebook. We will download the STIS reference files in a later cell since we’ll need the data downloaded.
# We will set the CRDS_PATH environment_variable
# Creating path to where the files are saved
crds_path = os.path.join(os.environ["HOME"], "crds_cache")
# Setting the environment variable CRDS_PATH to our CRDS path
os.environ["CRDS_PATH"] = crds_path
# URL for the STScI CRDS page
crds_server_url = "https://hst-crds.stsci.edu"
# Setting env variable to URL
os.environ["CRDS_SERVER_URL"] = crds_server_url
# Set the lref environment variable (COS)
lref = os.path.join(crds_path, "references/hst/cos")
os.environ["lref"] = lref
!crds sync --contexts hst_cos_0357.imap --fetch-references
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_ywlkfile_0003.rmap 922 bytes (1 / 26 files) (0 / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_xwlkfile_0002.rmap 922 bytes (2 / 26 files) (922 / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_xtractab_0269.rmap 1.6 K bytes (3 / 26 files) (1.8 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_wcptab_0257.rmap 1.3 K bytes (4 / 26 files) (3.5 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_twozxtab_0277.rmap 990 bytes (5 / 26 files) (4.8 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_tracetab_0276.rmap 998 bytes (6 / 26 files) (5.8 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_tdstab_0271.rmap 803 bytes (7 / 26 files) (6.8 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_spwcstab_0255.rmap 1.1 K bytes (8 / 26 files) (7.6 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_spottab_0006.rmap 766 bytes (9 / 26 files) (8.7 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_proftab_0276.rmap 1.0 K bytes (10 / 26 files) (9.4 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_phatab_0250.rmap 668 bytes (11 / 26 files) (10.4 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_lamptab_0264.rmap 1.4 K bytes (12 / 26 files) (11.1 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_hvtab_0259.rmap 567 bytes (13 / 26 files) (12.5 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_hvdstab_0002.rmap 1.0 K bytes (14 / 26 files) (13.0 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_gsagtab_0259.rmap 712 bytes (15 / 26 files) (14.1 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_geofile_0250.rmap 670 bytes (16 / 26 files) (14.8 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_fluxtab_0282.rmap 1.7 K bytes (17 / 26 files) (15.5 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_flatfile_0264.rmap 1.8 K bytes (18 / 26 files) (17.2 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_disptab_0276.rmap 1.7 K bytes (19 / 26 files) (19.0 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_dgeofile_0002.rmap 909 bytes (20 / 26 files) (20.7 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_deadtab_0250.rmap 711 bytes (21 / 26 files) (21.6 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_brsttab_0250.rmap 696 bytes (22 / 26 files) (22.3 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_brftab_0250.rmap 614 bytes (23 / 26 files) (23.0 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_bpixtab_0260.rmap 773 bytes (24 / 26 files) (23.6 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_badttab_0252.rmap 643 bytes (25 / 26 files) (24.4 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_cos_0357.imap 1.4 K bytes (26 / 26 files) (25.0 K / 26.5 K bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/03p1706jl_wcp.fits 14.4 K bytes (1 / 108 files) (0 / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/05i1639ml_disp.fits 20.2 K bytes (2 / 108 files) (14.4 K / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/14o2013ql_xwalk.fits 4.2 M bytes (3 / 108 files) (34.6 K / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/14o20140l_wcp.fits 14.4 K bytes (4 / 108 files) (4.2 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/15c2018fl_dgeo.fits 102.2 M bytes (5 / 108 files) (4.3 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/19m1548dl_flat.fits 134.2 M bytes (6 / 108 files) (106.5 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/19m1548jl_flat.fits 134.2 M bytes (7 / 108 files) (240.7 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/19m1548ql_flat.fits 134.2 M bytes (8 / 108 files) (375.0 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/23n1744jl_lamp.fits 16.3 M bytes (9 / 108 files) (509.2 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256il_1dx.fits 34.6 K bytes (10 / 108 files) (525.5 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256jl_trace.fits 15.8 M bytes (11 / 108 files) (525.5 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256ml_disp.fits 28.8 K bytes (12 / 108 files) (541.3 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256nl_2zx.fits 25.9 K bytes (13 / 108 files) (541.3 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256ol_lamp.fits 17.9 M bytes (14 / 108 files) (541.3 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits 705.8 M bytes (15 / 108 files) (559.2 M / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/46t1622el_flat.fits 134.2 M bytes (16 / 108 files) (1.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/49g17153l_disp.fits 20.2 K bytes (17 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/49g17154l_spwcs.fits 23.0 K bytes (18 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/4ae20499l_flat.fits 4.2 M bytes (19 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/52m2056fl_tds.fits 697.0 K bytes (20 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/57g19494l_bpix.fits 14.4 K bytes (21 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5992009hl_profile.fits 832.8 M bytes (22 / 108 files) (1.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5992009nl_trace.fits 18.9 M bytes (23 / 108 files) (2.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5992009ol_disp.fits 28.8 K bytes (24 / 108 files) (2.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5992009ql_flat.fits 134.2 M bytes (25 / 108 files) (2.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5992009tl_2zx.fits 20.2 K bytes (26 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/59920102l_1dx.fits 34.6 K bytes (27 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b91919sl_trace.fits 14.7 M bytes (28 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b91919tl_lamp.fits 16.8 M bytes (29 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b919201l_lamp.fits 17.9 M bytes (30 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b919203l_2zx.fits 17.3 K bytes (31 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b919205l_disp.fits 23.0 K bytes (32 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b919206l_1dx.fits 23.0 K bytes (33 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/5b91920fl_profile.fits 622.1 M bytes (34 / 108 files) (2.4 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/62m19537l_phot.fits 2.5 M bytes (35 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/62m19539l_phot.fits 2.2 M bytes (36 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/62m1953bl_phot.fits 2.8 M bytes (37 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/62m1953cl_phot.fits 2.7 M bytes (38 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/6331526il_wcp.fits 14.4 K bytes (39 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/63p1559jl_disp.fits 43.2 K bytes (40 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/66r2010dl_phot.fits 2.1 M bytes (41 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69d21090l_flat.fits 134.2 M bytes (42 / 108 files) (3.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69d21093l_lamp.fits 17.9 M bytes (43 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69d2109fl_disp.fits 28.8 K bytes (44 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69f1919fl_1dx.fits 54.7 K bytes (45 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69f20032l_spot.fits 20.2 K bytes (46 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/69m20528l_bpix.fits 23.0 K bytes (47 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/71j1935dl_gsag.fits 25.2 M bytes (48 / 108 files) (3.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/71j1935gl_gsag.fits 28.9 M bytes (49 / 108 files) (3.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/76u1835sl_2zx.fits 25.9 K bytes (50 / 108 files) (3.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/76u18360l_trace.fits 7.9 M bytes (51 / 108 files) (3.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/76u18362l_profile.fits 792.4 M bytes (52 / 108 files) (3.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/76u18369l_1dx.fits 34.6 K bytes (53 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/8141834il_badt.fits 8.6 K bytes (54 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j2044tl_phot.fits 2.3 M bytes (55 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j20451l_phot.fits 1.2 M bytes (56 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j20452l_phot.fits 2.5 M bytes (57 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j20454l_tds.fits 699.8 K bytes (58 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j20455l_phot.fits 2.5 M bytes (59 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/83j20457l_phot.fits 2.7 M bytes (60 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/8782023sl_tds.fits 8.0 M bytes (61 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/87t2019dl_hvds.fits 8.6 K bytes (62 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/88m17269l_ywalk.fits 538.6 K bytes (63 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/r7p1113nl_geo.fits 96.4 M bytes (64 / 108 files) (4.1 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g17006l_1dx.fits 17.3 K bytes (65 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g17007l_1dx.fits 17.3 K bytes (66 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700dl_bpix.fits 14.4 K bytes (67 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700fl_burst.fits 11.5 K bytes (68 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700gl_dead.fits 8.6 K bytes (69 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700il_lamp.fits 4.7 M bytes (70 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700jl_pha.fits 8.6 K bytes (71 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700kl_phot.fits 1.6 M bytes (72 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700nl_1dx.fits 46.1 K bytes (73 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700ol_1dx.fits 46.1 K bytes (74 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700pl_bpix.fits 11.5 K bytes (75 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700ql_dead.fits 8.6 K bytes (76 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g1700tl_flat.fits 4.2 M bytes (77 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g17010l_lamp.fits 1.8 M bytes (78 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g17011l_phot.fits 2.1 M bytes (79 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/s7g17013l_disp.fits 34.6 K bytes (80 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/t2314311l_wcp.fits 11.5 K bytes (81 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/t2k1224el_disp.fits 11.5 K bytes (82 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/t9b18112l_wcp.fits 11.5 K bytes (83 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/t9e1307kl_disp.fits 20.2 K bytes (84 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/t9e1307ll_disp.fits 51.8 K bytes (85 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/u1t1616ol_lamp.fits 2.4 M bytes (86 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/u1t1616ql_wcp.fits 11.5 K bytes (87 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/u6s1320ql_disp.fits 17.3 K bytes (88 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/u6s1320rl_lamp.fits 6.0 M bytes (89 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai1737ol_spwcs.fits 17.3 K bytes (90 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai1737pl_spwcs.fits 17.3 K bytes (91 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai1737ql_spwcs.fits 17.3 K bytes (92 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai17385l_spwcs.fits 43.2 K bytes (93 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai17386l_spwcs.fits 43.2 K bytes (94 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/uai17387l_spwcs.fits 43.2 K bytes (95 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/wc318317l_pha.fits 11.5 K bytes (96 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/x1u1459gl_geo.fits 102.2 M bytes (97 / 108 files) (4.2 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/x1u1459il_brf.fits 14.4 K bytes (98 / 108 files) (4.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/x1v17414l_1dx.fits 28.8 K bytes (99 / 108 files) (4.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/x6q17586l_1dx.fits 34.6 K bytes (100 / 108 files) (4.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/xaa18189l_disp.fits 17.3 K bytes (101 / 108 files) (4.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/xab1551cl_flat.fits 134.2 M bytes (102 / 108 files) (4.3 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/xae1742al_wcp.fits 14.4 K bytes (103 / 108 files) (4.5 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/xaf1429el_wcp.fits 11.5 K bytes (104 / 108 files) (4.5 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/ybp2015il_hv.fits 14.4 K bytes (105 / 108 files) (4.5 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/z6n16116l_flat.fits 134.2 M bytes (106 / 108 files) (4.5 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/z6n16117l_flat.fits 134.2 M bytes (107 / 108 files) (4.6 G / 4.9 G bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/cos/z6n16118l_flat.fits 134.2 M bytes (108 / 108 files) (4.7 G / 4.9 G bytes)
CRDS - INFO - 0 errors
CRDS - INFO - 0 warnings
CRDS - INFO - 134 infos
We will create a function to consolidate and organize our data since we will be utilizing it for two datasets in the tutorial. The coadd script requires all X1D and SX1 files to be in a single directory to be coadded. When downloading data from MAST, it creates multiple directories: ./mastDownload/HST and within this directory are sub-directories for each observation set. We will move all of the files in these sub-directories to the respective STIS/COS directory.
def consolidate_files(data_path):
'''
Consolidate all files to single directory; necessary for HASP script run.
---------------
Input:
Path data_path: Path object to the directory where the files should be moved.
---------------
Output:
None. Files moved to data_path. ./mastDownload/HST directory is deleted.
'''
# The path to all obs_id folders
mast_path = data_path / Path("mastDownload/HST/")
try:
for obs_id_path in mast_path.iterdir():
for file in obs_id_path.glob("*fits"):
shutil.move(str(file), data_path / file.name)
shutil.rmtree(mast_path.parent)
except Exception as e:
print(f"An error occurred: {e}")
1. Performing Wavelength Adjustments on COS Data#
During science exposures, the wavelength calibration aperture is illuminated by two Pt-Ne lamps, which are used as a template by CalCOS to assign wavelengths to positions on the COS detector. A zero-point shift is then applied to the science data to align the wavelength calibration exposure and the science exposure. These wavelength calibration exposures are taken simultaneously with science exposures (except LP6 exposures; more information about LP6 wavecals in Chapter 5.7.6 of the COS Instrument Handbook). Information about COS wavelength accuracies can be found in Chapter 5.1.11 of the COS Instrument Handbook.
We will create a few different directories for our COS example.
# To hold all of our COS example's output and data
cos_ex = Path("./cos_ex/")
# Contains the RAWTAG and ASN files
cos_data = Path("./cos_ex/cos_data/")
# Holds the unshifted X1Ds and the respective coadd
cos_unshifted = Path("./cos_ex/cos_unshifted/")
cos_unshifted_coadd = Path("./cos_ex/cos_unshifted/coadd/")
# Will contain the X1Ds created with the shift applied, and respective coadd
cos_shifted = Path("./cos_ex/cos_shifted/")
cos_shifted_coadd = Path("./cos_ex/cos_shifted/coadd/")
# If the directory doesn't exist, then create it
cos_ex.mkdir(exist_ok=True)
cos_data.mkdir(exist_ok=True)
cos_unshifted.mkdir(exist_ok=True)
cos_unshifted_coadd.mkdir(exist_ok=True)
cos_shifted.mkdir(exist_ok=True)
cos_shifted_coadd.mkdir(exist_ok=True)
We will be shifting COS FUV spectra of the target LMC079-1, a Wolf-Rayet star observed in the first visit of Program 15824. We will download the dataset from the first visit of this program, LE2701010, which observes the target at LP4 using the grating and central wavelength G160M/1577.
1.1 Downloading and Organizing COS Data using Astroquery#
We will start by downloading our dataset using astroquery.mast Observations module; we will go through this very briefly, so if you are unfamiliar with downloading MAST data using astroquery, please check out our CoaddTutorial.ipynb notebook.
To run the coadd script, we will need to download the X1D files. To perform our wavelength adjustments, we will need to download the RAWTAG and ASN files since we will be calculating the pixel offset between the X1D files and re-running the COS calibration pipeline (CalCOS). Let’s do so in the cell below:
# Querying MAST for our dataset
cos_query = Observations.query_criteria(
obs_id="LE2701010"
)
# Getting a list of products for this dataset
cos_products = Observations.get_product_list(
cos_query
)
# A list of files that we need to run the coadd script and CalCOS
necessary_filetypes = ["X1D", "RAWTAG_A", "RAWTAG_B", "ASN"]
# Downloading the products
Observations.download_products(
cos_products,
download_dir=str(cos_data),
productSubGroupDescription=necessary_filetypes
)
# Moving all files to single directory and deleting mastDownload
consolidate_files(cos_data)
# Now moving all of the original X1Ds to cos_unshifted
for file in cos_data.glob("*x1d*"):
shutil.move(str(file), cos_unshifted / file.name)
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701010_asn.fits to cos_ex/cos_data/mastDownload/HST/le2701010/le2701010_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q0q_rawtag_a.fits to cos_ex/cos_data/mastDownload/HST/le2701q0q/le2701q0q_rawtag_a.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q0q_rawtag_b.fits to cos_ex/cos_data/mastDownload/HST/le2701q0q/le2701q0q_rawtag_b.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q0q_x1d.fits to cos_ex/cos_data/mastDownload/HST/le2701q0q/le2701q0q_x1d.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q2q_rawtag_a.fits to cos_ex/cos_data/mastDownload/HST/le2701q2q/le2701q2q_rawtag_a.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q2q_rawtag_b.fits to cos_ex/cos_data/mastDownload/HST/le2701q2q/le2701q2q_rawtag_b.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q2q_x1d.fits to cos_ex/cos_data/mastDownload/HST/le2701q2q/le2701q2q_x1d.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q4q_rawtag_a.fits to cos_ex/cos_data/mastDownload/HST/le2701q4q/le2701q4q_rawtag_a.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q4q_rawtag_b.fits to cos_ex/cos_data/mastDownload/HST/le2701q4q/le2701q4q_rawtag_b.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q4q_x1d.fits to cos_ex/cos_data/mastDownload/HST/le2701q4q/le2701q4q_x1d.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q6q_rawtag_a.fits to cos_ex/cos_data/mastDownload/HST/le2701q6q/le2701q6q_rawtag_a.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q6q_rawtag_b.fits to cos_ex/cos_data/mastDownload/HST/le2701q6q/le2701q6q_rawtag_b.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/le2701q6q_x1d.fits to cos_ex/cos_data/mastDownload/HST/le2701q6q/le2701q6q_x1d.fits ...
[Done]
1.2 Running the HASP Script on COS Data#
Now that we’ve downloaded our data, we can run our coadd code. We can run the HASP coadd script, saving our coadded data products to the ./cos_ex/cos_unshifted/coadd/ directory:
Note: Again, this notebook will not go into specifics about running the script and analyzing the output files. Please check out our CoaddTutorial.ipynb to learn more about running the script.
!swrapper -i ./cos_ex/cos_unshifted -o ./cos_ex/cos_unshifted/coadd
HASP version 1.0
Ullyses version 4.1.0
Creating list of unique modes from these files:
./cos_ex/cos_unshifted/le2701q0q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_unshifted/le2701q2q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_unshifted/le2701q4q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_unshifted/le2701q6q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
Looping over visits
Processing product (15824, '01')
Targets in visit (15824, '01'): ['LMC079-1']
Processing target LMC079-1 in visit (15824, '01')
Processing grating COS/G160M
Importing files ['./cos_ex/cos_unshifted/le2701q0q_x1d.fits', './cos_ex/cos_unshifted/le2701q2q_x1d.fits', './cos_ex/cos_unshifted/le2701q4q_x1d.fits', './cos_ex/cos_unshifted/le2701q6q_x1d.fits']
Processing file ./cos_ex/cos_unshifted/le2701q0q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q2q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q4q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q6q_x1d.fits
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/ullyses/coadd.py:563: RuntimeWarning: invalid value encountered in divide
thru_nans = segment.data['net'] / segment.data['flux']
Using a maximum SNR of 20.0 in flux-based filtering
WARNING: VerifyWarning: Card is too long, comment will be truncated. [astropy.io.fits.card]
Wrote ./cos_ex/cos_unshifted/coadd/hst_15824_cos_lmc079-1_g160m_le2701_cspec.fits
No need to create abutted product as < 2 single grating products
Looping over proposals
Processing product 15824
Targets in proposal 15824: ['LMC079-1']
Processing target LMC079-1 in proposal 15824
Processing grating COS/G160M
Importing files ['./cos_ex/cos_unshifted/le2701q0q_x1d.fits', './cos_ex/cos_unshifted/le2701q2q_x1d.fits', './cos_ex/cos_unshifted/le2701q4q_x1d.fits', './cos_ex/cos_unshifted/le2701q6q_x1d.fits']
Processing file ./cos_ex/cos_unshifted/le2701q0q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q2q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q4q_x1d.fits
Processing file ./cos_ex/cos_unshifted/le2701q6q_x1d.fits
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/ullyses/coadd.py:563: RuntimeWarning: invalid value encountered in divide
thru_nans = segment.data['net'] / segment.data['flux']
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./cos_ex/cos_unshifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits
Making a product from these gratings
COS/G160M 1342-1800 (Actual: 1383.5-1754.0)
Transition wavelengths tweaked
Starting at the short wavelength end with grating COS/G160M
Truncating current grating at 1753.9885046073168
./cos_ex/cos_unshifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits already exists and overwrite=False, skipping write
Wrote ./cos_ex/cos_unshifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits
We have created two different coadded files by running our script. The file hst_15824_cos_lmc079-1_g160m_le27_cspec.fits is our fully coadded spectrum for this program. The other file, hst_15824_cos_lmc079-1_g160m_le2701_cspec.fits is the visit-level coadd; if we were to include other visits’ X1D files then there would be a similar file created for each visit. Each X1D was taken at a different grating offset (FPPOS), more information about FPPOS is in Section 5.8.2 of the COS Instrument Handbook. Let’s plot the coadd in the cell below with the X1D files:
# Coadd filename
coadd_cos = "hst_15824_cos_lmc079-1_g160m_le27_cspec.fits"
# List of X1D files
x1ds = cos_unshifted.glob("*x1d*")
plt.figure(figsize=(15, 6))
colors = ["blue", "red", "cyan", "orange"]
# Plotting each X1D file
for i, file in enumerate(sorted(x1ds)):
with fits.open(file) as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
plt.plot(wl, flux,
lw=2,
label=f'FPPOS {hdul[0].header["FPPOS"]}',
color=colors[i],
alpha=0.6)
# Plotting the coadd
with fits.open(cos_unshifted_coadd / coadd_cos) as hdul:
wl_coadd = hdul[1].data["WAVELENGTH"].ravel()
flux_coadd = hdul[1].data["FLUX"].ravel()
plt.plot(wl_coadd, flux_coadd,
lw=2,
label="Coadd",
color="black",
alpha=0.6)
# Formatting and titles
plt.title("Coadd and X1D files - LMC079-1 G160M")
plt.xlabel(r'Wavelength [$\AA$]')
plt.ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
plt.ylim(0, 1.5e-13)
plt.legend()
plt.show()
1.3 Identifying a Wavelength Shift in COS Data#
It is up to the user to determine if their data needs to be shifted, and there are multiple different ways to determine if you need to calculate and apply shifts. It can sometimes be visually apparent that there is a wavelength offset when looking at spectral features as you’ll see misalignment, but a more absolute method of determining if your data needs to be shifted is if you compare the coadd’s radial velocity to the literature value. In our COS example, we will compare the coadd’s radial velocity to the ULLYSES High-Level Science Product’s (HLSP) radial velocity. We will do a rough, quick calculation to demonstrate that there’s an actual shift between the datasets; there are more accurate methods of determining the radial velocity but it is outside the scope of this notebook. The ULLYSES team has created tutorial notebooks that detail how to download this data via astroquery. We will download the HLSP for our target, specifically the file hlsp_ullyses_hst_cos_lmc079-1_g160m_dr7_cspec.fits, which is the HLSP for the G160M grating.
ullyses_query = Observations.query_criteria(
target_name="LMC079-1",
provenance_name="ULLYSES",
)
ullyses_prodlist = Observations.get_product_list(
ullyses_query
)
ullyses_prodlist = Observations.filter_products(
ullyses_prodlist,
productFilename="hlsp_ullyses_hst_cos_lmc079-1_g160m_dr7_cspec.fits"
)
Observations.download_products(
ullyses_prodlist,
download_dir=str(cos_ex)
)
download_dir = cos_ex / "mastDownload"
hlsp_dir = download_dir / "HLSP/hlsp_ullyses_hst_cos_lmc079-1_uv"
target_filename = "hlsp_ullyses_hst_cos_lmc079-1_g160m_dr7_cspec.fits"
source_path = hlsp_dir / target_filename
hlsp_path = cos_ex / target_filename
shutil.move(str(source_path), str(hlsp_path))
shutil.rmtree(cos_ex / "mastDownload")
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HLSP/ullyses/lmc079-1/dr7/hlsp_ullyses_hst_cos_lmc079-1_g160m_dr7_cspec.fits to cos_ex/mastDownload/HLSP/hlsp_ullyses_hst_cos_lmc079-1_uv/hlsp_ullyses_hst_cos_lmc079-1_g160m_dr7_cspec.fits ...
[Done]
Now we can plot our coadd with the ULLYSES HLSP. We will zoom in on two different spectral features: SiII at 1526 Å and FeII at 1608 Å.
plt.figure(figsize=(15, 6))
wavelength_range = ([1607, 1611], [1525, 1530])
# Plotting the coadd
plt.plot(wl_coadd, flux_coadd,
lw=2,
label="Coadd",
color="black",
alpha=0.6)
# Plotting the ULLYSES HLSP
with fits.open(hlsp_path) as hdul:
wl_hlsp = hdul[1].data["WAVELENGTH"].ravel()
flux_hlsp = hdul[1].data["FLUX"].ravel()
plt.plot(wl_hlsp, flux_hlsp,
lw=2,
label="ULLYSES HLSP",
color="blue",
alpha=0.6)
plt.title("Coadd and ULLYSES HLSP - LMC079-1 G160M")
plt.xlabel(r'Wavelength [$\AA$]')
plt.ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
plt.legend()
plt.show()
# Zooming in on two spectral features
fig, ax = plt.subplots(1, 2, figsize=(15, 6))
for subplot in ax.ravel():
# Plotting the coadd
subplot.plot(wl_coadd, flux_coadd,
lw=2,
color="black",
alpha=0.6)
# Plotting the HLSP
subplot.plot(wl_hlsp, flux_hlsp,
lw=2,
color="blue",
alpha=0.6)
subplot.set_xlabel(r'Wavelength [$\AA$]')
subplot.set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[0].set_xlim(wavelength_range[0])
ax[0].set_title(f"FUVA - ZOOMED {wavelength_range[0]} Å",
fontweight="bold")
ax[1].set_xlim(wavelength_range[1])
ax[1].set_title(f"FUVB - ZOOMED {wavelength_range[1]} Å",
fontweight="bold")
plt.show()
We can see visually that there is a slight wavelength shift between the two data products. We will do a very rough estimate of the radial velocity using the SiII line at 1526.71 Å.
We will first fit a Gaussian to our spectral feature to determine the model fit parameters of the absorption feature. Let’s define the function below:
def fit_gaussian(wavelength, amplitude, mean, stddev):
'''
Fit a Gaussian to the data.
Gaussian is defined as:
f(x) = c + amplitude * np.exp(-(((wavelength - mean) / stddev)**2)/2)
----------
Input:
arr wavelength : Data of the independent variable (wl in our context)
float amplitude : Amplitude of Gaussian. Represents the peak of the data
float mean : Mean wl of Gaussian. Represents central wavelength of feature
float stddev : Standard deviation of Gaussian. Represents function's width
----------
Output:
The value of flux at each wavelength using the fit.
'''
# An estimate of the continuum flux value
c = 6.5e-14
return c + amplitude * np.exp(-(((wavelength - mean) / stddev)**2)/2)
We will use scipy.optimize to help fit our model to the absorption feature by optimizing the parameters of the fit_gaussian function. We’ll calculate the radial velocity of the HLSP first. This will allow us to determine the exact wavelength corresponding to the peak of the fitted Gaussian, which we’ll use to calculate the radial velocity of the HLSP.
# Getting the indicies within the wavelength range
indicies = np.where((wl_hlsp >= 1525.1) & (wl_hlsp <= 1526.8))
trimmed_flux = flux_hlsp[indicies]
trimmed_wl = wl_hlsp[indicies]
# We need to make an initial guess for the parameter values
# The array is in form [PEAK OF GAUSSIAN, CENTRAL WAVELENGTH, WIDTH OF LINE]
p0 = [.8e-14, 1526.7, 0.0053]
popt_hlsp, _ = optimize.curve_fit(fit_gaussian,
trimmed_wl,
trimmed_flux,
p0)
print(f"The SiII peak is fitted to be {np.round(popt_hlsp[1], 3)} Å")
# Plotting the absorption feature of the HLSP with our fit
plt.figure(figsize=(8, 6))
# Plotting the actual data
plt.plot(
wl_hlsp,
flux_hlsp,
label="HLSP Data"
)
# Plotting our fit
plt.plot(
wl_hlsp,
fit_gaussian(wl_hlsp, *popt_hlsp),
label="Model Fit",
color="red",
alpha=0.6
)
# Adding vertical lines to show fitted "peak"
plt.axvline(popt_hlsp[1],
label='Model\'s Peak',
color="black",
linestyle="dotted")
plt.xlim(wavelength_range[1])
plt.legend()
plt.xlabel(r'Wavelength [$\AA$]')
plt.ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
plt.title("HLSP of LMC079-1 with Modeled Fit",
fontweight="bold")
plt.show()
The SiII peak is fitted to be 1526.619 Å
Now that we’ve determined the observed wavelength of the SiII line, we can calculate the radial velocity. The rest wavelength of this line is 1526.71 Å. We will use the equation below to calculate the radial velocity:
\( v_r = c \left( \frac{\lambda - \lambda_0}{\lambda_0} \right) \)
Where:
\( v_r \) is the radial velocity,
\( c \) is the speed of light (\( \approx 2.99 * 10^5 \) km/s),
\( \lambda \) is the observed wavelength of the spectral line,
\( \lambda_0 \) is the rest wavelength of the spectral line.
Let’s calculate it for the HLSP below:
# Speed of light (in km/s)
c = 2.99e5
# Getting the observed wavelength of our HLSP
observed_wavelength = popt_hlsp[1]
# Rest wavelength of SiII
rest_wavelength = 1526.71
v_r = c * ((observed_wavelength - rest_wavelength) / rest_wavelength)
v_r = np.round(v_r, 2)
print(f"The radial velocity of LMC079-1 using the HLSP is roughly {v_r} km/s")
The radial velocity of LMC079-1 using the HLSP is roughly -17.78 km/s
Now let’s calculate the radial velocity of our coadd using the same process.
# Getting the indicies within the wavelength range
indicies = np.where((wl_coadd >= 1525.) & (wl_coadd <= 1526.8))
trimmed_flux = flux_coadd[indicies]
trimmed_wl = wl_coadd[indicies]
# We need to make an initial guess for the parameter values
# The array is in form [PEAK OF GAUSSIAN, CENTRAL WAVELENGTH, WIDTH OF LINE]
p0 = [.75e-14, 1526.7, 0.0055]
popt, _ = optimize.curve_fit(fit_gaussian,
trimmed_wl,
trimmed_flux,
p0)
print(f"The SiII peak is fitted to be {np.round(popt[1], 3)} Å")
# Plotting the absorption feature of the HLSP with our fit
plt.figure(figsize=(8, 6))
# Plotting the actual data
plt.plot(
wl_coadd,
flux_coadd,
label="Coadd Data"
)
# Plotting our fit
plt.plot(
wl_coadd,
fit_gaussian(wl_coadd, *popt),
label="Model Fit",
color="red",
alpha=0.6
)
# Adding vertical lines to show fitted "peak"
plt.axvline(popt[1],
label='Coadd Model\'s Peak',
color="black",
linestyle="dotted")
# Adding vertical line to show observed wl of HLSP
plt.axvline(popt_hlsp[1],
label='HLSP Model\'s Peak',
color="red",
linestyle="dashed")
plt.xlim(wavelength_range[1])
plt.legend()
plt.xlabel(r'Wavelength [$\AA$]')
plt.ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
plt.title("Coadd of LMC079-1 with Modeled Fit",
fontweight="bold")
plt.show()
# Getting the observed wavelength of our HLSP
observed_wavelength = popt[1]
v_r = c * ((observed_wavelength - rest_wavelength) / rest_wavelength)
v_r = np.round(v_r, 2)
print(f"The radial velocity of LMC079-1 using the coadd is roughly {v_r} km/s")
The SiII peak is fitted to be 1526.692 Å
The radial velocity of LMC079-1 using the coadd is roughly -3.5 km/s
We can see that there is a very significant difference between the target’s calculated radial velocity using the HLSP (roughly -17.78 km/s) and the coadd (roughly -3.5 km/s). This is an indicator that there is a wavelength offset between the coadd’s constituent X1D files. We will need to determine this wavelength offset between the X1D files, apply this shift when running CalCOS, and redo the coadd.
1.4 Performing Cross-Correlation on X1D COS Data to Calculate Lag#
We will determine the shift of our spectrum by cross-correlating one of the X1D files to the other files, determining the lag with the greatest cross-correlation coefficient, and then inputting this lag into CalCOS to re-generate the X1D files. We will need to calculate the shift, in pixels, for both the FUVA and FUVB segments of each X1D. Users will want to cross-correlate along a wavelength range that captures absorption features unique to the target and is free of instrumental effects. Additionally, cross-correlating across a unique feature of the spectrum rather than the entire spectrum greatly improves the cross-correlation accuracy.
We will cross-correlate along the ranges 1525 - 1530 Å for Segment FUVB and 1607 - 1611 Å for Segment FUVA, which capture SiII and FeII absorption features of this spectrum, respectively. Let’s take a closer look at these spectra:
fig, ax = plt.subplots(3, 1, figsize=(14, 15))
x1ds = cos_unshifted.glob("*x1d*")
for i, file in enumerate(sorted(x1ds)):
# Getting the flux and wavelength for our dataset
data = fits.open(file)[1].data
wavelength = data["WAVELENGTH"].ravel()
flux = data["FLUX"].ravel()
fppos = fits.open(file)[0].header["FPPOS"]
# ax[0] is plot with total spectrum, ax[1] is FUVB, ax[2] is FUVA
for subplot in ax:
# Plotting the spectrum
subplot.plot(wavelength, flux,
lw=2,
alpha=0.6,
color=colors[i],
label=f"FP-POS {fppos}")
subplot.set_xlabel(r'Wavelength [$\AA$]')
subplot.set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
subplot.set_ylim(0, 1.5e-13)
subplot.legend()
# Adding formatting to the subplots
ax[0].set_title("Flux vs Wavelength, LMC079-1, both segments",
fontweight="bold")
ax[1].set_title(f'Flux vs Wavelength, {wavelength_range[1]} Å, Seg FUVB',
fontweight="bold")
ax[2].set_title(f'Flux vs Wavelength, {wavelength_range[0]} Å, Seg FUVA',
fontweight="bold")
ax[1].set_xlim(wavelength_range[1])
ax[2].set_xlim(wavelength_range[0])
ax[0].legend()
fig.tight_layout()
plt.show()
We can see an apparent shift between the X1D files, especially between the FPPOS 1+2 and FPPOS 3+4 exposures.
We will now determine which X1D file will be the reference file. Users have different methods for determining the reference file best suited for your dataset. For this example, we will choose the reference file to be the X1D with a model peak closest to the HLSP’s peak of the SiII absorption feature.
We’ll define a function to help us fit the peaks:
def fit_model(i, p0, ax, wavelength_range, file):
'''
Fit the Gaussian to the feature, return the "peak" wavelength
----------
arr i : The wavelength range to trim flux/wl to
arr p0 : The initial guess for the Gaussian fit
plt.subplot ax : A specific subplot, used for plotting each X1D
arr wavelength_range : Wavelength range for the plot
str file : Path to the X1D file
'''
with fits.open(file) as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
# Getting the indicies within the wavelength range
indicies = np.where((wl >= i[0]) & (wl <= i[1]))
trimmed_flux = flux[indicies]
trimmed_wl = wl[indicies]
popt, _ = optimize.curve_fit(fit_gaussian,
trimmed_wl,
trimmed_flux,
p0)
# Plotting the X1D's data
ax.plot(
wl,
flux
)
# Plotting the fit
ax.plot(
wl,
fit_gaussian(wl, *popt),
label="Modeled Fit",
color="purple"
)
# Adding vertical line to show peak wl of HLSP
ax.axvline(popt_hlsp[1],
label='HLSP Model\'s Peak',
color="red",
linestyle="dashed")
# Adding vertical line to show peak wl of X1D
ax.axvline(popt[1],
label='X1D Model\'s Peak',
color="black",
linestyle="dotted")
ax.set_xlim(wavelength_range)
ax.set_ylim(0, 1.5e-13)
ax.legend()
fppos = fits.getval(file, "FPPOS")
ax.set_title(f'Flux vs Wavelength with Fit, FPPOS {fppos}',
fontweight="bold")
ax.set_xlabel(r'Wavelength [$\AA$]')
ax.set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
peak_diff = np.round(popt[1] - popt_hlsp[1], 3)
ax.text(wavelength_range[1] - 1.35,
1.2e-13,
f'Difference in peak wavelength = {peak_diff} Å',
ha='center', va='center')
return peak_diff
Now we will determine the file to be used as a reference, which will be the file that has the smallest difference in peak wavelength for the SiII feature compared to the HLSP peak.
fig, axes = plt.subplots(2, 2, figsize=(16, 16))
x1ds = list(cos_unshifted.glob("*x1d*"))
# A placeholder reference file
ref_file = x1ds[0]
# A placeholder value for the smallest peak
smallest_peak = 10000
for file, ax in zip(sorted(x1ds), axes.ravel()):
fppos = fits.getval(file, "FPPOS")
i = [1525., 1525.8]
if fppos == 1:
p0 = [-6e-14, 1526.75, 0.13]
elif fppos == 2:
p0 = [-6e-14, 1526.75, 0.125]
elif fppos == 3:
p0 = [-5.75e-14, 1526.65, 0.125]
elif fppos == 4:
p0 = [-5.8e-14, 1526.62, 0.13]
curr_peak = fit_model(i, p0, ax, wavelength_range[1], file)
# Is the current iteration's file closer to the HLSP?
if np.abs(curr_peak) < smallest_peak:
smallest_peak = np.abs(curr_peak)
ref_file = file
plt.show()
fppos = fits.getval(ref_file, "FPPOS")
print(f'The file to be used as reference was taken at FPPOS {fppos}')
/tmp/ipykernel_2291/1408116224.py:21: OptimizeWarning: Covariance of the parameters could not be estimated
popt, _ = optimize.curve_fit(fit_gaussian,
The file to be used as reference was taken at FPPOS 4
As we can see, the file that is closest to the HLSP is the observation taken at FPPOS 4.
We will now define a function to determine the lag and cross-correlation coefficient between our reference and shifted spectra. We will use the correlation_lags function from scipy.signal to compute the cross-correlation coefficient for each lag. The lag is the displacement (in pixels) between the reference and current spectra. The cross-correlation coefficient is in the range [-1, 1], a value of 1 being perfectly correlated, 0 being no correlation, and -1 being inversely correlated. The shift that we will input to CalCOS is going to be the lag at the maximum cross-correlation coefficient value. We will define the function to calculate the lag and cross-correlation coefficient in the cell below (this function is from the STIS Cross Correlation Notebook).
# From the STIS cross correlation notebook
def cross_correlate(ref_flux, shifted_flux):
assert len(shifted_flux) == len(ref_flux), "Arrays must be same size"
# Normalize inputs:
shifted_flux = shifted_flux - shifted_flux.mean()
shifted_flux /= shifted_flux.std()
ref_flux = ref_flux - ref_flux.mean()
ref_flux /= ref_flux.std()
# centered at the median of len(a)
lag = correlation_lags(len(shifted_flux), len(ref_flux), mode="same")
# find the cross-correlation coefficient
cc = correlate(shifted_flux, ref_flux, mode="same") / float(len(ref_flux))
return lag, cc
Now we will define a function to calculate the shift between our reference file (FPPOS 4) and the FPPOS 1+2+3 exposures. We will plot the correlation coefficient vs lag as well. We will have to get shift values for each segment; for FUVA we will correlate to the wavelength range [1607, 1611], and for FUVB we will correlate to the wavelength range [1525, 1530]. Since our cross_correlate function returns only discrete value shifts, we will need to fit a curve to the correlation lag plot; the shift we will apply with CalCOS is at the maxima of this curve.
Note: You will need to experiment with different fits for your dataset.
def find_shift_normalized(ref_file, file, wl_range, segment, width, plot):
'''
Determine shift amount in pixels between the reference file and the file.
Can also plot wavelength range and the correlation coeff. vs lag as well.
----------
Input:
Pathlib path ref_file : Path to reference file's spectrum to shift to.
Pathlib path file : Path to file of spectrum to apply shifts to
arr wl_range : Wavelength range to correlate to. Form: [START_WL, END_WL]
str segment : The segment that is being correlated. Either 'FUVA' or 'FUVB'
int width : Width of fit, needs to be greater than 2
bool plot : Do you want to show plots?
----------
Output:
float shift : Calculated lag [px] between ref and current spectrum
'''
# Grabbing the reference spectrum's data
with fits.open(ref_file) as hdul:
seg_i = np.where(hdul[1].data["SEGMENT"] == segment)
ref_wl = hdul[1].data["WAVELENGTH"][seg_i]
ref_flux = hdul[1].data["FLUX"][seg_i]
# Getting the flux data for the current FPPOS file
with fits.open(file) as hdul:
seg_i = np.where(hdul[1].data["SEGMENT"] == segment)
flux = hdul[1].data["FLUX"][seg_i]
range_i = np.where((ref_wl >= wl_range[0]) & (ref_wl <= wl_range[1]))
# Trimming the flux and wavelength ranges to match the user inputted range
flux = flux[range_i]
ref_flux = ref_flux[range_i]
wavelength = ref_wl[range_i]
# Calculating lag and correlation coeff. using STIS notebook's function
lag, cc = cross_correlate(ref_flux, flux)
# Fitting a quadratic to the peak to find pixel shift
fitter = fitting.LinearLSQFitter()
# Getting the points near the peak
low, hi = np.argmax(cc) - width//2, np.argmax(cc) + width//2 + 1
fit = fitter(Polynomial1D(degree=2), x=lag[low:hi], y=cc[low:hi])
x_c = np.arange(np.min(lag), np.max(lag), 0.01)
# Determining the shift, in pixels
shift1 = -fit.parameters[1] / (2. * fit.parameters[2])
if segment == "FUVA":
shift = shift1 + fits.getval(file, "SHIFT1A", ext=1)
else:
shift = shift1 + fits.getval(file, "SHIFT1B", ext=1)
# If not plotting, then just return the shift
if plot is False:
return shift
fppos = fits.getval(file, 'FPPOS')
print(f"Shift for {segment} between ref and FPPOS {fppos} is {shift1} px")
# Setting up the subplots
fig, ax = plt.subplots(2, 1, figsize=(16, 8))
ax[0].plot(
wavelength,
ref_flux,
lw=2,
label="Reference File"
)
ax[0].plot(
wavelength,
flux,
lw=2,
label=f'FPPOS {fits.getval(file, "FPPOS")}'
)
ax[1].plot(
lag,
cc,
lw=2,
color="black"
)
ax[1].plot(
x_c,
fit(x_c),
lw=2,
color="red",
label="Fitted quadratic",
alpha=0.6
)
ax[1].axvline(
shift1,
linestyle="dashed",
label="Maxima",
)
ax[1].legend()
ax[1].set_ylim(-0.3, 0.8)
ax[1].set_xlim(shift1-100, shift1+100)
# Adjusting formatting + adding titles
ax[0].set_xlabel("Wavelength")
ax[0].set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[0].set_title(f'Flux vs Wavelength, FPPOS {fppos} & Ref, {segment}',
weight="bold")
ax[1].set_xlabel("Lags (px)")
ax[1].set_ylabel("Correlation Coeff.")
ax[1].set_title(f'CC vs Lags (px), FPPOS {fppos} & Ref, {segment}',
weight="bold")
ax[0].legend()
plt.tight_layout()
plt.show()
return
Let’s calculate the shift of both segments for the FPPOS 1 exposure:
fppos1 = cos_unshifted / "le2701q0q_x1d.fits"
widths1 = [25, 25]
find_shift_normalized(ref_file,
fppos1,
wavelength_range[0],
"FUVA",
width=widths1[0],
plot=True)
find_shift_normalized(ref_file,
fppos1,
wavelength_range[1],
"FUVB",
width=widths1[1],
plot=True)
Shift for FUVA between ref and FPPOS 1 is 14.127291788136656 px
Shift for FUVB between ref and FPPOS 1 is 10.149594904818544 px
Now we can do the same for our FPPOS 2 exposure:
fppos2 = cos_unshifted / "le2701q2q_x1d.fits"
widths2 = [25, 35]
find_shift_normalized(ref_file,
fppos2,
wavelength_range[0],
"FUVA",
width=widths2[0],
plot=True)
find_shift_normalized(ref_file,
fppos2,
wavelength_range[1],
"FUVB",
width=widths2[1],
plot=True)
Shift for FUVA between ref and FPPOS 2 is 14.655856093413052 px
Shift for FUVB between ref and FPPOS 2 is 9.414641664769572 px
And finally, let’s calculate the shift for our FPPOS 3 exposure:
fppos3 = cos_unshifted / "le2701q4q_x1d.fits"
widths3 = [25, 30]
find_shift_normalized(ref_file,
fppos3,
wavelength_range[0],
"FUVA",
width=widths3[0],
plot=True)
find_shift_normalized(ref_file,
fppos3,
wavelength_range[1],
"FUVB",
width=widths3[1],
plot=True)
Shift for FUVA between ref and FPPOS 3 is -1.2887920062544729 px
Shift for FUVB between ref and FPPOS 3 is 0.08679990676566517 px
1.5 Applying Shifts to COS data and Re-creating Coadd#
Now that we’ve determined the shift in pixels, we will re-calibrate our data using CalCOS. There are two ways that we can apply our shifts: we can either modify the corrtag files, or we can put them in a .txt file and feed that into CalCOS. We will do the latter option in this tutorial. The shift value that we will write in the .txt file is the sum of the shift we calculated using the above function and the value of the SHIFT1A header keyword of the X1D file (SHIFT1A for FUVA, SHIFT1B for FUVB).
The shifts.txt file must have the following columns:
- ROOTNAME
- FPOFFSET
- FLASH/STRIPE/SEGMENT
- New SHIFT1 value in pixels (dispersion direction shift)
- New SHIFT2 value in pixels (cross-dispersion direction shift)**
**Note: including the SHIFT2 value is optional
If the ROOTNAME is not the association’s rootname, then you can specify FPOFFSET as any in the file. This goes for FLASH/STRIPE/SEGMENT as well, but we will be specifying the segment in our example because we had to calculate the shifts for each segment. More information about running CalCOS when applying the shifts can be found in Section 5.3.2 of the COS Data Handbook.
Running the cell below will create a shifts.txt file, which will be inputted into CalCOS to apply the new shifts to the datasets.
with open(cos_data / "shifts.txt", "w") as shift_file:
widths = (widths1, widths2, widths3)
for file, width in zip([fppos1, fppos2, fppos3], widths):
rootname = fits.getval(file, "ROOTNAME")
shift_fuva = find_shift_normalized(ref_file,
file,
wavelength_range[0],
"FUVA",
width=width[0],
plot=False)
shift_file.write(f'{rootname} any any FUVA {shift_fuva}\n')
shift_fuvb = find_shift_normalized(ref_file,
file,
wavelength_range[1],
"FUVB",
width=width[1],
plot=False)
shift_file.write(f'{rootname} any any FUVB {shift_fuvb}\n')
Now we can run CalCOS on our data to perform the shift. Check out the COS team’s CalCOS notebook for a tutorial on how to run CalCOS.
try:
calcos.calcos(f"{cos_data}/le2701010_asn.fits",
outdir=str(cos_shifted),
shift_file=f"{cos_data}/shifts.txt")
except RuntimeError as e:
print('An error occured', e)
CALCOS version 3.5.1
numpy version 1.26.4
astropy version 6.1.3
Begin 30-Aug-2024 14:48:03 UTC
Association file = cos_ex/cos_data/le2701010_asn.fits
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:48:03 UTC
Input cos_ex/cos_data/le2701q0q_rawtag_a.fits
OutTag cos_ex/cos_shifted/le2701q0q_corrtag_a.fits
OutFlt cos_ex/cos_shifted/le2701q0q_flt_a.fits
OutCounts cos_ex/cos_shifted/le2701q0q_counts_a.fits
OutFlash cos_ex/cos_shifted/le2701q0q_lampflash_a.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment A
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET -2
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.7
2: 545.6 557.0 11.4 551.3
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVA 0.3 (518.7) -485.1 0.00 [ 6.0] -504.9 519358.1 (2750) # user-specified
2 FUVA -0.1 (518.3) -485.1 0.00 [ 5.5] -504.9 1656814.6 (2680) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -487, 0
Shifting to -486, 0
Shifting to -485, 0
Shifting to -485, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -54112
Upper wavelength limit of 2100.000000 corresponds to column 43871
Starting center = 419.120000
13240 good columns
Background regions are from 565 to 595
and from 615 to 645
Adopted background in science data = 0.000782
Centroid = 421.130309
13237 good columns
Background regions are from 567 to 597
and from 617 to 647
Adopted background in science data = 0.000797
Centroid = 421.140414
13237 good columns
Background regions are from 567 to 597
and from 617 to 647
Adopted background in science data = 0.000797
Centroid = 421.140414
Centroid calculation converged
Background regions are from 567 to 597
and from 617 to 647
Error on centroid = 0.009376
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 419.124786, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.778551
Input Reference centroid = 418.778551, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.778551
Reference centroid calculation converged
Using calculated offset of -2.361862
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -487, 0
Shifting to -486, 0
Shifting to -485, 0
Shifting to -485, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:48:18 UTC
Input cos_ex/cos_shifted/le2701q0q_flt_a.fits
Incounts cos_ex/cos_shifted/le2701q0q_counts_a.fits
Output cos_ex/cos_shifted/le2701q0q_x1d_a.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 418.778551
Calculating background for reference profile
Warning: Background region outside array
Warning: Background region outside array
Warning: Background region 2 is outside data array
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:48:20 UTC
Input cos_ex/cos_data/le2701q0q_rawtag_b.fits
OutTag cos_ex/cos_shifted/le2701q0q_corrtag_b.fits
OutFlt cos_ex/cos_shifted/le2701q0q_flt_b.fits
OutCounts cos_ex/cos_shifted/le2701q0q_counts_b.fits
OutFlash cos_ex/cos_shifted/le2701q0q_lampflash_b.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment B
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET -2
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
2: 545.6 557.0 11.4 551.3
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVB 0.4 (581.8) -491.1 0.00 [ 6.0] -507.1 251459.3 (4814) # user-specified
2 FUVB 0.2 (581.6) -491.1 0.00 [ 5.8] -507.1 269671.4 (4811) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -493, 0
Shifting to -492, 0
Shifting to -491, 0
Shifting to -491, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -38777
Upper wavelength limit of 2100.000000 corresponds to column 59278
Starting center = 478.110000
13710 good columns
Background regions are from 401 to 435
and from 605 to 639
Adopted background in science data = 0.001217
Centroid = 479.717805
13710 good columns
Background regions are from 403 to 437
and from 607 to 641
Adopted background in science data = 0.001223
Centroid = 479.730995
13710 good columns
Background regions are from 403 to 437
and from 607 to 641
Adopted background in science data = 0.001223
Centroid = 479.730995
Centroid calculation converged
Background regions are from 403 to 437
and from 607 to 641
Error on centroid = 0.004458
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 478.110870, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943328
Input Reference centroid = 477.943328, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943328
Reference centroid calculation converged
Using calculated offset of -1.787667
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -493, 0
Shifting to -492, 0
Shifting to -491, 0
Shifting to -491, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:49:27 UTC
Input cos_ex/cos_shifted/le2701q0q_flt_b.fits
Incounts cos_ex/cos_shifted/le2701q0q_counts_b.fits
Output cos_ex/cos_shifted/le2701q0q_x1d_b.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 477.943328
Calculating background for reference profile
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:49:29 UTC
Input cos_ex/cos_data/le2701q2q_rawtag_a.fits
OutTag cos_ex/cos_shifted/le2701q2q_corrtag_a.fits
OutFlt cos_ex/cos_shifted/le2701q2q_flt_a.fits
OutCounts cos_ex/cos_shifted/le2701q2q_counts_a.fits
OutFlash cos_ex/cos_shifted/le2701q2q_lampflash_a.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment A
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET -1
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.4 11.8 6.6
2: 545.6 557.0 11.4 551.4
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVA 0.1 (518.5) -181.4 0.00 [ -6.1] -189.4 88906.1 (2762) # user-specified
2 FUVA -0.0 (518.4) -181.4 0.00 [ -7.2] -189.4 95717.9 (2737) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -182, 0
Shifting to -181, 0
Shifting to -180, 0
Shifting to -182, 0
Shifting to -181, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -54112
Upper wavelength limit of 2100.000000 corresponds to column 43871
Starting center = 419.120000
13231 good columns
Background regions are from 565 to 595
and from 615 to 645
Adopted background in science data = 0.000783
Centroid = 421.131506
13229 good columns
Background regions are from 567 to 597
and from 617 to 647
Adopted background in science data = 0.000783
Centroid = 421.143251
13229 good columns
Background regions are from 567 to 597
and from 617 to 647
Adopted background in science data = 0.000783
Centroid = 421.143251
Centroid calculation converged
Background regions are from 567 to 597
and from 617 to 647
Error on centroid = 0.009420
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 419.124786, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.779285
Input Reference centroid = 418.779285, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.779285
Reference centroid calculation converged
Using calculated offset of -2.363967
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -182, 0
Shifting to -181, 0
Shifting to -180, 0
Shifting to -182, 0
Shifting to -181, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:49:43 UTC
Input cos_ex/cos_shifted/le2701q2q_flt_a.fits
Incounts cos_ex/cos_shifted/le2701q2q_counts_a.fits
Output cos_ex/cos_shifted/le2701q2q_x1d_a.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 418.779285
Calculating background for reference profile
Warning: Background region outside array
Warning: Background region outside array
Warning: Background region 2 is outside data array
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:49:45 UTC
Input cos_ex/cos_data/le2701q2q_rawtag_b.fits
OutTag cos_ex/cos_shifted/le2701q2q_corrtag_b.fits
OutFlt cos_ex/cos_shifted/le2701q2q_flt_b.fits
OutCounts cos_ex/cos_shifted/le2701q2q_counts_b.fits
OutFlash cos_ex/cos_shifted/le2701q2q_lampflash_b.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment B
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET -1
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
2: 545.6 557.0 11.4 551.2
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVB 0.2 (581.6) -186.5 0.00 [ -5.9] -189.9 258710.4 (4816) # user-specified
2 FUVB 0.3 (581.7) -186.5 0.00 [ -6.3] -189.9 220208.2 (4810) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -187, 0
Shifting to -186, 0
Shifting to -185, 0
Shifting to -187, 0
Shifting to -186, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -38777
Upper wavelength limit of 2100.000000 corresponds to column 59278
Starting center = 478.110000
13706 good columns
Background regions are from 401 to 435
and from 605 to 639
Adopted background in science data = 0.001285
Centroid = 479.698817
13706 good columns
Background regions are from 403 to 437
and from 607 to 641
Adopted background in science data = 0.001287
Centroid = 479.710929
13706 good columns
Background regions are from 403 to 437
and from 607 to 641
Adopted background in science data = 0.001287
Centroid = 479.710929
Centroid calculation converged
Background regions are from 403 to 437
and from 607 to 641
Error on centroid = 0.004482
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 478.110870, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943197
Input Reference centroid = 477.943197, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943197
Reference centroid calculation converged
Using calculated offset of -1.767732
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to -187, 0
Shifting to -186, 0
Shifting to -185, 0
Shifting to -187, 0
Shifting to -186, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:50:54 UTC
Input cos_ex/cos_shifted/le2701q2q_flt_b.fits
Incounts cos_ex/cos_shifted/le2701q2q_counts_b.fits
Output cos_ex/cos_shifted/le2701q2q_x1d_b.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 477.943197
Calculating background for reference profile
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:50:56 UTC
Input cos_ex/cos_data/le2701q4q_rawtag_a.fits
OutTag cos_ex/cos_shifted/le2701q4q_corrtag_a.fits
OutFlt cos_ex/cos_shifted/le2701q4q_flt_a.fits
OutCounts cos_ex/cos_shifted/le2701q4q_counts_a.fits
OutFlash cos_ex/cos_shifted/le2701q4q_lampflash_a.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment A
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET 0
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVA 0.3 (518.7) 20.5 0.00 [ 21.8] 0.0 5137.8 (2406) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 18, 0
Shifting to 19, 0
Shifting to 20, 0
Shifting to 21, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -54112
Upper wavelength limit of 2100.000000 corresponds to column 43871
Starting center = 419.120000
13227 good columns
Background regions are from 565 to 595
and from 615 to 645
Adopted background in science data = 0.000711
Centroid = 419.582957
13232 good columns
Background regions are from 566 to 596
and from 616 to 646
Adopted background in science data = 0.000715
Centroid = 419.592174
13232 good columns
Background regions are from 566 to 596
and from 616 to 646
Adopted background in science data = 0.000715
Centroid = 419.592174
Centroid calculation converged
Background regions are from 566 to 596
and from 616 to 646
Error on centroid = 0.009470
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 419.124786, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 376 to 406
Adopted background regions for reference profile:
Rows 326 to 356, and rows 376 to 406
Background = 0.000000
Measured reference centroid = 418.787492
Input Reference centroid = 418.787492, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.782456
Input Reference centroid = 418.782456, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.782456
Reference centroid calculation converged
Using calculated offset of -0.809718
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 18, 0
Shifting to 19, 0
Shifting to 20, 0
Shifting to 21, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:51:10 UTC
Input cos_ex/cos_shifted/le2701q4q_flt_a.fits
Incounts cos_ex/cos_shifted/le2701q4q_counts_a.fits
Output cos_ex/cos_shifted/le2701q4q_x1d_a.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 418.782456
Calculating background for reference profile
Warning: Background region outside array
Warning: Background region outside array
Warning: Background region 2 is outside data array
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:51:12 UTC
Input cos_ex/cos_data/le2701q4q_rawtag_b.fits
OutTag cos_ex/cos_shifted/le2701q4q_corrtag_b.fits
OutFlt cos_ex/cos_shifted/le2701q4q_flt_b.fits
OutCounts cos_ex/cos_shifted/le2701q4q_counts_b.fits
OutFlash cos_ex/cos_shifted/le2701q4q_lampflash_b.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment B
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET 0
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVB 0.1 (581.5) 23.1 0.00 [ 23.0] 0.0 11160.6 (4270) # user-specified
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 21, 0
Shifting to 22, 0
Shifting to 23, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -38777
Upper wavelength limit of 2100.000000 corresponds to column 59278
Starting center = 478.110000
13716 good columns
Background regions are from 401 to 435
and from 605 to 639
Adopted background in science data = 0.001209
Centroid = 478.718144
13716 good columns
Background regions are from 402 to 436
and from 606 to 640
Adopted background in science data = 0.001214
Centroid = 478.724798
13716 good columns
Background regions are from 402 to 436
and from 606 to 640
Adopted background in science data = 0.001214
Centroid = 478.724798
Centroid calculation converged
Background regions are from 402 to 436
and from 606 to 640
Error on centroid = 0.004495
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 478.110870, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943168
Input Reference centroid = 477.943168, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.943168
Reference centroid calculation converged
Using calculated offset of -0.781630
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 21, 0
Shifting to 22, 0
Shifting to 23, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:52:20 UTC
Input cos_ex/cos_shifted/le2701q4q_flt_b.fits
Incounts cos_ex/cos_shifted/le2701q4q_counts_b.fits
Output cos_ex/cos_shifted/le2701q4q_x1d_b.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 477.943168
Calculating background for reference profile
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:52:22 UTC
Input cos_ex/cos_data/le2701q6q_rawtag_a.fits
OutTag cos_ex/cos_shifted/le2701q6q_corrtag_a.fits
OutFlt cos_ex/cos_shifted/le2701q6q_flt_a.fits
OutCounts cos_ex/cos_shifted/le2701q6q_counts_a.fits
OutFlash cos_ex/cos_shifted/le2701q6q_lampflash_a.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment A
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET 1
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVA 0.0 (518.4) 303.1 1.35 [ -3.2] 306.3 5041.2 (2464)
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 302, 0
Shifting to 303, 0
Shifting to 303, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -54112
Upper wavelength limit of 2100.000000 corresponds to column 43871
Starting center = 419.120000
13249 good columns
Background regions are from 565 to 595
and from 615 to 645
Adopted background in science data = 0.000767
Centroid = 419.863309
13247 good columns
Background regions are from 566 to 596
and from 616 to 646
Adopted background in science data = 0.000777
Centroid = 419.869228
13247 good columns
Background regions are from 566 to 596
and from 616 to 646
Adopted background in science data = 0.000777
Centroid = 419.869228
Centroid calculation converged
Background regions are from 566 to 596
and from 616 to 646
Error on centroid = 0.009497
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 419.124786, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.784531
Input Reference centroid = 418.784531, row_0 = 240
Unable to extract background region #2 from reference profile
Requested rows: 375 to 405
Adopted background regions for reference profile:
Rows 325 to 355, and rows 375 to 405
Background = 0.000000
Measured reference centroid = 418.784531
Reference centroid calculation converged
Using calculated offset of -1.084697
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 302, 0
Shifting to 303, 0
Shifting to 303, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:52:36 UTC
Input cos_ex/cos_shifted/le2701q6q_flt_a.fits
Incounts cos_ex/cos_shifted/le2701q6q_counts_a.fits
Output cos_ex/cos_shifted/le2701q6q_x1d_a.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 418.784531
Calculating background for reference profile
Warning: Background region outside array
Warning: Background region outside array
Warning: Background region 2 is outside data array
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
Don't add simulated wavecal because association has no exp_swave members
TIME-TAG calibration -- 30-Aug-2024 14:52:38 UTC
Input cos_ex/cos_data/le2701q6q_rawtag_b.fits
OutTag cos_ex/cos_shifted/le2701q6q_corrtag_b.fits
OutFlt cos_ex/cos_shifted/le2701q6q_flt_b.fits
OutCounts cos_ex/cos_shifted/le2701q6q_counts_b.fits
OutFlash cos_ex/cos_shifted/le2701q6q_lampflash_b.fits
wavecal shifts overridden by file cos_ex/cos_data/shifts.txt
DETECTOR FUV, segment B
EXPTYPE EXTERNAL/SCI
OPT_ELEM G160M, CENWAVE 1577, FPOFFSET 1
APERTURE PSA
BADTCORR PERFORM
BADTTAB = lref$8141834il_badt.fits
RANDCORR PERFORM
RANDSEED = 1
TEMPCORR PERFORM
BRFTAB = lref$x1u1459il_brf.fits
GEOCORR PERFORM
GEOFILE = lref$x1u1459gl_geo.fits
IGEOCORR PERFORM
DGEOCORR PERFORM
DGEOFILE= lref$15c2018fl_dgeo.fits
IGEOCORR PERFORM
XWLKCORR PERFORM
XWLKFILE= lref$14o2013ql_xwalk.fits
YWLKCORR PERFORM
YWLKFILE= lref$88m17269l_ywalk.fits
DEADCORR PERFORM
DEADTAB = lref$s7g1700gl_dead.fits
PHACORR PERFORM
PHATAB = lref$wc318317l_pha.fits
DOPPCORR PERFORM
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
BRFTAB = lref$x1u1459il_brf.fits
FLATCORR PERFORM
FLATFILE= lref$19m1548ql_flat.fits
HVDSCORR PERFORM
HVDSTAB = lref$87t2019dl_hvds.fits
WAVECORR PERFORM
Process tagflash wavecal
WCPTAB = lref$14o20140l_wcp.fits
LAMPTAB = lref$2bj2256ol_lamp.fits
XTRACTAB= lref$2bj2256il_1dx.fits
DISPTAB = lref$2bj2256ml_disp.fits
lamp on, off, duration, median time:
1: 0.6 12.6 12.0 6.6
segment cross-disp dispersion direction
shift (locn) shift err [orig.] FP chi sq (n)
------- ------------- ------------------------- ----------
1 FUVB 0.4 (581.8) 302.0 0.35 [ -3.2] 305.2 10757.3 (4349)
LAMPUSED = NONE, which is incorrect; the value will be reset to P1.
HELCORR PERFORM for computing wavelengths for the corrtag table
BRSTCORR OMIT
TRCECORR PERFORM
TRACETAB= lref$2bj2256jl_trace.fits
ALGNCORR PERFORM
PROFTAB = lref$2bj2256ql_profile.fits
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 301, 0
Shifting to 302, 0
Shifting to 302, 0
Calculating centroid
Lower wavelength limit of 900.000000 corresponds to column -38777
Upper wavelength limit of 2100.000000 corresponds to column 59278
Starting center = 478.110000
13717 good columns
Background regions are from 401 to 435
and from 605 to 639
Adopted background in science data = 0.001280
Centroid = 478.318630
13717 good columns
Background regions are from 401 to 435
and from 605 to 639
Adopted background in science data = 0.001280
Centroid = 478.318630
Centroid calculation converged
Background regions are from 401 to 435
and from 605 to 639
Error on centroid = 0.004483
Using profile reference file /home/runner/crds_cache/references/hst/cos/2bj2256ql_profile.fits
Input Reference centroid = 478.110870, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.942683
Input Reference centroid = 477.942683, row_0 = 299
Adopted background regions for reference profile:
Rows 102 to 136, and rows 306 to 340
Background = 0.000000
Measured reference centroid = 477.942683
Reference centroid calculation converged
Using calculated offset of -0.375947
DQICORR PERFORM
BPIXTAB = lref$69m20528l_bpix.fits
GSAGTAB = lref$71j1935gl_gsag.fits
SPOTTAB = lref$69f20032l_spot.fits
Shifting to 301, 0
Shifting to 302, 0
Shifting to 302, 0
STATFLAG T
Append a TIMELINE extension.
Warning: spt file not found, so TIMELINE extension is incomplete
Spectral Extraction -- 30-Aug-2024 14:53:48 UTC
Input cos_ex/cos_shifted/le2701q6q_flt_b.fits
Incounts cos_ex/cos_shifted/le2701q6q_counts_b.fits
Output cos_ex/cos_shifted/le2701q6q_x1d_b.fits
Info: find-target option = no
X1DCORR PERFORM
Extraction algorithm = TWOZONE
TWOZXTAB= lref$2bj2256nl_2zx.fits
PROFTAB = lref$2bj2256ql_profile.fits
DISPTAB = lref$2bj2256ml_disp.fits
HELCORR PERFORM
BACKCORR PERFORM
STATFLAG T
FLUXCORR PERFORM
FLUXTAB = lref$83j20455l_phot.fits
TDSCORR PERFORM
TDSTAB = lref$83j20454l_tds.fits
Two-zone extraction method
Using profile centroid of 477.942683
Calculating background for reference profile
Using extraction percentiles of:
0.500000 and 99.500000 (outer region)
and 10.000000 and 90.000000 (inner region)
SPWCSTAB= lref$49g17154l_spwcs.fits
Average 1-D spectra -- 30-Aug-2024 14:53:52 UTC
Input ['cos_ex/cos_shifted/le2701q0q_x1d.fits', 'cos_ex/cos_shifted/le2701q2q_x1d.fits', 'cos_ex/cos_shifted/le2701q4q_x1d.fits', 'cos_ex/cos_shifted/le2701q6q_x1d.fits']
Output cos_ex/cos_shifted/le2701010_x1dsum.fits
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Warning: Flat field extends beyond the data array; the flat will be truncated.
Average 1-D spectra -- 30-Aug-2024 14:53:52 UTC
Input ['cos_ex/cos_shifted/le2701q0q_x1d.fits']
Output cos_ex/cos_shifted/le2701010_x1dsum1.fits
Average 1-D spectra -- 30-Aug-2024 14:53:52 UTC
Input ['cos_ex/cos_shifted/le2701q2q_x1d.fits']
Output cos_ex/cos_shifted/le2701010_x1dsum2.fits
Average 1-D spectra -- 30-Aug-2024 14:53:52 UTC
Input ['cos_ex/cos_shifted/le2701q4q_x1d.fits']
Output cos_ex/cos_shifted/le2701010_x1dsum3.fits
Average 1-D spectra -- 30-Aug-2024 14:53:52 UTC
Input ['cos_ex/cos_shifted/le2701q6q_x1d.fits']
Output cos_ex/cos_shifted/le2701010_x1dsum4.fits
Warning: spt file not found, so not copied to product
End 30-Aug-2024 14:53:52 UTC
Let’s compare the pre-shifted and shifted wavelength ranges of our observations for both segments:
fig, ax = plt.subplots(2, 2, figsize=(16, 8))
# Plotting the unshifted data on the top row
for i, file in enumerate(sorted(cos_unshifted.glob("*x1d.fits*"))):
with fits.open(file) as hdul:
wavelength = hdul[1].data["WAVELENGTH"].flatten()
flux = hdul[1].data["FLUX"].flatten()
for j in range(0, 2):
ax[0][j].plot(
wavelength,
flux,
lw=2,
alpha=0.6,
label=f'FPPOS {fits.getval(file, "FPPOS")}',
color=colors[i]
)
# Now plotting the shifted data on the bottom row
for i, file in enumerate(sorted(cos_shifted.glob("*x1d.fits*"))):
with fits.open(file) as hdul:
wavelength = hdul[1].data["WAVELENGTH"].flatten()
flux = hdul[1].data["FLUX"].flatten()
for j in range(0, 2):
ax[1][j].plot(
wavelength,
flux,
lw=2,
alpha=0.6,
label=f'FPPOS {fits.getval(file, "FPPOS")}',
color=colors[i]
)
# Adding titles
fig.suptitle("Flux vs Wavelength, Pre-shifted (top) and Shifted (bottom)",
weight="bold",
fontsize=14)
ax[0][0].set_title(f"Pre-shifted, FUVA, {wavelength_range[0]}")
ax[0][1].set_title(f"Pre-shifted, FUVB, {wavelength_range[1]}")
ax[1][0].set_title(f"Shifted, FUVA, {wavelength_range[0]}")
ax[1][1].set_title(f"Shifted, FUVB, {wavelength_range[1]}")
# Setting xlimits
ax[0][0].set_xlim(wavelength_range[0])
ax[0][1].set_xlim(wavelength_range[1][0], wavelength_range[1][1])
ax[1][0].set_xlim(wavelength_range[0])
ax[1][1].set_xlim(wavelength_range[1][0], wavelength_range[1][1])
# Adding a legend and setting ylim
for subplot in ax.flatten():
subplot.legend()
subplot.set_ylim(0, 1.5e-13)
plt.tight_layout()
plt.show()
We can visually see a clear improvement in the spectral features when we applied our shifts to CalCOS as the two absorption features have lined up for all FPPOS.
1.6 Comparing Non-Shifted and Shifted COS Coadds#
Now that we’ve successfully shifted our data, let’s re-create our coadd. We will calculate the radial velocity of the new coadd as well and compare it with our values from the earlier section.
!swrapper -i ./cos_ex/cos_shifted -o ./cos_ex/cos_shifted/coadd
HASP version 1.0
Ullyses version 4.1.0
Creating list of unique modes from these files:
./cos_ex/cos_shifted/le2701q0q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_shifted/le2701q2q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_shifted/le2701q4q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
./cos_ex/cos_shifted/le2701q6q_x1d.fits LMC079-1 COS FUV G160M PSA 15824 (15824, '01')
Looping over visits
Processing product (15824, '01')
Targets in visit (15824, '01'): ['LMC079-1']
Processing target LMC079-1 in visit (15824, '01')
Processing grating COS/G160M
Importing files ['./cos_ex/cos_shifted/le2701q0q_x1d.fits', './cos_ex/cos_shifted/le2701q2q_x1d.fits', './cos_ex/cos_shifted/le2701q4q_x1d.fits', './cos_ex/cos_shifted/le2701q6q_x1d.fits']
Processing file ./cos_ex/cos_shifted/le2701q0q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q2q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q4q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q6q_x1d.fits
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/ullyses/coadd.py:563: RuntimeWarning: invalid value encountered in divide
thru_nans = segment.data['net'] / segment.data['flux']
Using a maximum SNR of 20.0 in flux-based filtering
WARNING: VerifyWarning: Card is too long, comment will be truncated. [astropy.io.fits.card]
Wrote ./cos_ex/cos_shifted/coadd/hst_15824_cos_lmc079-1_g160m_le2701_cspec.fits
No need to create abutted product as < 2 single grating products
Looping over proposals
Processing product 15824
Targets in proposal 15824: ['LMC079-1']
Processing target LMC079-1 in proposal 15824
Processing grating COS/G160M
Importing files ['./cos_ex/cos_shifted/le2701q0q_x1d.fits', './cos_ex/cos_shifted/le2701q2q_x1d.fits', './cos_ex/cos_shifted/le2701q4q_x1d.fits', './cos_ex/cos_shifted/le2701q6q_x1d.fits']
Processing file ./cos_ex/cos_shifted/le2701q0q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q2q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q4q_x1d.fits
Processing file ./cos_ex/cos_shifted/le2701q6q_x1d.fits
/opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/site-packages/ullyses/coadd.py:563: RuntimeWarning: invalid value encountered in divide
thru_nans = segment.data['net'] / segment.data['flux']
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./cos_ex/cos_shifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits
Making a product from these gratings
COS/G160M 1342-1800 (Actual: 1383.5-1753.8)
Transition wavelengths tweaked
Starting at the short wavelength end with grating COS/G160M
Truncating current grating at 1753.8170462302742
./cos_ex/cos_shifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits already exists and overwrite=False, skipping write
Wrote ./cos_ex/cos_shifted/coadd/hst_15824_cos_lmc079-1_g160m_le27_cspec.fits
Let’s see the flux and SNR of our coadd now that we’ve recalibrated:
coadd = "hst_15824_cos_lmc079-1_g160m_le27_cspec.fits"
# The paths to both of our coadds
preshift = cos_unshifted_coadd / coadd
shifted = cos_shifted_coadd / coadd
# Getting the data for our pre- and post-shifted coadd
with fits.open(preshift) as hdul:
pre_wl = hdul[1].data["WAVELENGTH"].ravel()
pre_flux = hdul[1].data["FLUX"].ravel()
pre_snr = hdul[1].data["SNR"].ravel()
with fits.open(shifted) as hdul:
shifted_wl = hdul[1].data["WAVELENGTH"].ravel()
shifted_flux = hdul[1].data["FLUX"].ravel()
shifted_snr = hdul[1].data["SNR"].ravel()
fig, ax = plt.subplots(2, 2, figsize=(14, 8))
# Interpolating flux and SNR arrays since difference shapes from pre-shifted
shifted_flux = np.interp(pre_wl, shifted_wl, shifted_flux)
shifted_snr = np.interp(pre_wl, shifted_wl, shifted_snr)
# Plotting flux vs wavelength
ax[0][0].plot(
pre_wl,
pre_flux,
label="Unshifted",
lw=2,
alpha=0.6,
color="red"
)
ax[0][0].plot(
pre_wl,
shifted_flux,
label="Shifted",
lw=2,
alpha=0.6,
color="blue"
)
# Plotting SNR vs wavelength
ax[0][1].plot(
pre_wl,
pre_snr,
label="Unshifted",
lw=2,
alpha=0.6,
color="red"
)
ax[0][1].plot(
pre_wl,
shifted_snr,
label="Shifted",
lw=2,
alpha=0.6,
color="blue"
)
# Plotting flux residuals
ax[1][0].plot(
pre_wl,
shifted_flux-pre_flux,
lw=2,
color="black",
alpha=0.8
)
# Plotting snr residuals
ax[1][1].plot(
pre_wl,
shifted_snr-pre_snr,
lw=2,
color="black",
alpha=0.8
)
for subplot in ax.ravel():
subplot.set_xlabel(r'Wavelength [$\AA$]')
subplot.legend()
ax[0][0].set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[1][0].set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[0][1].set_ylabel(r'SNR')
ax[1][1].set_ylabel(r'SNR')
ax[0][0].set_title("Flux vs Wavelength, Unshifted and Shifted",
fontweight="bold")
ax[1][0].set_title("Flux Residuals",
fontweight="bold")
ax[0][1].set_title("SNR vs Wavelength, Unshifted and Shifted",
fontweight="bold")
ax[1][1].set_title("SNR Residuals",
fontweight="bold")
plt.tight_layout()
plt.show()
/tmp/ipykernel_2291/3098637481.py:82: UserWarning: No artists with labels found to put in legend. Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
subplot.legend()
While you won’t necessarily see a big improvement in the SNR with a shift, we will see that our coadd has a better wavelength solution by calculating the radial velocity below:
new_coadd = cos_shifted_coadd / "hst_15824_cos_lmc079-1_g160m_le27_cspec.fits"
with fits.open(new_coadd) as hdul:
data_new_coadd = hdul[1].data
wl_new_coadd = data_new_coadd["WAVELENGTH"].ravel()
flux_new_coadd = data_new_coadd["FLUX"].ravel()
# Getting the indicies within the wavelength range
indicies = np.where((wl_new_coadd >= 1525.) & (wl_new_coadd <= 1525.75))
trimmed_flux = flux_new_coadd[indicies]
trimmed_wl = wl_new_coadd[indicies]
# We need to make an initial guess for the parameter values
# The array is in form [PEAK OF GAUSSIAN, CENTRAL WAVELENGTH, WIDTH OF LINE]
p0 = [-0.58e-13, 1526.63, 0.12]
popt, _ = optimize.curve_fit(fit_gaussian,
trimmed_wl,
trimmed_flux,
p0)
print(f"The SiII peak is fitted to be {np.round(popt[1], 3)} Å")
# Plotting the absorption feature of the HLSP with our fit
plt.figure(figsize=(8, 6))
# Plotting the actual data
plt.plot(
wl_new_coadd,
flux_new_coadd,
label="Coadd Data"
)
# Plotting our fit
plt.plot(
wl_new_coadd,
fit_gaussian(wl_new_coadd, *popt),
label="Model Fit",
color="red",
alpha=0.6
)
# Adding vertical lines to show fitted "peak"
plt.axvline(popt[1],
label='Coadd Model\'s Peak',
color="black",
linestyle="dotted")
# Adding vertical line to show observed wl of HLSP
plt.axvline(popt_hlsp[1],
label='HLSP Model\'s Peak',
color="red",
linestyle="dashed")
plt.xlim(wavelength_range[1])
plt.legend()
plt.xlabel(r'Wavelength [$\AA$]')
plt.ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
plt.title("Coadd of LMC079-1 with Modeled Fit",
fontweight="bold")
plt.show()
# Getting the observed wavelength of our HLSP
observed_wavelength = popt[1]
v_r = c * ((observed_wavelength - rest_wavelength) / rest_wavelength)
v_r = np.round(v_r, 2)
print(f"The radial velocity of LMC079-1 using the coadd is roughly {v_r} km/s")
The SiII peak is fitted to be 1526.63 Å
/tmp/ipykernel_2291/3490721434.py:18: OptimizeWarning: Covariance of the parameters could not be estimated
popt, _ = optimize.curve_fit(fit_gaussian,
The radial velocity of LMC079-1 using the coadd is roughly -15.67 km/s
The radial velocity of the coadd created with the shifted X1D files (-15.67 km/s) is a lot closer to the HLSP’s radial velocity (-17.78 km/s) compared to the radial velocity of the pre-shifted coadd (-3.5 km/s). We can now move on to the STIS example.
2. Performing Wavelength Adjustments on STIS Data#
At the beginning of a science exposure, two Pt-Cr/Ne line lamps are flashed to obtain wavelength calibration exposures and assign a zero-point for the wavelength scale. These wavecals are taken at the beginning of virtually every exposure and are automatically taken at each 2300sec interval thereafter. Similar to COS, shifts between exposures can occur due to imperfect target acquisitions, repositioning of the grating, and thermal flexure. In these instances, users will need to manually shift their spectra to ensure the correct wavelength and flux calibrations are being performed. Echelle data and low-resolution spectra are suspectable to rapid sensitivity changes with wavelength, which makes accurate wavelength solutions even more important. Information about STIS wavelength accuracies can be found in Chapter 4.2 of the STIS Instrument Handbook.
We will be shifting data taken with the STIS/CCD, using the 52X2 aperture. There is a small pixel shift between data taken at the nominal position and data taken at the E1 pseudo-aperture position for this STIS mode (mentioned in Joyce 2018). We will download our data using astroquery, run the HASP script, cross-correlate the spectra in the dataset to the brightest observation to calculate the wavelength shift, and then apply this shift using CalSTIS.
Note: many of the cross-correlation steps outlined in this notebook are detailed in the STIS Cross-Correlation Jupyter Notebook
2.1 Downloading and Organizing STIS Data using Astroquery#
We will be downloading STIS/CCD G430L data for the object, AGK+81D266, a spectrophotometric target taken in Program 14423. Let’s create a few directories for our investigation:
# To hold all of our STIS example's output and data
stis_ex = Path("./stis_ex")
# To contain the raw files necessary to run CalSTIS
stis_data = Path("./stis_ex/stis_data/")
# To hold the unshifted data products and coadds
stis_unshifted = Path("./stis_ex/stis_unshifted/")
stis_unshifted_coadd = Path("./stis_ex/stis_unshifted/coadd/")
# To contain the shifted data products and coadds
stis_shifted = Path("./stis_ex/stis_shifted/")
stis_shifted_coadd = Path("./stis_ex/stis_shifted/coadd/")
# If the directory doesn't exist then create it
stis_ex.mkdir(exist_ok=True)
stis_data.mkdir(exist_ok=True)
stis_unshifted.mkdir(exist_ok=True)
stis_unshifted_coadd.mkdir(exist_ok=True)
stis_shifted.mkdir(exist_ok=True)
stis_shifted_coadd.mkdir(exist_ok=True)
We can use astroquery to query our datasets, get a list of associated products, and download the data to our ./stis_data directory. This is similar to how we downloaded the COS data in the previous example.
# Querying our datasets
stis_query = Observations.query_criteria(
proposal_id=14423,
instrument_name="STIS/CCD",
filters="G430L",
target_name="AGK+81D266"
)
# Getting the list of products for our datasets
stis_prodlist = Observations.get_product_list(
stis_query
)
# Some of the files aren't coadded by default because POSTARG != 0
# We won't download these to save memory space
bad_obsids = [
"od1am1090",
"od1am10a0",
"od1am10c0",
"od1am10d0",
"od1am10f0"
]
stis_prodlist = stis_prodlist[~np.isin(stis_prodlist["obs_id"], bad_obsids)]
# Filtering the product list to only get the required files
stis_prodlist = Observations.filter_products(
stis_prodlist,
productSubGroupDescription=["SX1", "RAW", "ASN", "FLT"]
)
# Downloading them to ./stis_data
Observations.download_products(
stis_prodlist,
download_dir=str(stis_data),
)
# Moving all sub-folders to stis_data and deleting mastDownload folder
consolidate_files(stis_data)
# Moving all sx1 to stis_unshifted
for file in stis_data.glob("*sx1.fits*"):
# New path for file
newpath = stis_unshifted / fits.getval(file, 'FILENAME')
# Moving the actual file
shutil.move(file, newpath)
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1030_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al1030/od1al1030_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1030_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al1030/od1al1030_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1030_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al1030/od1al1030_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1030_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al1030/od1al1030_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1040_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al1040/od1al1040_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1040_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al1040/od1al1040_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1040_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al1040/od1al1040_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al1040_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al1040/od1al1040_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2030_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al2030/od1al2030_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2030_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al2030/od1al2030_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2030_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al2030/od1al2030_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2030_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al2030/od1al2030_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2040_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al2040/od1al2040_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2040_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al2040/od1al2040_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2040_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al2040/od1al2040_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al2040_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al2040/od1al2040_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4030_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al4030/od1al4030_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4030_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al4030/od1al4030_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4030_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al4030/od1al4030_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4030_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al4030/od1al4030_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4040_asn.fits to stis_ex/stis_data/mastDownload/HST/od1al4040/od1al4040_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4040_flt.fits to stis_ex/stis_data/mastDownload/HST/od1al4040/od1al4040_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4040_raw.fits to stis_ex/stis_data/mastDownload/HST/od1al4040/od1al4040_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1al4040_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1al4040/od1al4040_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10b0_asn.fits to stis_ex/stis_data/mastDownload/HST/od1am10b0/od1am10b0_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10b0_flt.fits to stis_ex/stis_data/mastDownload/HST/od1am10b0/od1am10b0_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10b0_raw.fits to stis_ex/stis_data/mastDownload/HST/od1am10b0/od1am10b0_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10b0_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1am10b0/od1am10b0_sx1.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10e0_asn.fits to stis_ex/stis_data/mastDownload/HST/od1am10e0/od1am10e0_asn.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10e0_flt.fits to stis_ex/stis_data/mastDownload/HST/od1am10e0/od1am10e0_flt.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10e0_raw.fits to stis_ex/stis_data/mastDownload/HST/od1am10e0/od1am10e0_raw.fits ...
[Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/od1am10e0_sx1.fits to stis_ex/stis_data/mastDownload/HST/od1am10e0/od1am10e0_sx1.fits ...
[Done]
Now we will go and download the reference files needed for running CalSTIS:
# We will set the CRDS_PATH environment_variable
# Creating path to where the files are saved
crds_path = os.path.join(os.environ["HOME"], "crds_cache")
# Setting the environment variable CRDS_PATH to our CRDS path
os.environ["CRDS_PATH"] = crds_path
# URL for the STScI CRDS page
crds_server_url = "https://hst-crds.stsci.edu"
# Setting env variable to URL
os.environ["CRDS_SERVER_URL"] = crds_server_url
# Set the oref environment variable (STIS)
oref = os.path.join(crds_path, "references/hst/stis/")
os.environ["oref"] = oref
!crds bestrefs --update-bestrefs --sync-references=1 --files ./stis_ex/stis_data/*_raw.fits
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_wf4tfile_0250.rmap 678 bytes (1 / 116 files) (0 / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_shadfile_0250.rmap 977 bytes (2 / 116 files) (678 / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_offtab_0250.rmap 642 bytes (3 / 116 files) (1.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_maskfile_0250.rmap 685 bytes (4 / 116 files) (2.3 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_idctab_0250.rmap 696 bytes (5 / 116 files) (3.0 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_flatfile_0250.rmap 30.0 K bytes (6 / 116 files) (3.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_dgeofile_0250.rmap 801 bytes (7 / 116 files) (33.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_darkfile_0250.rmap 178.4 K bytes (8 / 116 files) (34.5 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_biasfile_0250.rmap 3.3 K bytes (9 / 116 files) (212.8 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_atodfile_0250.rmap 874 bytes (10 / 116 files) (216.1 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfpc2_0250.imap 782 bytes (11 / 116 files) (217.0 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_snkcfile_0003.rmap 681 bytes (12 / 116 files) (217.8 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_satufile_0002.rmap 1.0 K bytes (13 / 116 files) (218.5 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_pfltfile_0253.rmap 34.2 K bytes (14 / 116 files) (219.5 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_pctetab_0004.rmap 698 bytes (15 / 116 files) (253.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_oscntab_0250.rmap 747 bytes (16 / 116 files) (254.4 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_npolfile_0254.rmap 4.0 K bytes (17 / 116 files) (255.1 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_nlinfile_0250.rmap 726 bytes (18 / 116 files) (259.2 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_mdriztab_0254.rmap 845 bytes (19 / 116 files) (259.9 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_imphttab_0256.rmap 683 bytes (20 / 116 files) (260.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_idctab_0254.rmap 661 bytes (21 / 116 files) (261.4 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_flshfile_0256.rmap 5.8 K bytes (22 / 116 files) (262.1 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_drkcfile_0194.rmap 234.8 K bytes (23 / 116 files) (267.9 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_dfltfile_0002.rmap 17.1 K bytes (24 / 116 files) (502.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_darkfile_0492.rmap 276.0 K bytes (25 / 116 files) (519.8 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_d2imfile_0251.rmap 605 bytes (26 / 116 files) (795.8 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_crrejtab_0250.rmap 803 bytes (27 / 116 files) (796.4 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_ccdtab_0250.rmap 799 bytes (28 / 116 files) (797.2 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_bpixtab_0310.rmap 11.7 K bytes (29 / 116 files) (798.0 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_biasfile_0267.rmap 23.4 K bytes (30 / 116 files) (809.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_biacfile_0003.rmap 692 bytes (31 / 116 files) (833.1 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_atodtab_0250.rmap 651 bytes (32 / 116 files) (833.8 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_wfc3_0595.imap 1.3 K bytes (33 / 116 files) (834.4 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_tmttab_0002.rmap 745 bytes (34 / 116 files) (835.7 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_tmgtab_0012.rmap 767 bytes (35 / 116 files) (836.4 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_tmctab_0052.rmap 743 bytes (36 / 116 files) (837.2 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_thruput_0056.rmap 329.6 K bytes (37 / 116 files) (837.9 K / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_thermal_0003.rmap 20.4 K bytes (38 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_obsmodes_0004.rmap 743 bytes (39 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_synphot_0067.imap 579 bytes (40 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_xtractab_0250.rmap 815 bytes (41 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_wcptab_0251.rmap 578 bytes (42 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_teltab_0250.rmap 745 bytes (43 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_tdstab_0254.rmap 921 bytes (44 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_tdctab_0252.rmap 650 bytes (45 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_srwtab_0250.rmap 745 bytes (46 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_sptrctab_0251.rmap 895 bytes (47 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_sdctab_0251.rmap 889 bytes (48 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_riptab_0254.rmap 877 bytes (49 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_phottab_0258.rmap 1.6 K bytes (50 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_pfltfile_0250.rmap 23.7 K bytes (51 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_pctab_0250.rmap 3.1 K bytes (52 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_mofftab_0250.rmap 747 bytes (53 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_mlintab_0250.rmap 601 bytes (54 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_lfltfile_0250.rmap 11.8 K bytes (55 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_lamptab_0250.rmap 610 bytes (56 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_inangtab_0250.rmap 815 bytes (57 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_imphttab_0252.rmap 616 bytes (58 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_idctab_0251.rmap 775 bytes (59 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_halotab_0250.rmap 747 bytes (60 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_gactab_0250.rmap 651 bytes (61 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_exstab_0250.rmap 745 bytes (62 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_echsctab_0250.rmap 749 bytes (63 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_disptab_0250.rmap 813 bytes (64 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_darkfile_0353.rmap 59.7 K bytes (65 / 116 files) (1.2 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_crrejtab_0250.rmap 711 bytes (66 / 116 files) (1.3 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_cdstab_0250.rmap 745 bytes (67 / 116 files) (1.3 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_ccdtab_0252.rmap 893 bytes (68 / 116 files) (1.3 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_bpixtab_0250.rmap 845 bytes (69 / 116 files) (1.3 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_biasfile_0355.rmap 119.5 K bytes (70 / 116 files) (1.3 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_apertab_0250.rmap 588 bytes (71 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_apdestab_0252.rmap 636 bytes (72 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_stis_0369.imap 1.7 K bytes (73 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_zprattab_0250.rmap 646 bytes (74 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_tempfile_0250.rmap 1.1 K bytes (75 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_tdffile_0250.rmap 8.9 K bytes (76 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_saadfile_0250.rmap 771 bytes (77 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_saacntab_0250.rmap 594 bytes (78 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_rnlcortb_0250.rmap 771 bytes (79 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_pmskfile_0250.rmap 603 bytes (80 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_pmodfile_0250.rmap 603 bytes (81 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_phottab_0250.rmap 862 bytes (82 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_pedsbtab_0250.rmap 594 bytes (83 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_noisfile_0250.rmap 2.6 K bytes (84 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_nlinfile_0250.rmap 1.7 K bytes (85 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_maskfile_0250.rmap 1.2 K bytes (86 / 116 files) (1.4 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_illmfile_0250.rmap 5.8 K bytes (87 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_idctab_0250.rmap 767 bytes (88 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_flatfile_0250.rmap 11.0 K bytes (89 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_darkfile_0250.rmap 14.9 K bytes (90 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_nicmos_0250.imap 1.1 K bytes (91 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_spottab_0251.rmap 641 bytes (92 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_snkcfile_0097.rmap 7.3 K bytes (93 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_shadfile_0251.rmap 531 bytes (94 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_satufile_0002.rmap 1.2 K bytes (95 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_pfltfile_0253.rmap 69.2 K bytes (96 / 116 files) (1.5 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_pctetab_0253.rmap 615 bytes (97 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_oscntab_0251.rmap 781 bytes (98 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_npolfile_0253.rmap 3.2 K bytes (99 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_mlintab_0250.rmap 646 bytes (100 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_mdriztab_0253.rmap 769 bytes (101 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_imphttab_0260.rmap 769 bytes (102 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_idctab_0256.rmap 1.5 K bytes (103 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_flshfile_0268.rmap 3.4 K bytes (104 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_drkcfile_0448.rmap 14.8 K bytes (105 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_dgeofile_0250.rmap 3.2 K bytes (106 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_darkfile_0439.rmap 86.8 K bytes (107 / 116 files) (1.6 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_d2imfile_0253.rmap 601 bytes (108 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_crrejtab_0251.rmap 945 bytes (109 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_cfltfile_0250.rmap 1.2 K bytes (110 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_ccdtab_0256.rmap 1.4 K bytes (111 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_bpixtab_0252.rmap 1.0 K bytes (112 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_biasfile_0437.rmap 56.9 K bytes (113 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_atodtab_0251.rmap 528 bytes (114 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_acs_0538.imap 1.3 K bytes (115 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/mappings/hst/hst_1177.pmap 495 bytes (116 / 116 files) (1.7 M / 1.7 M bytes)
CRDS - INFO - No comparison context or source comparison requested.
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al1030_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al1040_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al2030_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al2040_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al4030_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1al4040_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1am10b0_raw.fits
CRDS - INFO - ===> Processing ./stis_ex/stis_data/od1am10e0_raw.fits
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/02a1919to_bia.fits 10.5 M bytes (1 / 27 files) (0 / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/02a1920ao_drk.fits 14.7 M bytes (2 / 27 files) (10.5 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/0531402qo_bia.fits 10.5 M bytes (3 / 27 files) (25.2 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/05314032o_bia.fits 10.5 M bytes (4 / 27 files) (35.7 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/05314034o_drk.fits 14.7 M bytes (5 / 27 files) (46.2 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/0531403co_drk.fits 14.7 M bytes (6 / 27 files) (60.9 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/09k14502o_bia.fits 10.5 M bytes (7 / 27 files) (75.6 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/09k14506o_drk.fits 14.7 M bytes (8 / 27 files) (86.1 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/16j16005o_apd.fits 49.0 K bytes (9 / 27 files) (100.8 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/16j16006o_sdc.fits 74.9 K bytes (10 / 27 files) (100.9 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/16j1600co_wcp.fits 20.2 K bytes (11 / 27 files) (101.0 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/16j1600do_ccd.fits 34.6 K bytes (12 / 27 files) (101.0 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/74e15479o_pht.fits 385.9 K bytes (13 / 27 files) (101.0 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/77o18274o_imp.fits 800.6 K bytes (14 / 27 files) (101.4 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/8712049eo_tds.fits 80.6 K bytes (15 / 27 files) (102.2 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/h1v11475o_bpx.fits 11.5 K bytes (16 / 27 files) (102.3 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/h5s11397o_iac.fits 23.0 K bytes (17 / 27 files) (102.3 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/j3m1403io_crr.fits 14.4 K bytes (18 / 27 files) (102.3 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/l2j0137to_dsp.fits 256.3 K bytes (19 / 27 files) (102.3 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/l421050oo_lmp.fits 7.2 M bytes (20 / 27 files) (102.6 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/n7p1031qo_1dx.fits 123.8 K bytes (21 / 27 files) (109.8 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/p9r19203o_gac.fits 250.6 K bytes (22 / 27 files) (109.9 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/pcc2026jo_lfl.fits 16.8 M bytes (23 / 27 files) (110.2 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/q541740no_pct.fits 60.5 K bytes (24 / 27 files) (127.0 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/qa31608go_1dt.fits 8.0 M bytes (25 / 27 files) (127.0 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/x6417094o_pfl.fits 10.5 M bytes (26 / 27 files) (135.1 M / 157.1 M bytes)
CRDS - INFO - Fetching /home/runner/crds_cache/references/hst/stis/y2r1559to_apt.fits 11.6 M bytes (27 / 27 files) (145.6 M / 157.1 M bytes)
CRDS - INFO - 0 errors
CRDS - INFO - 0 warnings
CRDS - INFO - 152 infos
2.2 Running the HASP Script on STIS Data#
Now that we have our data downloaded, we can run the coadd script and create abutted products. Check out our CoaddTutorial.ipynb notebook for a more detailed look as to how to run the script and change the flag parameters.
!swrapper -i ./stis_ex/stis_unshifted -o ./stis_ex/stis_unshifted/coadd
HASP version 1.0
Ullyses version 4.1.0
Creating list of unique modes from these files:
./stis_ex/stis_unshifted/od1al1030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l1')
./stis_ex/stis_unshifted/od1al1040_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'l1')
./stis_ex/stis_unshifted/od1al2030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l2')
./stis_ex/stis_unshifted/od1al2040_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'l2')
./stis_ex/stis_unshifted/od1al4030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l4')
./stis_ex/stis_unshifted/od1al4040_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'l4')
./stis_ex/stis_unshifted/od1am10b0_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'm1')
./stis_ex/stis_unshifted/od1am10e0_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'm1')
Looping over visits
Processing product (14423, 'l1')
Targets in visit (14423, 'l1'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l1')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_unshifted/od1al1030_sx1.fits', './stis_ex/stis_unshifted/od1al1040_sx1.fits']
Processing file ./stis_ex/stis_unshifted/od1al1030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al1040_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
WARNING: VerifyWarning: Card is too long, comment will be truncated. [astropy.io.fits.card]
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al1_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'l2')
Targets in visit (14423, 'l2'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l2')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_unshifted/od1al2030_sx1.fits', './stis_ex/stis_unshifted/od1al2040_sx1.fits']
Processing file ./stis_ex/stis_unshifted/od1al2030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al2040_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al2_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'l4')
Targets in visit (14423, 'l4'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l4')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_unshifted/od1al4030_sx1.fits', './stis_ex/stis_unshifted/od1al4040_sx1.fits']
Processing file ./stis_ex/stis_unshifted/od1al4030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al4040_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al4_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'm1')
Targets in visit (14423, 'm1'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'm1')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_unshifted/od1am10b0_sx1.fits', './stis_ex/stis_unshifted/od1am10e0_sx1.fits']
Processing file ./stis_ex/stis_unshifted/od1am10b0_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1am10e0_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1am1_cspec.fits
No need to create abutted product as < 2 single grating products
Looping over proposals
Processing product 14423
Targets in proposal 14423: ['AGK+81D266']
Processing target AGK+81D266 in proposal 14423
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_unshifted/od1al1030_sx1.fits', './stis_ex/stis_unshifted/od1al1040_sx1.fits', './stis_ex/stis_unshifted/od1al2030_sx1.fits', './stis_ex/stis_unshifted/od1al2040_sx1.fits', './stis_ex/stis_unshifted/od1al4030_sx1.fits', './stis_ex/stis_unshifted/od1al4040_sx1.fits', './stis_ex/stis_unshifted/od1am10b0_sx1.fits', './stis_ex/stis_unshifted/od1am10e0_sx1.fits']
Processing file ./stis_ex/stis_unshifted/od1al1030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al1040_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al2030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al2040_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al4030_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1al4040_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1am10b0_sx1.fits
Processing file ./stis_ex/stis_unshifted/od1am10e0_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits
Making a product from these gratings
STIS/G430L 2895.9-5704.4 (Actual: 2969.5-5702.7)
Transition wavelengths tweaked
Starting at the short wavelength end with grating STIS/G430L
Truncating current grating at 5702.705595657229
./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits already exists and overwrite=False, skipping write
Wrote ./stis_ex/stis_unshifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits
We will plot the coadd over our current SX1 files; the aperture used is also listed in the legend. Observations that were taken at the E1 position have the value 52X2E1 for the PROPAPER header keyword (and are dotted on the plot), whereas observations taken at the nominal position have the value 52X2. Notice the area around 4860Å in the second plot shows a visible shift between datasets taken at the nominal and E1 positions.
coadd_stis = "hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits"
# A list of the SX1 files for our data
sx1s = list(stis_unshifted.glob("*sx1*"))
# Creating a figure with two subplots
fig, ax = plt.subplots(2, 1, figsize=(14, 12))
for curr_plot in ax:
# Plotting each SX1 file
for file in sx1s:
with fits.open(file) as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
aperture = hdul[0].header['PROPAPER']
# Differentiating between nominal and E1 position via linestyle
if aperture == "52X2":
linestyle = "solid"
label = f"{hdul[0].header['ROOTNAME']} - nom."
else:
linestyle = "dotted"
label = f"{hdul[0].header['ROOTNAME']} - E1"
# Plotting the actual data
curr_plot.plot(wl, flux,
label=label,
alpha=0.75,
lw=2,
linestyle=linestyle)
# Plotting the coadd in black
with fits.open(stis_unshifted_coadd / coadd_stis) as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
curr_plot.plot(wl, flux,
label="Coadd",
alpha=0.75,
color="black",
lw=2)
# Adding labels, formatting, xlim
plt.suptitle("SX1 Files against Coadd - AGK+81D266")
plt.xlabel(r'Wavelength [$\AA$]')
ax[0].set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[1].set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
ax[1].set_xlim(4825, 4900)
ax[1].set_ylim(0.4e-13, 1.5e-13)
ax[0].legend()
plt.tight_layout()
plt.show()
Since we see a consistent shift in the data between the observations that used the E1 aperture and the nominal, we need to determine the actual shift in pixels and re-run CalSTIS on our data. We will not be calculating the radial velocity and comparing it to the literature value to reduce notebook length, and because the shift is known to be relative to the nominal position.
2.3 Performing Cross-Correlation on STIS data and Calculating Lag#
There are multiple ways to determine the best observation to set as the reference, and that is up to the user to do so. Since we are shifting all the E1 observations to the nominal positions, we will use the brightest nominal observation as our reference. We are using the brightest because we are making the assumption that it is the observation most centered in the aperture, but you will need to use other methods when determining the file to reference to. Let’s determine the brightest nominal file below:
# A variable for the brightest filename, arbitrarily
ref_file = sx1s[0]
for file in sx1s:
# Getting flux data for current interation's file + current brightest file
with fits.open(file) as hdul:
curr_flux = hdul[1].data["FLUX"].ravel()
aperture = hdul[0].header["PROPAPER"]
with fits.open(ref_file) as ref_hdul:
ref_flux = ref_hdul[1].data["FLUX"].ravel()
# If current file's mean flux > ref file, replace ref file
if ((np.mean(curr_flux) > np.mean(ref_flux)) & (aperture == "52X2")):
ref_file = file
else:
continue
# Printing out our file
print(f"The brightest file is {ref_file.name}.")
The brightest file is od1al2030_sx1.fits.
We’ve now determined that od1al2030_sx1.fits is the brightest spectra of our data. We will go through each SX1 file taken at the E1 position in our data and cross-correlate it to our od1al2030_sx1.fits file. We will calculate the shifts for a single file first (to better illustrate each step), then define a function to perform these same steps for the rest of the files.
We will be cross-correlating similarly to how we did our COS example in the previous section, but this section will mainly follow the steps in the official STIS Cross-Correlation Notebook.
We will need to calculate the mean plate scale, i.e. the dispersion per pixel, for our reference dataset. This will be used to determine the shift in pixels later on in the tutorial.
# Getting a list of files taken at E1 position
e1_pos = [file for file in sx1s if fits.getval(file, "PROPAPER") != "52X2"]
# Example file
stis_file = e1_pos[0]
# Getting the data for the reference file
with fits.open(ref_file) as hdul:
ref_wl = hdul[1].data["WAVELENGTH"].ravel()
ref_flux = hdul[1].data["FLUX"].ravel()
with fits.open(stis_file) as hdul:
ex_wl = hdul[1].data["WAVELENGTH"].ravel()
ex_flux = hdul[1].data["FLUX"].ravel()
# Interpolating the example spectra
ex_flux = np.interp(ref_wl, ex_wl, ex_flux)
# Getting the dispersion per pixel
mean_plate_scale = np.mean(ref_wl[1:] - ref_wl[:-1])
print(f"The dispersion per pixel is {np.round(mean_plate_scale, 2)} Å/pixel")
The dispersion per pixel is 2.75 Å/pixel
Now we will use our cross-correlation function defined in the COS section to determine the lag and cross-correlation coefficient. We can determine the shift by getting the lag value with the highest corresponding cross-correlation coefficient. Our lags are discrete pixel integer values, so we will need to fit a quadratic curve using fitting and Polynomial1D from the astropy.modeling module. The lag at the maxima of our fit is the pixel shift that we will use when re-calibrating with CalSTIS.
Note: you will need to experiment with different fits when determining your lag; there is no single function that will work in all scenarios
# Calculating the lag and cc coeff using the earlier defined function
lag, cc = cross_correlate(ref_flux, ex_flux)
# Fitting a quadratic to the peak to find pixel shift
fitter = fitting.LinearLSQFitter()
# Getting the 8 points near the peak
width = 8
low, hi = np.argmax(cc) - width//2, np.argmax(cc) + width//2 + 1
fit = fitter(Polynomial1D(degree=2), x=lag[low:hi], y=cc[low:hi])
x_c = np.arange(np.min(lag), np.max(lag), 0.01)
# Determining the shift, in pixels
shift1 = -fit.parameters[1] / (2. * fit.parameters[2])
print(f"The shift, in pixels, is {np.round(shift1, 2)} pixels")
print(f"The shift, in angstroms, is {np.round(shift1*mean_plate_scale, 2)}Å")
plt.plot(
lag,
cc,
lw=2,
color="black"
)
plt.plot(
x_c,
fit(x_c),
lw=2,
label="Fitted Quadratic",
alpha=0.6
)
plt.axvline(
shift1,
color="red",
label="Maxima of fit"
)
# Adding title
plt.title("Lag (px) vs Cross Correlation Coeff, with fitted curve and ZOOMED",
weight="bold")
plt.xlabel("Lag (px)")
plt.ylabel("Cross Correlation Coeff.")
plt.ylim(0.9, 1.05)
plt.xlim(shift1 - 25, shift1 + 25)
plt.legend()
plt.tight_layout()
plt.show()
The shift, in pixels, is 1.17 pixels
The shift, in angstroms, is 3.21Å
2.4 Applying Shifts to Raw STIS data and Re-creating Coadd#
Now that we’ve calculated the shift, we need to alter the header keywords of our data and then re-calibrate the spectrum using CalSTIS. We will extract the SHIFTA1 and SHIFTA2 keywords from the corresponding FLT file, add our calculated shift value to the value of this keyword, then set the WAVECORR calibration switch in the RAW file to OMIT and re-run CalSTIS.
# Path to the FLT for our example file
flt_file = stis_data / f"{fits.getval(stis_file, 'ROOTNAME')}_flt.fits"
# Extracting the shift from the FLT file
SHIFTA1 = fits.getval(flt_file, "SHIFTA1", ext=1)
SHIFTA2 = fits.getval(flt_file, "SHIFTA2", ext=1)
# Update SHIFTA1 (spectral direction) to take into account the calculated shift
SHIFTA1 += shift1
# Path to the raw file
raw_file = stis_data / f"{fits.getval(stis_file, 'ROOTNAME')}_raw.fits"
# Updating the header to reflect updated shift + FLT SHIFTA2 value
fits.setval(raw_file, keyword="SHIFTA1", value=SHIFTA1, ext=1)
fits.setval(raw_file, keyword="SHIFTA2", value=SHIFTA2, ext=1)
# Set WAVECORR to OMIT since we're applying the shift
fits.setval(raw_file, "WAVECORR", value="OMIT", ext=0)
Now we can run CalSTIS:
try:
stistools.calstis.calstis(str(raw_file),
outroot=str(stis_shifted))
except RuntimeError as e:
print('An error occured', e)
*** CALSTIS-0 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:24 UTC
Input stis_ex/stis_data/od1al1040_raw.fits
Outroot stis_ex/stis_shifted
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:24 UTC
Input stis_ex/stis_data/od1al1040_raw.fits
Output stis_ex/stis_shifted_blv_tmp.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:24 UTC
Epcfile od1al1b1j_epc.fits
Warning EPCTAB `od1al1b1j_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR PERFORM
DQITAB oref$h1v11475o_bpx.fits
DQITAB PEDIGREE=GROUND
DQITAB DESCRIP =Prel. Ground Calib
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1450.05.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASFILE oref$02a1919to_bia.fits
BIASFILE PEDIGREE=INFLIGHT 08/11/2015 16/11/2015
BIASFILE DESCRIP =Weekly gain=1 bias for STIS CCD data taken after Nov 08 2015-------
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
PHOTCORR OMIT
Imset 1 End 14:56:24 UTC
Imset 2 Begin 14:56:24 UTC
Epcfile od1al1b2j_epc.fits
Warning EPCTAB `od1al1b2j_epc.fits' not found.
DQICORR PERFORM
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1451.58.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
Imset 2 End 14:56:24 UTC
End 30-Aug-2024 14:56:24 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-2 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:24 UTC
Input stis_ex/stis_shifted_blv_tmp.fits
Output stis_ex/stis_shifted_crj_tmp.fits
CRCORR PERFORM
Total number of input image sets = 2
CRREJTAB oref$j3m1403io_crr.fits
CRCORR COMPLETE
End 30-Aug-2024 14:56:24 UTC
*** CALSTIS-2 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:24 UTC
Input stis_ex/stis_shifted_crj_tmp.fits
Output stis_ex/stis_shifted_crj.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:24 UTC
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$02a1920ao_drk.fits
DARKFILE PEDIGREE=INFLIGHT 07/11/2015 16/11/2015
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Nov 07 2015-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:25 UTC
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_shifted_blv_tmp.fits
Output stis_ex/stis_shifted_flt.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:25 UTC
Epcfile od1al1b1j_epc.fits
Warning EPCTAB `od1al1b1j_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$02a1920ao_drk.fits
DARKFILE PEDIGREE=INFLIGHT 07/11/2015 16/11/2015
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Nov 07 2015-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:25 UTC
Imset 2 Begin 14:56:25 UTC
Epcfile od1al1b2j_epc.fits
Warning EPCTAB `od1al1b2j_epc.fits' not found.
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKCORR COMPLETE
FLATCORR PERFORM
FLATCORR COMPLETE
SHADCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 2 End 14:56:25 UTC
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-7 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_shifted_crj.fits
Output stis_ex/stis_shifted_sx2.fits
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:25 UTC
Warning Wavecal processing has not been performed.
HELCORR PERFORM
HELCORR COMPLETE
Order 1 Begin 14:56:25 UTC
X2DCORR PERFORM
DISPCORR PERFORM
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
SDCTAB oref$16j16006o_sdc.fits
SDCTAB PEDIGREE=INFLIGHT 27/05/1997 13/06/2017
SDCTAB DESCRIP =Co-aligned fiducial bars via an update to the CDELT2 plate scales.-
SDCTAB DESCRIP =CDELT2 updated with inflight data, others Lindler/prelaunch
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
INANGTAB oref$h5s11397o_iac.fits
INANGTAB PEDIGREE=GROUND
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
INANGTAB DESCRIP =Model/C. Bowers
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
SPTRCTAB DESCRIP =Lindler/Bohlin/Dressel/Holfeltz postlaunch calibration
FLUXCORR PERFORM
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 14/04/1998
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
PHOTTAB DESCRIP =Updated Sensitivities 2022
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/5/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
PCTAB DESCRIP =12 STIS observations averaged
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR COMPLETE
X2DCORR COMPLETE
DISPCORR COMPLETE
Order 1 End 14:56:25 UTC
Imset 1 End 14:56:25 UTC
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-7 complete ***
*** CALSTIS-6 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
INFO 'E1' has been appended to aperture
Input stis_ex/stis_shifted_crj.fits
Output stis_ex/stis_shifted_sx1.fits
Rootname od1al1040
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
XTRACTAB oref$n7p1031qo_1dx.fits
XTRACTAB PEDIGREE=INFLIGHT 18/05/97
XTRACTAB DESCRIP =Analysis from prop. 7094
XTRACTAB DESCRIP =Analysis from prop. 7094
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 02/09/1997 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
Imset 1 Begin 14:56:25 UTC
Input read into memory.
Order 1 Begin 14:56:25 UTC
X1DCORR PERFORM
BACKCORR PERFORM
******** Calling Slfit ***********BACKCORR COMPLETE
X1DCORR COMPLETE
Spectrum extracted at y position = 892.684
DISPCORR PERFORM
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
INANGTAB oref$h5s11397o_iac.fits
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
DISPCORR COMPLETE
HELCORR PERFORM
HELCORR COMPLETE
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 16/03/2021
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
GACTAB oref$p9r19203o_gac.fits
GACTAB PEDIGREE=INFLIGHT 03/04/2002 03/08/2004
GACTAB DESCRIP =X1D flux corr for grating/aper combos
GACTAB DESCRIP =Grating-Aperture Throughput Correction
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/05/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR PERFORM
CTECORR PERFORM
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
GACTAB correction applied for G430L 52X2E1 4300
CTECORR COMPLETE
FLUXCORR COMPLETE
SGEOCORR OMIT
Row 1 written to disk.
Order 1 End 14:56:25 UTC
trace was rotated by = 0.0493412 degree.
Imset 1 End 14:56:25 UTC
Warning Keyword `XTRACALG' is being added to header.
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-6 complete ***
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-0 complete ***
We will now define a function to calculate and perform shifts on the rest of the E1 position datasets. We have three remaining files to shift, so we will define a function to calculate the fit, plot, and run CalSTIS.
Note that you will need to experiment with different fits/functions for your dataset.
def shift_stis(ref_file, stis_file, width, plot, run_calstis=False):
'''
Determing the shift, in pixels, between the file and the reference.
Update the RAW file with the new shift and run CalSTIS.
----------
Input:
pathlib.Path or str ref_file : Path to the reference file
pathlib.Path or str stis_file : Path to the file that needs to be shifted
int width : Number points to fit at the peak of the function, must be > 2
bool plot : Do you want to plot the cc function and the fit?
bool run_calstis : True if you want to run CalSTIS on the shifted dataset
'''
# Getting the data for the reference file
with fits.open(ref_file) as hdul:
ref_wl = hdul[1].data["WAVELENGTH"].ravel()
ref_flux = hdul[1].data["FLUX"].ravel()
with fits.open(stis_file) as hdul:
ex_wl = hdul[1].data["WAVELENGTH"].ravel()
ex_flux = hdul[1].data["FLUX"].ravel()
# Interpolating the example spectra
ex_flux = np.interp(ref_wl, ex_wl, ex_flux)
# Getting the dispersion per pixel
mean_plate_scale = np.mean(ref_wl[1:] - ref_wl[:-1])
print(f"Dispersion per pixel is {np.round(mean_plate_scale, 2)} Å/pixel")
# Calculating the lag and cc coeff using the earlier defined function
lag, cc = cross_correlate(ref_flux, ex_flux)
# Fitting a quadratic to the peak to find pixel shift
fitter = fitting.LinearLSQFitter()
low, hi = np.argmax(cc) - width//2, np.argmax(cc) + width//2 + 1
fit = fitter(Polynomial1D(degree=2), x=lag[low:hi], y=cc[low:hi])
x_c = np.arange(np.min(lag), np.max(lag), 0.01)
# Determining the shift, in pixels
shift1 = -fit.parameters[1] / (2. * fit.parameters[2])
print(f"The shift, in pixels, is {np.round(shift1, 2)} pixels")
print(f"The shift, in Å, is {np.round(shift1*mean_plate_scale, 2)}Å")
if plot:
plt.plot(
lag,
cc,
lw=2,
color="black",
alpha=0.8
)
plt.plot(
x_c,
fit(x_c),
lw=2,
label="Fitted Quadratic",
alpha=0.6
)
plt.axvline(
shift1,
color="red",
label="Maxima of fit"
)
# Adding title
plt.title("Lag (px) vs Cross Correlation Coeff, with fitted curve",
weight="bold")
plt.xlabel("Lag (px)")
plt.ylabel("Cross Correlation Coeff.")
plt.ylim(0.9, 1.05)
plt.xlim(shift1 - 25, shift1 + 25)
plt.legend()
plt.tight_layout()
plt.show()
if run_calstis:
# Path to the FLT for our example file
flt_file = f"{stis_data}/{fits.getval(stis_file, 'ROOTNAME')}_flt.fits"
# Extracting the shift from the FLT file
SHIFTA1 = fits.getval(flt_file, "SHIFTA1", ext=1)
SHIFTA2 = fits.getval(flt_file, "SHIFTA2", ext=1)
# Update SHIFTA1 (spectral direction) to include the calculated shift
SHIFTA1 += shift1
# Path to the raw file
raw_file = f"{stis_data}/{fits.getval(stis_file, 'ROOTNAME')}_raw.fits"
# Updating the header to reflect updated shift + FLT SHIFTA2 value
fits.setval(raw_file, keyword="SHIFTA1", value=SHIFTA1, ext=1)
fits.setval(raw_file, keyword="SHIFTA2", value=SHIFTA2, ext=1)
# Set WAVECORR to OMIT since we're applying the shift
fits.setval(raw_file, "WAVECORR", value="OMIT", ext=0)
stistools.calstis.calstis(raw_file,
verbose=False,
outroot=f"{str(stis_shifted)}/")
Let’s shift od1al4040_sx1.fits:
width = 7
try:
shift_stis(ref_file, e1_pos[1], width, plot=False, run_calstis=True)
except RuntimeError as e:
print('An error occured', e)
Dispersion per pixel is 2.75 Å/pixel
The shift, in pixels, is 0.76 pixels
The shift, in Å, is 2.1Å
*** CALSTIS-0 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_data/od1al4040_raw.fits
Outroot stis_ex/stis_shifted/od1al4040_raw.fits
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_data/od1al4040_raw.fits
Output stis_ex/stis_shifted/od1al4040_blv_tmp.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:25 UTC
Epcfile od1al4axj_epc.fits
Warning EPCTAB `od1al4axj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR PERFORM
DQITAB oref$h1v11475o_bpx.fits
DQITAB PEDIGREE=GROUND
DQITAB DESCRIP =Prel. Ground Calib
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1451.76.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASFILE oref$09k14502o_bia.fits
BIASFILE PEDIGREE=INFLIGHT 18/08/2016 25/08/2016
BIASFILE DESCRIP =Weekly gain=1 bias for STIS CCD data taken after Aug 18 2016-------
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
PHOTCORR OMIT
Imset 1 End 14:56:25 UTC
Imset 2 Begin 14:56:25 UTC
Epcfile od1al4ayj_epc.fits
Warning EPCTAB `od1al4ayj_epc.fits' not found.
DQICORR PERFORM
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1454.25.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
Imset 2 End 14:56:25 UTC
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-2 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_shifted/od1al4040_blv_tmp.fits
Output stis_ex/stis_shifted/od1al4040_crj_tmp.fits
CRCORR PERFORM
Total number of input image sets = 2
CRREJTAB oref$j3m1403io_crr.fits
CRCORR COMPLETE
End 30-Aug-2024 14:56:25 UTC
*** CALSTIS-2 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:25 UTC
Input stis_ex/stis_shifted/od1al4040_crj_tmp.fits
Output stis_ex/stis_shifted/od1al4040_crj.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:25 UTC
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$09k14506o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 18/08/2016 25/08/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Aug 18 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:26 UTC
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_shifted/od1al4040_blv_tmp.fits
Output stis_ex/stis_shifted/od1al4040_flt.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:26 UTC
Epcfile od1al4axj_epc.fits
Warning EPCTAB `od1al4axj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$09k14506o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 18/08/2016 25/08/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Aug 18 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:26 UTC
Imset 2 Begin 14:56:26 UTC
Epcfile od1al4ayj_epc.fits
Warning EPCTAB `od1al4ayj_epc.fits' not found.
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKCORR COMPLETE
FLATCORR PERFORM
FLATCORR COMPLETE
SHADCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 2 End 14:56:26 UTC
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-7 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_shifted/od1al4040_crj.fits
Output stis_ex/stis_shifted/od1al4040_sx2.fits
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:26 UTC
Warning Wavecal processing has not been performed.
HELCORR PERFORM
HELCORR COMPLETE
Order 1 Begin 14:56:26 UTC
X2DCORR PERFORM
DISPCORR PERFORM
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
SDCTAB oref$16j16006o_sdc.fits
SDCTAB PEDIGREE=INFLIGHT 27/05/1997 13/06/2017
SDCTAB DESCRIP =Co-aligned fiducial bars via an update to the CDELT2 plate scales.-
SDCTAB DESCRIP =CDELT2 updated with inflight data, others Lindler/prelaunch
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
INANGTAB oref$h5s11397o_iac.fits
INANGTAB PEDIGREE=GROUND
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
INANGTAB DESCRIP =Model/C. Bowers
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
SPTRCTAB DESCRIP =Lindler/Bohlin/Dressel/Holfeltz postlaunch calibration
FLUXCORR PERFORM
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 14/04/1998
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
PHOTTAB DESCRIP =Updated Sensitivities 2022
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/5/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
PCTAB DESCRIP =12 STIS observations averaged
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR COMPLETE
X2DCORR COMPLETE
DISPCORR COMPLETE
Order 1 End 14:56:26 UTC
Imset 1 End 14:56:26 UTC
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-7 complete ***
*** CALSTIS-6 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
INFO 'E1' has been appended to aperture
Input stis_ex/stis_shifted/od1al4040_crj.fits
Output stis_ex/stis_shifted/od1al4040_sx1.fits
Rootname od1al4040
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
XTRACTAB oref$n7p1031qo_1dx.fits
XTRACTAB PEDIGREE=INFLIGHT 18/05/97
XTRACTAB DESCRIP =Analysis from prop. 7094
XTRACTAB DESCRIP =Analysis from prop. 7094
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 02/09/1997 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
Imset 1 Begin 14:56:26 UTC
Input read into memory.
Order 1 Begin 14:56:26 UTC
X1DCORR PERFORM
BACKCORR PERFORM
******** Calling Slfit ***********BACKCORR COMPLETE
X1DCORR COMPLETE
Spectrum extracted at y position = 892.751
DISPCORR PERFORM
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
INANGTAB oref$h5s11397o_iac.fits
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
DISPCORR COMPLETE
HELCORR PERFORM
HELCORR COMPLETE
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 16/03/2021
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
GACTAB oref$p9r19203o_gac.fits
GACTAB PEDIGREE=INFLIGHT 03/04/2002 03/08/2004
GACTAB DESCRIP =X1D flux corr for grating/aper combos
GACTAB DESCRIP =Grating-Aperture Throughput Correction
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/05/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR PERFORM
CTECORR PERFORM
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
GACTAB correction applied for G430L 52X2E1 4300
CTECORR COMPLETE
FLUXCORR COMPLETE
SGEOCORR OMIT
Row 1 written to disk.
Order 1 End 14:56:26 UTC
trace was rotated by = 0.0524527 degree.
Imset 1 End 14:56:26 UTC
Warning Keyword `XTRACALG' is being added to header.
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-6 complete ***
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-0 complete ***
Now od1am10e0_sx1.fits:
width = 9
try:
shift_stis(ref_file, e1_pos[2], width, plot=False, run_calstis=True)
except RuntimeError as e:
print('An error occured', e)
Dispersion per pixel is 2.75 Å/pixel
The shift, in pixels, is 0.57 pixels
The shift, in Å, is 1.56Å
*** CALSTIS-0 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_data/od1am10e0_raw.fits
Outroot stis_ex/stis_shifted/od1am10e0_raw.fits
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_data/od1am10e0_raw.fits
Output stis_ex/stis_shifted/od1am10e0_blv_tmp.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:26 UTC
Epcfile od1am1hnj_epc.fits
Warning EPCTAB `od1am1hnj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR PERFORM
DQITAB oref$h1v11475o_bpx.fits
DQITAB PEDIGREE=GROUND
DQITAB DESCRIP =Prel. Ground Calib
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1434.75.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASFILE oref$0531402qo_bia.fits
BIASFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
BIASFILE DESCRIP =Weekly gain=1 bias for STIS CCD data taken after Feb 22 2016-------
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
PHOTCORR OMIT
Imset 1 End 14:56:26 UTC
Imset 2 Begin 14:56:26 UTC
Epcfile od1am1hoj_epc.fits
Warning EPCTAB `od1am1hoj_epc.fits' not found.
DQICORR PERFORM
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1434.94.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
Imset 2 End 14:56:26 UTC
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-2 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_shifted/od1am10e0_blv_tmp.fits
Output stis_ex/stis_shifted/od1am10e0_crj_tmp.fits
CRCORR PERFORM
Total number of input image sets = 2
CRREJTAB oref$j3m1403io_crr.fits
CRCORR COMPLETE
End 30-Aug-2024 14:56:26 UTC
*** CALSTIS-2 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:26 UTC
Input stis_ex/stis_shifted/od1am10e0_crj_tmp.fits
Output stis_ex/stis_shifted/od1am10e0_crj.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:26 UTC
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$05314034o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Feb 22 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:27 UTC
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_shifted/od1am10e0_blv_tmp.fits
Output stis_ex/stis_shifted/od1am10e0_flt.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:27 UTC
Epcfile od1am1hnj_epc.fits
Warning EPCTAB `od1am1hnj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$05314034o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Feb 22 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:27 UTC
Imset 2 Begin 14:56:27 UTC
Epcfile od1am1hoj_epc.fits
Warning EPCTAB `od1am1hoj_epc.fits' not found.
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKCORR COMPLETE
FLATCORR PERFORM
FLATCORR COMPLETE
SHADCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 2 End 14:56:27 UTC
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-7 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_shifted/od1am10e0_crj.fits
Output stis_ex/stis_shifted/od1am10e0_sx2.fits
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:27 UTC
Warning Wavecal processing has not been performed.
HELCORR PERFORM
HELCORR COMPLETE
Order 1 Begin 14:56:27 UTC
X2DCORR PERFORM
DISPCORR PERFORM
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
SDCTAB oref$16j16006o_sdc.fits
SDCTAB PEDIGREE=INFLIGHT 27/05/1997 13/06/2017
SDCTAB DESCRIP =Co-aligned fiducial bars via an update to the CDELT2 plate scales.-
SDCTAB DESCRIP =CDELT2 updated with inflight data, others Lindler/prelaunch
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
INANGTAB oref$h5s11397o_iac.fits
INANGTAB PEDIGREE=GROUND
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
INANGTAB DESCRIP =Model/C. Bowers
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
SPTRCTAB DESCRIP =Lindler/Bohlin/Dressel/Holfeltz postlaunch calibration
FLUXCORR PERFORM
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 14/04/1998
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
PHOTTAB DESCRIP =Updated Sensitivities 2022
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/5/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
PCTAB DESCRIP =12 STIS observations averaged
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR COMPLETE
X2DCORR COMPLETE
DISPCORR COMPLETE
Order 1 End 14:56:27 UTC
Imset 1 End 14:56:27 UTC
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-7 complete ***
*** CALSTIS-6 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
INFO 'E1' has been appended to aperture
Input stis_ex/stis_shifted/od1am10e0_crj.fits
Output stis_ex/stis_shifted/od1am10e0_sx1.fits
Rootname od1am10e0
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
XTRACTAB oref$n7p1031qo_1dx.fits
XTRACTAB PEDIGREE=INFLIGHT 18/05/97
XTRACTAB DESCRIP =Analysis from prop. 7094
XTRACTAB DESCRIP =Analysis from prop. 7094
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 02/09/1997 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
Imset 1 Begin 14:56:27 UTC
Input read into memory.
Order 1 Begin 14:56:27 UTC
X1DCORR PERFORM
BACKCORR PERFORM
******** Calling Slfit ***********BACKCORR COMPLETE
X1DCORR COMPLETE
Spectrum extracted at y position = 892.867
DISPCORR PERFORM
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
INANGTAB oref$h5s11397o_iac.fits
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
DISPCORR COMPLETE
HELCORR PERFORM
HELCORR COMPLETE
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 16/03/2021
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
GACTAB oref$p9r19203o_gac.fits
GACTAB PEDIGREE=INFLIGHT 03/04/2002 03/08/2004
GACTAB DESCRIP =X1D flux corr for grating/aper combos
GACTAB DESCRIP =Grating-Aperture Throughput Correction
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/05/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR PERFORM
CTECORR PERFORM
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
GACTAB correction applied for G430L 52X2E1 4300
CTECORR COMPLETE
FLUXCORR COMPLETE
SGEOCORR OMIT
Row 1 written to disk.
Order 1 End 14:56:27 UTC
trace was rotated by = 0.050452 degree.
Imset 1 End 14:56:27 UTC
Warning Keyword `XTRACALG' is being added to header.
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-6 complete ***
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-0 complete ***
And finally, od1al1040_sx1.fits:
width = 7
try:
shift_stis(ref_file, e1_pos[3], width, plot=False, run_calstis=True)
except RuntimeError as e:
print('An error occured', e)
Dispersion per pixel is 2.75 Å/pixel
The shift, in pixels, is 0.73 pixels
The shift, in Å, is 2.01Å
*** CALSTIS-0 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_data/od1al2040_raw.fits
Outroot stis_ex/stis_shifted/od1al2040_raw.fits
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_data/od1al2040_raw.fits
Output stis_ex/stis_shifted/od1al2040_blv_tmp.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:27 UTC
Epcfile od1al2yrj_epc.fits
Warning EPCTAB `od1al2yrj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR PERFORM
DQITAB oref$h1v11475o_bpx.fits
DQITAB PEDIGREE=GROUND
DQITAB DESCRIP =Prel. Ground Calib
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1442.79.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASFILE oref$05314032o_bia.fits
BIASFILE PEDIGREE=INFLIGHT 27/03/2016 04/04/2016
BIASFILE DESCRIP =Weekly gain=1 bias for STIS CCD data taken after Mar 27 2016-------
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
PHOTCORR OMIT
Imset 1 End 14:56:27 UTC
Imset 2 Begin 14:56:27 UTC
Epcfile od1al2ysj_epc.fits
Warning EPCTAB `od1al2ysj_epc.fits' not found.
DQICORR PERFORM
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1444.06.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
Imset 2 End 14:56:27 UTC
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-2 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_shifted/od1al2040_blv_tmp.fits
Output stis_ex/stis_shifted/od1al2040_crj_tmp.fits
CRCORR PERFORM
Total number of input image sets = 2
CRREJTAB oref$j3m1403io_crr.fits
CRCORR COMPLETE
End 30-Aug-2024 14:56:27 UTC
*** CALSTIS-2 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:27 UTC
Input stis_ex/stis_shifted/od1al2040_crj_tmp.fits
Output stis_ex/stis_shifted/od1al2040_crj.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:27 UTC
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$0531403co_drk.fits
DARKFILE PEDIGREE=INFLIGHT 27/03/2016 04/04/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Mar 27 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:28 UTC
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
Input stis_ex/stis_shifted/od1al2040_blv_tmp.fits
Output stis_ex/stis_shifted/od1al2040_flt.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:28 UTC
Epcfile od1al2yrj_epc.fits
Warning EPCTAB `od1al2yrj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$0531403co_drk.fits
DARKFILE PEDIGREE=INFLIGHT 27/03/2016 04/04/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Mar 27 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:28 UTC
Imset 2 Begin 14:56:28 UTC
Epcfile od1al2ysj_epc.fits
Warning EPCTAB `od1al2ysj_epc.fits' not found.
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKCORR COMPLETE
FLATCORR PERFORM
FLATCORR COMPLETE
SHADCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 2 End 14:56:28 UTC
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-7 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
Input stis_ex/stis_shifted/od1al2040_crj.fits
Output stis_ex/stis_shifted/od1al2040_sx2.fits
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:28 UTC
Warning Wavecal processing has not been performed.
HELCORR PERFORM
HELCORR COMPLETE
Order 1 Begin 14:56:28 UTC
X2DCORR PERFORM
DISPCORR PERFORM
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
SDCTAB oref$16j16006o_sdc.fits
SDCTAB PEDIGREE=INFLIGHT 27/05/1997 13/06/2017
SDCTAB DESCRIP =Co-aligned fiducial bars via an update to the CDELT2 plate scales.-
SDCTAB DESCRIP =CDELT2 updated with inflight data, others Lindler/prelaunch
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
INANGTAB oref$h5s11397o_iac.fits
INANGTAB PEDIGREE=GROUND
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
INANGTAB DESCRIP =Model/C. Bowers
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
SPTRCTAB DESCRIP =Lindler/Bohlin/Dressel/Holfeltz postlaunch calibration
FLUXCORR PERFORM
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 14/04/1998
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
PHOTTAB DESCRIP =Updated Sensitivities 2022
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/5/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
PCTAB DESCRIP =12 STIS observations averaged
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR COMPLETE
X2DCORR COMPLETE
DISPCORR COMPLETE
Order 1 End 14:56:28 UTC
Imset 1 End 14:56:28 UTC
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-7 complete ***
*** CALSTIS-6 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
INFO 'E1' has been appended to aperture
Input stis_ex/stis_shifted/od1al2040_crj.fits
Output stis_ex/stis_shifted/od1al2040_sx1.fits
Rootname od1al2040
OBSMODE ACCUM
APERTURE 52X2E1
OPT_ELEM G430L
DETECTOR CCD
XTRACTAB oref$n7p1031qo_1dx.fits
XTRACTAB PEDIGREE=INFLIGHT 18/05/97
XTRACTAB DESCRIP =Analysis from prop. 7094
XTRACTAB DESCRIP =Analysis from prop. 7094
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 02/09/1997 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
Imset 1 Begin 14:56:28 UTC
Input read into memory.
Order 1 Begin 14:56:28 UTC
X1DCORR PERFORM
BACKCORR PERFORM
******** Calling Slfit ***********BACKCORR COMPLETE
X1DCORR COMPLETE
Spectrum extracted at y position = 892.934
DISPCORR PERFORM
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Offset relative to row 900
INANGTAB oref$h5s11397o_iac.fits
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
DISPCORR COMPLETE
HELCORR PERFORM
HELCORR COMPLETE
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 16/03/2021
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
GACTAB oref$p9r19203o_gac.fits
GACTAB PEDIGREE=INFLIGHT 03/04/2002 03/08/2004
GACTAB DESCRIP =X1D flux corr for grating/aper combos
GACTAB DESCRIP =Grating-Aperture Throughput Correction
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/05/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR PERFORM
CTECORR PERFORM
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
GACTAB correction applied for G430L 52X2E1 4300
CTECORR COMPLETE
FLUXCORR COMPLETE
SGEOCORR OMIT
Row 1 written to disk.
Order 1 End 14:56:28 UTC
trace was rotated by = 0.0508783 degree.
Imset 1 End 14:56:28 UTC
Warning Keyword `XTRACALG' is being added to header.
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-6 complete ***
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-0 complete ***
A file taken in the nominal position, od1am10b0 is also shifted, so we will fix that too:
width = 15
filepath = stis_unshifted / "od1am10b0_sx1.fits"
try:
shift_stis(ref_file, filepath, width, plot=False, run_calstis=True)
except RuntimeError as e:
print('An error occured', e)
Dispersion per pixel is 2.75 Å/pixel
The shift, in pixels, is -0.49 pixels
The shift, in Å, is -1.35Å
*** CALSTIS-0 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
Input stis_ex/stis_data/od1am10b0_raw.fits
Outroot stis_ex/stis_shifted/od1am10b0_raw.fits
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
Input stis_ex/stis_data/od1am10b0_raw.fits
Output stis_ex/stis_shifted/od1am10b0_blv_tmp.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:28 UTC
Epcfile od1am1hgj_epc.fits
Warning EPCTAB `od1am1hgj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR PERFORM
DQITAB oref$h1v11475o_bpx.fits
DQITAB PEDIGREE=GROUND
DQITAB DESCRIP =Prel. Ground Calib
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1434.32.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASFILE oref$0531402qo_bia.fits
BIASFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
BIASFILE DESCRIP =Weekly gain=1 bias for STIS CCD data taken after Feb 22 2016-------
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
PHOTCORR OMIT
Imset 1 End 14:56:28 UTC
Imset 2 Begin 14:56:28 UTC
Epcfile od1am1hhj_epc.fits
Warning EPCTAB `od1am1hhj_epc.fits' not found.
DQICORR PERFORM
DQICORR COMPLETE
ATODCORR OMIT
BLEVCORR PERFORM
Bias level from overscan has been subtracted; \
mean of bias levels subtracted was 1435.35.
BLEVCORR COMPLETE
Uncertainty array initialized, readnoise=6.24, gain=1
BIASCORR PERFORM
BIASCORR COMPLETE
DARKCORR OMIT
FLATCORR OMIT
SHADCORR OMIT
Imset 2 End 14:56:28 UTC
End 30-Aug-2024 14:56:28 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-2 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:28 UTC
Input stis_ex/stis_shifted/od1am10b0_blv_tmp.fits
Output stis_ex/stis_shifted/od1am10b0_crj_tmp.fits
CRCORR PERFORM
Total number of input image sets = 2
CRREJTAB oref$j3m1403io_crr.fits
CRCORR COMPLETE
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-2 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:29 UTC
Input stis_ex/stis_shifted/od1am10b0_crj_tmp.fits
Output stis_ex/stis_shifted/od1am10b0_crj.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:29 UTC
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$05314034o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Feb 22 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:29 UTC
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-1 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:29 UTC
Input stis_ex/stis_shifted/od1am10b0_blv_tmp.fits
Output stis_ex/stis_shifted/od1am10b0_flt.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:29 UTC
Epcfile od1am1hgj_epc.fits
Warning EPCTAB `od1am1hgj_epc.fits' not found.
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKFILE oref$05314034o_drk.fits
DARKFILE PEDIGREE=INFLIGHT 22/02/2016 01/03/2016
DARKFILE DESCRIP =Weekly gain=1 dark for STIS CCD data taken after Feb 22 2016-------
DARKCORR COMPLETE
FLATCORR PERFORM
PFLTFILE oref$x6417094o_pfl.fits
PFLTFILE PEDIGREE=INFLIGHT 24/10/2011 24/06/2012
PFLTFILE DESCRIP =REVISED ON-ORBIT STIS SPECTROSCOPIC CCD P-FLAT FOR L-MODES---------
LFLTFILE oref$pcc2026jo_lfl.fits
LFLTFILE PEDIGREE=INFLIGHT 27/05/1997 03/08/2004
LFLTFILE DESCRIP =CCD G430L Low-Order Flat
FLATCORR COMPLETE
SHADCORR OMIT
PHOTCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 1 End 14:56:29 UTC
Imset 2 Begin 14:56:29 UTC
Epcfile od1am1hhj_epc.fits
Warning EPCTAB `od1am1hhj_epc.fits' not found.
DQICORR OMIT
ATODCORR OMIT
BLEVCORR OMIT
BIASCORR OMIT
DARKCORR PERFORM
DARKCORR COMPLETE
FLATCORR PERFORM
FLATCORR COMPLETE
SHADCORR OMIT
STATFLAG PERFORM
STATFLAG COMPLETE
Imset 2 End 14:56:29 UTC
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-1 complete ***
*** CALSTIS-7 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:29 UTC
Input stis_ex/stis_shifted/od1am10b0_crj.fits
Output stis_ex/stis_shifted/od1am10b0_sx2.fits
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
Imset 1 Begin 14:56:29 UTC
Warning Wavecal processing has not been performed.
HELCORR PERFORM
HELCORR COMPLETE
Order 1 Begin 14:56:29 UTC
X2DCORR PERFORM
DISPCORR PERFORM
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Microscope Meas./Hartig Post-launch Offsets
SDCTAB oref$16j16006o_sdc.fits
SDCTAB PEDIGREE=INFLIGHT 27/05/1997 13/06/2017
SDCTAB DESCRIP =Co-aligned fiducial bars via an update to the CDELT2 plate scales.-
SDCTAB DESCRIP =CDELT2 updated with inflight data, others Lindler/prelaunch
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
INANGTAB oref$h5s11397o_iac.fits
INANGTAB PEDIGREE=GROUND
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
INANGTAB DESCRIP =Model/C. Bowers
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
SPTRCTAB DESCRIP =Lindler/Bohlin/Dressel/Holfeltz postlaunch calibration
FLUXCORR PERFORM
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 14/04/1998
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
PHOTTAB DESCRIP =Updated Sensitivities 2022
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/5/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
PCTAB DESCRIP =12 STIS observations averaged
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR COMPLETE
X2DCORR COMPLETE
DISPCORR COMPLETE
Order 1 End 14:56:29 UTC
Imset 1 End 14:56:29 UTC
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-7 complete ***
*** CALSTIS-6 -- Version 3.4.2 (19-Jan-2018) ***
Begin 30-Aug-2024 14:56:29 UTC
Input stis_ex/stis_shifted/od1am10b0_crj.fits
Output stis_ex/stis_shifted/od1am10b0_sx1.fits
Rootname od1am10b0
OBSMODE ACCUM
APERTURE 52X2
OPT_ELEM G430L
DETECTOR CCD
XTRACTAB oref$n7p1031qo_1dx.fits
XTRACTAB PEDIGREE=INFLIGHT 18/05/97
XTRACTAB DESCRIP =Analysis from prop. 7094
XTRACTAB DESCRIP =Analysis from prop. 7094
SPTRCTAB oref$qa31608go_1dt.fits
SPTRCTAB PEDIGREE=INFLIGHT 02/09/1997 13/02/1998
SPTRCTAB DESCRIP =New traces to account for angle change with time
Imset 1 Begin 14:56:29 UTC
Input read into memory.
Order 1 Begin 14:56:29 UTC
X1DCORR PERFORM
BACKCORR PERFORM
******** Calling Slfit ***********BACKCORR COMPLETE
X1DCORR COMPLETE
Spectrum extracted at y position = 509.434
DISPCORR PERFORM
DISPTAB oref$l2j0137to_dsp.fits
DISPTAB PEDIGREE=INFLIGHT 27/02/1997 24/11/1999
DISPTAB DESCRIP =Lindler, May 2000
DISPTAB DESCRIP =Lindler Postlaunch, May 2000
APDESTAB oref$16j16005o_apd.fits
APDESTAB PEDIGREE=INFLIGHT 01/03/1997 13/06/2017
APDESTAB DESCRIP =Aligned long-slit bar positions for single-bar cases.--------------
APDESTAB DESCRIP =Microscope Meas./Hartig Post-launch Offsets
INANGTAB oref$h5s11397o_iac.fits
INANGTAB DESCRIP =Model/C. Bowers May 6, 1997
DISPCORR COMPLETE
HELCORR PERFORM
HELCORR COMPLETE
PHOTTAB oref$74e15479o_pht.fits
PHOTTAB PEDIGREE=INFLIGHT 27/02/1997 16/03/2021
PHOTTAB DESCRIP =Updated sensitivity curves for G750L
APERTAB oref$y2r1559to_apt.fits
APERTAB PEDIGREE=MODEL
APERTAB DESCRIP =Added/updated values for 31X0.05NDA,31X0.05NDB,31X0.05NDC apertures
APERTAB DESCRIP =Bohlin/Hartig TIM Models Nov. 1998
PCTAB oref$q541740no_pct.fits
PCTAB PEDIGREE=INFLIGHT 18/05/1997 19/12/1998
PCTAB DESCRIP =Sensitivity for diff. extractions heights
TDSTAB oref$8712049eo_tds.fits
TDSTAB PEDIGREE=INFLIGHT 01/04/1997 06/03/2024
TDSTAB DESCRIP =Updated time sensitivities for MIRVIS, G230LB, and G230MB
FLUXCORR PERFORM
CTECORR PERFORM
CCDTAB oref$16j1600do_ccd.fits
CCDTAB PEDIGREE=INFLIGHT 01/05/2009 01/05/2009
CCDTAB DESCRIP =Updated amp=D gain=4 atodgain and corresponding readnoise values---
CCDTAB DESCRIP =Proposal 8057, by I. Dashevsky & P. Goudfrooij
CTECORR COMPLETE
FLUXCORR COMPLETE
SGEOCORR OMIT
Row 1 written to disk.
Order 1 End 14:56:29 UTC
trace was rotated by = 0.0504519 degree.
Imset 1 End 14:56:29 UTC
Warning Keyword `XTRACALG' is being added to header.
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-6 complete ***
End 30-Aug-2024 14:56:29 UTC
*** CALSTIS-0 complete ***
2.5 Comparing Non-Adjusted and Adjusted STIS Coadds#
Now that we’ve applied the shifts to our data, we will re-run the coadd code. To get a proper comparison, we will need to copy over the files taken at the nominal position to the stis_shifted directory since the coadd code needs all X1D/SX1 files in the same directory.
for file in sx1s:
if file.name == "od1am10b0_sx1.fits":
continue
if fits.getval(file, "PROPAPER") == "52X2":
new_path = stis_shifted / os.path.basename(file)
shutil.copy(file, new_path)
And now we run the coadd script:
!swrapper -i ./stis_ex/stis_shifted -o ./stis_ex/stis_shifted/coadd
HASP version 1.0
Ullyses version 4.1.0
Creating list of unique modes from these files:
./stis_ex/stis_shifted/od1al1030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l1')
./stis_ex/stis_shifted/od1al2030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l2')
./stis_ex/stis_shifted/od1al2040_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'l2')
./stis_ex/stis_shifted/od1al4030_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'l4')
./stis_ex/stis_shifted/od1al4040_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'l4')
./stis_ex/stis_shifted/od1am10b0_sx1.fits AGK+81D266 STIS CCD G430L 52X2 14423 (14423, 'm1')
./stis_ex/stis_shifted/od1am10e0_sx1.fits AGK+81D266 STIS CCD G430L 52X2E1 14423 (14423, 'm1')
Looping over visits
Processing product (14423, 'l1')
Targets in visit (14423, 'l1'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l1')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_shifted/od1al1030_sx1.fits']
Processing file ./stis_ex/stis_shifted/od1al1030_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
WARNING: VerifyWarning: Card is too long, comment will be truncated. [astropy.io.fits.card]
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al1_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'l2')
Targets in visit (14423, 'l2'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l2')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_shifted/od1al2030_sx1.fits', './stis_ex/stis_shifted/od1al2040_sx1.fits']
Processing file ./stis_ex/stis_shifted/od1al2030_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al2040_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al2_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'l4')
Targets in visit (14423, 'l4'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'l4')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_shifted/od1al4030_sx1.fits', './stis_ex/stis_shifted/od1al4040_sx1.fits']
Processing file ./stis_ex/stis_shifted/od1al4030_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al4040_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1al4_cspec.fits
No need to create abutted product as < 2 single grating products
Processing product (14423, 'm1')
Targets in visit (14423, 'm1'): ['AGK+81D266']
Processing target AGK+81D266 in visit (14423, 'm1')
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_shifted/od1am10b0_sx1.fits', './stis_ex/stis_shifted/od1am10e0_sx1.fits']
Processing file ./stis_ex/stis_shifted/od1am10b0_sx1.fits
Processing file ./stis_ex/stis_shifted/od1am10e0_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1am1_cspec.fits
No need to create abutted product as < 2 single grating products
Looping over proposals
Processing product 14423
Targets in proposal 14423: ['AGK+81D266']
Processing target AGK+81D266 in proposal 14423
Processing grating STIS/G430L
Importing files ['./stis_ex/stis_shifted/od1al1030_sx1.fits', './stis_ex/stis_shifted/od1al2030_sx1.fits', './stis_ex/stis_shifted/od1al2040_sx1.fits', './stis_ex/stis_shifted/od1al4030_sx1.fits', './stis_ex/stis_shifted/od1al4040_sx1.fits', './stis_ex/stis_shifted/od1am10b0_sx1.fits', './stis_ex/stis_shifted/od1am10e0_sx1.fits']
Processing file ./stis_ex/stis_shifted/od1al1030_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al2030_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al2040_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al4030_sx1.fits
Processing file ./stis_ex/stis_shifted/od1al4040_sx1.fits
Processing file ./stis_ex/stis_shifted/od1am10b0_sx1.fits
Processing file ./stis_ex/stis_shifted/od1am10e0_sx1.fits
Using a maximum SNR of 20.0 in flux-based filtering
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits
Making a product from these gratings
STIS/G430L 2895.9-5704.4 (Actual: 2968.5-5701.7)
Transition wavelengths tweaked
Starting at the short wavelength end with grating STIS/G430L
Truncating current grating at 5701.705595657229
./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits already exists and overwrite=False, skipping write
Wrote ./stis_ex/stis_shifted/coadd/hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits
And we can now compare our pre-shifted and shifted data and their coadds.
coadd = "hst_14423_stis_agkp81d266_g430l_od1a_cspec.fits"
fig, ax = plt.subplots(2, 2, figsize=(14, 10))
types = [stis_unshifted, stis_shifted]
for i, is_shifted in enumerate(types):
for file in is_shifted.glob("*sx1*"):
with fits.open(file) as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
aperture = hdul[0].header['PROPAPER']
# Differentiating between nominal and E1 position via linestyle
if aperture == "52X2":
linestyle = "solid"
label = f"{hdul[0].header['ROOTNAME']} - nom."
else:
linestyle = "dotted"
label = f"{hdul[0].header['ROOTNAME']} - E1"
ax[0][i].plot(
wl,
flux,
lw=2,
alpha=0.6,
label=label,
linestyle=linestyle
)
ax[1][i].plot(
wl,
flux,
lw=2,
alpha=0.6,
label=label,
linestyle=linestyle
)
# Plotting the coadd
with fits.open(f"{is_shifted}/coadd/{coadd}") as hdul:
wl = hdul[1].data["WAVELENGTH"].ravel()
flux = hdul[1].data["FLUX"].ravel()
ax[0][i].plot(
wl,
flux,
label="Coadd",
color="black",
alpha=0.7
)
ax[1][i].plot(
wl,
flux,
label="Coadd",
color="black",
alpha=0.7
)
# All plots will have same labels
for subplot in ax[i].ravel():
subplot.set_ylabel(r'Flux [$erg\ s^{-1}\ cm^{-2}\ \AA^{-1}$]')
subplot.set_xlabel(r'Wavelength [$\AA$]')
shifted = ['Unshifted', 'Shifted'][i]
ax[0][i].set_title(f"Flux vs Wavelength, {shifted}",
fontweight="bold")
ax[1][i].set_title(f"Flux vs Wavelength 4840-4900Å, {shifted}",
fontweight="bold")
ax[1][i].set_xlim(4840, 4900)
ax[1][i].set_ylim(0.4e-13, 1.5e-13)
ax[0][i].legend()
plt.tight_layout()
plt.show()
We can see the offsets between the datasets taken at the nominal position and the E1 position are reduced after we’ve applied our shifts and run CalSTIS. While we did a very rough estimate of the shift, users will want to verify that they have the correct wavelength solution through their own methods (e.g. checking expected wavelengths to observed wavelengths, comparing radial velocities, etc.).
Congrats on completing the notebook!#
There are more tutorial notebooks for custom coaddition cases in this repo, check them out!#
About this Notebook#
Author: Sierra Gomez (sigomez@stsci.edu)
Updated on: August 29, 2024
This tutorial was generated to be in compliance with the STScI style guides and would like to cite the Jupyter guide in particular.
Citations#
If you use astropy, astroquery, or matplotlib, numpy for published research, please cite the authors. Follow these links for more information about citations: