Mimir - Software and Downloads

20080613 - This page has been moved to this location and the new GUI-based software page is now in its place. This page is provided as an archive/legacy support resource, only. This means these routines are no longer supported and should be replaced with the MSP_BDP and MSP_WCT packages. DPC.

----------------------------------------------------

NEWS: The first of the second generation Mimir data processing tools has been released. This tool performs wavelength calibration of spectral images, using either Argon calibration lamp lines or OH night sky lines. The tool is fully GUI-based, using IDL widgets wrapped around many of our working routines. This new tool embodies the data processing approach that will be embodied in all second generation Mimir software tools.

Fetch the new S/W tool: Mimir Software Package: Wavelength Calibration Tool (WCT), v1.0 (as a zip file)

To run the WCT:

    1. unpack the zip file
    2. open the IDL Development Editor (IDLDE) - be sure the "project window" is open
    3. click "Open Project" and open the file "MSP_WCT.prj"
    4. click the "project compile button" over the project window
    5. click the "project build button" over the project window
    6. click the right facing arrow head to launch the WCT
    7. enjoy!
    8. as time permits, a WCT "how-to" document will be developed and posted.

----------------------------------------------------------------------------------------------------------------------------------

Individual Mimir data processing programs and functions may be downloaded by clicking on the links below.

Routines are subject to change at any time and functionality is not guaranteed.

All routines are ready for beta testing (that means by you!) and bugs may be sent to clemens@bu.edu.

The processing steps are outlined in the table below and are linked to their routines.

More extensive descriptions of the steps are given on the Data Reduction Notes page.

Polarimetric Analyses steps are described on the Polarimetric Analyses - Software and Procedures page.

Spectroscopic Analyses steps are describe on the Spectroscopy Data Reduction page.

Log of fixes and updates at the Software Changes link.

Rough Benchmarks on the Software Benchmarks link.

I am writing the routines in IDL (v6.0) on a Windows XP machine, which means they work on that platform. Some routines have also been modified to work on Unix/Linux platforms (signified by a "Yes" in the "Unix?" column) and/or to support using the /NOGUI switch - see data reduction notes page) and/or processing using the batch.pro program (see "batch?" column). Entries of "N/A" signify a program intended to be run interactively. Programs with a "No" in a column have not yet been modified but will be in the "near future." -- DPC

Processing Stage names and Revision Dates in green are up to date; others will follow. Open BUGLIST at bottom.

Processing Stage

[Click Name for Description]

Routine Name
Description
Unix? NOGUI? batch?
Revision Date
Routine to run many instances of other Mimir and/or intrinsic IDL routines. Uses a text file with procedure names and command line arguments. See example input file. Can call itself.
Yes
Yes
Yes
20060801
Builds an observing log file from the FITS headers of the selected CDS images - requires FITS support routines
Yes
Yes
Yes
20051002

Evaluates many images to find bad ones, makes list of good images and list of bad images (with basis of rejection given). Also requires FITS support routines

Yes
Yes
Yes
20050908
Fast display of images (from a list) within IDL, for quick visual inspection. Requires FITS support routines
Yes
Yes
N/A
20060122
Deletes bad images in list generated by triage.pro
Yes
Yes
Yes
200501026
Program that evaluates images for the presence of shifted columns and makes recommendations for which quadrants need to be shifted
Yes
Yes
Yes
20060303

kokepeli_data_extract.pro
kokepeli_gaussian_fit.pro
kokepeli_maximum_detector.pro
kokepeli_offset_fitter.pro
kokepeli_sharpen.pro
make_kokepeli_kernel.pro
median_remove_image.pro
offset_fit.pro

truncate.pro

Routines called by kokepeli_analysis program. Also requires FITS support routines
Uses recommendations from kokepeli_analysis (and as edited by user) to perform column shifts of quadrants of both CDS and RAW1 images
Yes
Yes
Yes
20060222

CDS_to_RAW1_pathname.pro
CDS_dir_to_RAW1_dir.pro
parse_input_output_filenames.pro
quad_shift.pro
read_raw1.pro
write_raw1.pro

Routines called by make_sky_true (and later steps). Also requires FITS support routines.
Examines an entire night's set of RAW1 images to build a summary file of mean count values      
20060624
Interactively examines RAW1 summary file to isolate and find RAW1 images with means different than neighboring images (i.e., "jumps")      
20060625
Uses file of RAW1 jumps to correct indicated RAW1 images.      
20060624
Computes means and uncertainties for centers of each quadrant of a set of RAW1 images, also separating by odd and even rows. Useful for finding first read (e.g., reset) instability
Yes
Yes
Yes
20050925
Same, but analyzes CDS images
Yes
Yes
Yes
20051008
Displays CDS, RAW1 means for a linearity run, allows user to identify onset of CDS saturation, plots and computes CDS gain change constants with RAW1 jumps
Yes
N/A
N/A
20060122
Analyzes a "set" of RAW1 images to identify frames which have RAW1 jumps. A "set" is a group of images taken together (e.g., 32 biases, or 128 pol images)
Yes
N/A
N/A
20050918
Uses detection file and dCDS/RAW1 calibration constants to correct RAW1 and associated CDS images for jumps and gain changes.
Yes
Yes
Yes
20050918
(Optional) Plots a night's worth of RAW1 mean values vs image frame number
Yes
Yes
Yes
20050927
Uses a bunch of bias frames to build a bad pixel mask
Yes
Yes
Yes
20060725
Routines called by make_bad_pixel_mask.pro. Also requires FITS support routines
Builds the list of biases and linearity images and sorts by exposure time to prepare for coadding
Yes
Yes
N/A
20050715
Coadds the bias and linearity images, using the sorted list provided by make_linearity_list, producing median-filtered RAW1 and CDS images
Yes
Yes
Yes
20050921
Uses the coadded images to compute the linearity tables (images) making up the linearity correction data base (9 images).
Yes
No
No
20051124

Takes a set of bias (dark frames with "zero" exposure time) and computes a median-filtered mean RAW1 image to use as the best guess for the image of the reset pedestal.
- Support routine for above

Yes
Yes
Yes
20060129
(Optional) Converter to allow viewing RAW1-type images with DS9

Performs Linearity Correction on Bias and Linearity Images.
- Support routine for above

Yes
Yes
Yes
20051118
Make a list of files in a directory (similar to Unix "ls" command)
Yes
N/A
N/A
20050131
Forms differences of images taken with "lights on" and "lights off" to save only photocurrent images
Yes
Yes
Yes
20050924

Performs image analysis to extract key values from image quadrants.
- Support routine for above

Yes
Yes
Yes
20050924
Evaluates runs of mean with variance to fit and compute RN and CG
Yes
N/A
N/A
20050831

Performs Linearity Correction on Bias and Linearity Images.
- Support routine for above

Yes
Yes
Yes
20060627

(Optional) Evaluator to check for conversion problems

(Optional) Plots results of counter

Yes
Yes
Yes
20051002

Averages CDS images using median filter and respecting the bad pixel mask and COADDs.

- Support routine for above

Yes
Yes
Yes
20060129

coadd_for_flats.pro

Median filtered averager for flats. Run for Lights-on and Lights-off image sets separately.
Yes
Yes
Yes
20060129
Differences averaged Lights-on and Lights-off images, respecting bad pixel mask
Yes
Yes
Yes
20051008
Computes histogram of pixel values in an image, fits gaussian and computes median, printing all compute statistics
Yes
No
N/A
20051008
Normalizes an image by a constant. Used to produce normalized flat-field images.
Yes
Yes
Yes
20051008

prepare_polar_flats_for_coadd.pro

Takes a list of polarimetry flat field files (lights on and lights off) and creates an input file for batch processing of coaddition

Yes
Yes
Yes
20061002
Does polarimetry flats coadds, based on results of "prepare" step above. [does relative scaling for central 401x401 pixels instead of full image, as for photometry]
Yes
Yes
Yes
20061002
Determines the median values of the On-Off differenced images to drive normalization step
Yes
No
No
20060726
Creates an interpolated polarimetry flat from existing pol flats - used to solve PA error on one PA in script for pol flats
Yes
No
No
20060727

science_dark_and_flat_correct.pro

Performs dark and flat field corrections for any number of science images

Yes
Yes
Yes
20060801
Organizes same exposure time polarimetry science frames into input list files for batch processing
Yes
Yes
Yes
20060731
Photometric Analyses
Splits an overly long list of files into N smaller ones to facility processing by tp_image_combine  
20060802
Combines images from a list (see polarimetry section below)    
LM Tools

 

Merges short and long LM flats into one, scaled LM flat  
20060223
Forms image ratio, using bad pixel mask (useful for measuring filter transformations and scaling Argon spectra)
20060726
Does bad pixel repair, then averages group of images (no offsets, and does not do median filtering)  
20060223
Folds differenced spectral image to produce higher S/N spectral image. [others are support]  
20060225
JHK Tools
Tool for convolving OH night sky spectrum to Mimir spectral resolution
20060305
Uses OH lines to determine wavelength calibration.  
20061012
Extracts a single star spectrum from wavelength calibrated image. Creates SpeX type FITS file  
20061012
Similar, but for extended objects  
20061012
Adds/averages spectra in SpeX-type FITS formats  
20061012
Support routines for JHK spectroscopy programs  
20061012

Polarimetric Standard Star Analyses

defocus_star_phot.pro

Performs aperture photometry on a group of defocussed polarimetric standard star images

Yes
No
Yes
20051230

defocus_center_locate.pro
defocus_find_sky.pro
defocus_image_display.pro
defocus_select_star.pro
defocus_star_radius.pro
dpc_correlate.pro
fix_bad_pixels.pro
get_HWP_angle.pro
reset_high_low_pixels.pro

Support Routines for above
Yes
N/A
N/A
20060101
Analyzes photometric output from above routines for polarimetry
Yes
N/A
N/A
20060101

Does matrix least squares fit of standard star observations against true values to obtain instrumental polarization, pol efficiency, and instrument offset angle

Generic us-vs-them plotter

Yes
No
No
20060109
Target Star/Fields Polarimetric Analyses

prepare_polar_science_for_coadds.pro

Analyzes large set of polarimetry images to produce list files, grouped by object and HWP angle
Yes
N/A
N/A
20051102

tp_image_combine.pro

tp_sky_combine_sub.pro
tp_find_sky.pro
tp_find_offsets_sub.pro
tp_prep_image.pro
tp_find_stars_w_DAOPHOT_sub.pro
tp_diff_star_lists_sub.pro
reset_high_low_pixels.pro

Routine to combine dithered images, with sky illumination correction, into one final image for each HWP angle

 

Support routines for above

Yes
N/A
N/A
20060802

 

 

           
           
           
           
General Routines
Function that uses Thin Plate Spline routine to replace bad pixels with 2-D fit to local pixels
Yes
N/A
N/A
20051223
Displays image, allows user to select star, performs gaussian fitting, integrating counts and returning statistics
Yes
N/A
N/A
20060122
Support Routines
Core routines for averaging pixels across images with outlier rejection
Yes
N/A
N/A
20051023
Performs Image math while respecting bad pixels
Yes
N/A
N/A
20051210
Makes a list file, similar to Unix "ls" command
Yes
N/A
N/A
20050131
Merges contents of multiple list files into one list file
Yes
N/A
N/A
20051102
Writes a file to drive batch-type processing, based on the contents of a list file and user selection of routine and output file
Yes
N/A
N/A
20051102
Debugging Tools
Routine to turn a CDS-type image name into a RAW1-type image name        
Quick display program to show a number of images      
20051007
Views/Edits FITS header variable for any number of images
Yes
No
No
20060725
Counts number of pixels in a FITS image set to the value -1.0e6
Yes
No
No
20050925
Displays image, allows selection of star, fits profile, returns fit values
Yes
No
No
20051012
Computes difference image of two input images    
20050624
Converts RAW1 type image to a CDS type image    
20060129
Program to remove ski jumps from arbitrary images    
20050613
Computes histogram for an image    

20050718

Plots run of mean RAW1 values vs image frame number
Yes
Yes
Yes
20050927
astrolib routines

mrd_hread.pro
mrd_skip.pro
readfits.pro
strn.pro
sxaddpar.pro
sxdelpar.pro
sxpar.pro
valid_num.pro
writefits.pro

Needed for FITS read/write support and other routines
BUGLIST
  1. Need to modify RAW1_examination, jump_finder, jump_corrector to work with subframed image (2006/06/25)
List of items yet to be fixed