desisim change log

0.37.2 (unreleased)

  • No changes yet.

0.37.1 (2023-01-13)

  • Added sort to io.find_basis_template() (PR #576).

0.37.0 (2023-01-12)

  • Smoothing source contribution to noise in quickquasars (PR #566).
  • Quickquasars updates to reproduce actual z and mag distribution as obtained in SV for DESIY5 mocks (PR #569).
  • Make multiprocessing Pool safe in quickquasars (PR #570).
  • Renamed master -> main (PR #571).
  • Updated emission line and continuum models (PR #572).
  • Fix pixsim (PR #573).

0.36.0 (2022-01-20)

  • Major fixes to desisim unit tests, particularly for templates (see PR thread for details about algorithmic changes; PR #559).
  • Restore template-generating code to a working state (PR #556).
  • Flux bug fix in quicktransients simulator (PR #541).

0.35.6 (2021-03-31)

  • lighterweight quickquasars (PR #552).

0.35.5 (2021-02-15)

  • Migrated unit tests to GitHub Actions (PR #546).
  • Fix negative arc line ringing (PR #548).
  • Fix sim header keywords for TSNR calc (PR #550, PR #551).

0.35.4 (2020-11-12)

0.35.3 (2020-08-04)

  • desisim.spec_qa.redshifts.zstats support for astropy 4 (hotfix to master).

0.35.2 (2020-08-04)

  • Support astropy/4.x and fitsio/1.x (PR #539 and PR #542).
  • New keyword in quickcat to indicate which HDU to read in fba files (PR #538)
  • Fix sky level Travis test failure (#534) and “low QSO flux” template unit test failure (#507) (PR #536).
  • Add freeze_iers to more functions in simexp (direct to master).
  • Add the option to run quickquasars in eBOSS mode (PR #481)

0.35.1 (2020-04-15)

  • Add freeze_iers to quickgen (direct fix to master).

0.35.0 (2020-04-13)

  • Use desiutil.iers.freeze_iers instead of desisurvey (requires desiutil >= 2.0.3) (PR #530).
  • Update BAL_META columns (PR #527).

0.34.3 (2020-04-07)

  • Add functionality to simulate transients into galaxy spectra; includes several example notebooks (PR #525).
  • Added a new table with a development emission line table (PR #523).

0.34.2 (2019-12-27)

  • Add desisurvey.utils.freeze_iers() to any code that uses astropy.time (PR #520).

0.34.1 (2019-12-20)

  • New fiberassign file names (PR #519).
  • Minor change to DLA metadata (PR #517).
  • Use desitarget.io.find_target_files to find (mock) target catalogs (PR #514).
  • Update desisim.module to use latest v3.2 basis templates (PR #513).

0.34.0 (2019-10-17)

Requires desispec/0.30.0 or later.

  • Support mocks in bright/dark subdirs (PR #508).
  • Support FIBERASSIGN_X/Y instead of DESIGN_X/Y from fiberassign (PR #512).

0.33.1 (2019-10-01)

  • No code or API changes in this tag.
  • Pinned Numpy version to fix broken tests (PR #505).
  • Minor changes to documentation configuration and docstrings.

0.33.0 (2019-09-30)

  • Running quickquasar on recent London mocks (PR #495, PR #497).
  • Update eBOSS to DR16 (PR #498).
  • Updates to pixsim for SV (PR #502).
  • Fix bug in counting repeat observations (PR #503).

0.32.0 (2019-05-30)

0.31.2 (2019-02-28)

  • Update quickquasars default redshift error (PR #466).
  • Support for London mocks v5.0 + DLAs (PR #467).

0.31.1 (2018-12-14)

  • quickquasars updates:
    • support eBOSS (PR #450).
    • mimic redshift fitter uncertainties (PR #452).
    • adding shift to redshift (PR #454).
    • fix error in size of Z_noFOG (PR #455).
    • Fix quickquasars targetid truth (PR #457).
  • Precompute colors for star and galaxy templates. (PR #453).
  • Refactor S/N qa to load cframes only once (also updates OII for new TRUTH table) (PR #459, PR #465).
  • Use basis_templates v3.1 and matching desisim-testdata 0.6.1 (PR #464).

0.31.0 (2018-11-08)

  • Update to new fibermap format for consistency with targeting and fiber assignment; requires desispec >= 0.26.0 (PR #446).
  • Update desisim.templates.BGS to use latest selection cuts (PR #439).
  • Fix quickquasar to work with Saclay mocks (PR #435).
  • Add support for >v3.0 stellar templates, with notebook to boot (PR #434).
  • Update notebook describing the construction of the LRG templates (PR #433).
  • Fix quicksurvey (PR #431).
  • Update quickcat model (PR #430, PR #427).
  • Fix archetype computation for redrock (PR #429).
  • Change electron to count for FITS compliance (PR #428).
  • Do not include Mg II emission by default (PR #426).
  • Add and adjust the nebular emission line spectra added to galaxy templates (PR #424).
  • quickquasar options for random z, ignoring transmission, random seeds, desisim.templates.SIMQSO vs. QSO (PR #419, PR #408, PR #406, PR #401).
  • Read and write select_mock_targets style simspec file (PR #416).
  • Restore quickquasars to a functioning state, after being broken in PR #409 (PR #413).
  • Add optional nside and overwrite arguments to wrap-newexp and obs.new_exposure, respectively (PR #412).
  • Major (and backwards-incompatible) refactor of how the template/simulated metadata are returned by desisim.templates (PR #409).
  • Adding reading metals from LyA transmission files (PR #407).

0.30.0 (2018-08-09)

  • Update templates to DR7+ standard-star designation (FSTD–>STD) (PR #400).
  • Update standard star bit name again STD -> STD_FAINT; requires desitarget 0.23.0 (PR #402).

0.29.0 (2018-07-26)

  • Option in quickspectra to write the full sim table (PR #392).
  • Option to use Gaussian instead of Poisson for QSO DLA. Requires specsim >= v0.12 (PR #393).
  • Use overwrite instead of clobber for astropy.io.fits (PR #395).

0.28.0 (2018-07-18)

  • Add BALs to templates.QSO class (PR #321).
  • Enable redshift QA using input summary catalogs of truth and redshifts (PR #349).
  • Add zstats-like good/fail/miss/list QA method from desitest mini notebook and refactor previous code to enable it (PR #351).
  • quickquasar mags and random seed (PR #350 and PR #352).
  • New pixsim and pixsim_nights (PR #353, PR #354, and PR #358).
  • Generate confusion matrix related to Spectype (PR #359).
  • Update QA to use qaprod_dir
  • Fix newexp-mock wrapper when first expid != 0 (PR #361).
  • newexp-mock options for production running (PR #363).
  • Add BALs to QSO spectra outside of desisim.templates (PR #370).
  • Add rest-frame option to templates.SIMQSO (PR #377).
  • Optionally change output wave vector in templates.SIMQSO when noresample=True or restframe=True (PR #383).
  • Fix newexp-mock and wrap-fastframe file parsing for NIGHT/EXPID/*.* vs. NIGHT/*.*.
  • Speed up emission line simulation when using MKL >= 2018.0.2 (PR #390).

0.27.0 (2018-03-29)

  • Fix pixsim_mpi; make it faster with scatter/gather (PR #329, PR #332, and PR #344).
  • Fix PSF convolution for newexp-mock (PR #331).
  • BGS redshift bug fix (PR #333).
  • Astropy 2 compatibility (PR #334).
  • Fix newexp-mock –nspec option (PR #340).
  • Fix fibermap EXTNAME (PR #340).
  • Fix PSF convolution for newexp_mock (PR #331).
  • Match desispec renaming and relocating of of pix -> preproc (PR #337 and PR #339).
  • More robust handling of unassigned fiber inputs (PR #341).

0.26.0 (2018-02-27)

Requires desitarget >= 0.19.0

  • Update BGS fiber acceptance vs. z (PR #326)
  • Update desitarget imports for desitarget/0.19.0 (PR #328)

0.25.1 (2018-02-23)

Requires desitarget < 0.19.0

  • Fix set_xscale(…) nonposy -> nonposx for qa_zfind

0.25.0 (2018-02-23)

  • Fix double PSF convolution in pixsims (PR #320).
  • Additional edits to QA scripts and doc to run with mini Notebook (PR #322).
  • Optional specsim config for simulating spectra (PR #325)

0.24.0 (2018-01-30)

  • Support new LRG templates (v2.0). (PR #302).
  • Bug fixes and additional features added to SIMQSO template maker. (PR #303).
  • Fixes quickspectra (broken by desispec change) (PR #306).
  • Fixes quickspectra random seed (never worked?) (PR #306).
  • Improves pixsim_mpi performance (PR #312).
  • Optionally do not wavelength resample simqso templates (PR #310).
  • Default to basis templates v2.4 instead of 2.3
  • Minor edits to QA scripts and doc (PR #311).
  • Adds quickspectra –skyerr option (PR #313).
  • Correct fastframe output BUNIT (PR #317).

0.23.0 (2017-12-20)

  • Fixed crash in newexp-mock success print message.
  • Refactor DLA code into its own module (PR #294).
  • Adds reader for LyA skewer v2.x format (PR #297).
  • Removed deprecated brick output from quickgen.
  • Preliminary support for simqso based QSO templates (PR #293).
  • fastframe can directly output cframes (PR #287).
  • adds BGS efficiency notebooks (PR #285 and PR #286).

0.22.0 (2017-11-10)

  • Scaling updates to wrap-fastframe and wrap-newexp (PR #274).
  • Fix a minor units scaling bug in lya_spectra (PR #264).
  • newexp takes exposures list with EXPID and arcs/flats (PR #275).
  • lyman alpha QSOs with optional DLAs (PR #275).
  • Update arc lamp line list (PR #272).
  • Fix MPI pixsim wrappers (PR #265 and PR #262).
  • quicksurvey updats for latest surveysim outputs (PR #270).
  • Adds fastfiber method of fiber input loss calculations (PR #261).
  • Fix quickgen moon input parameters (PR #263).
  • Adds quickspectra script (PR #259).

0.21.0 (2017-09-29)

  • Major refactor of newexp to add connection to upstream mocks, surveysims, and fiber assignment (PR #250).
  • Support latest (>DR4) data model in the templates metadata table and also scale simulated templates by 1e17 erg/s/cm2/Angstrom (PR #252).
  • Add desi_qa_s2n script (PR #254)
  • Refactor desi_qa_zfind script (PR #254)
  • Refactor redshift QA for new data model (PR #254)
  • Refactor shared QA methods to desisim.spec_qa.utils (PR #254)
  • New plots for S/N of spectra for various objects (ELG, LRG, QSO) (PR #254)
  • Add BGS, MWS to z_find QA
  • Miscellaneous polishing in QA (velocity, clip before RMS, extend [OII] flux, S/N per Ang)
  • Bug fix: correctly select both “bright” and “faint” BGS templates by default (PR #257).
  • Updates for newexp/fastframe wrappers for end-to-end sims (PR #258).

0.20.0 (2017-07-12)

  • Adds tutorial on simulating spectra (PR #244).
  • Fixes QSO template wavelength extrapolation (PR #247); requires desispec > 0.15.1.
  • Uses desitarget.cuts.isLRG_colors; requires desitarget >= 0.14.0 (PR #246).
  • Uses desiutil.log instead of desispec.log.

0.19.0 (2017-06-15)

  • “FLAVOR” keyword is arc/flat/science but not dark/bright/bgs/mws/etc to match desispec usage (PR #243).
  • Add nocolorcuts option for LyA spectra (PR #242).
  • Fixes for targets.dat to targets.yaml change (PR #240).
  • Changed refs to desispec.brick to its new location at desiutil.brick (PR #241).
  • Remove LyA absorption below the LyA limit (PR #236).
  • Refactor and speed-up of QSO templates; add Lya forest on-the-fly (PR #234).

0.18.3 (2017-04-13)

  • Add DLAs to lya spectra (PR #220)
  • Fix quickgen for specsim v0.8 (PR #226).
  • Add verbose output to templates code (PR #230).
  • Much faster quickcat (PR #233).

0.18.2 (2017-03-27)

0.18.1 (2016-03-05)

  • Update desisim.module to use DESI_BASIS_TEMPLATES v2.3.

0.18.0 (2016-03-04)

  • pixsims add new required keywords DOSVER, FEEVER, DETECTOR.
  • Small bug fixes in quickcat; drop unused truth,targets columns to save memory in quicksurvey loop (PRs #198, #199).
  • quickgen update to support white dwarf templates (PR #204)
  • several enhancements of the templates code
    • optionally output rest-frame templates (PR #208)
    • rewrite of lya_spectra to achieve factor of 10 speedup; use COSMO (astropy.cosmology setup) as a new optional keyword for qso_desi_templates; updated API (PRs #210, #212)
    • various small changes to desisim.templates (PR #211)
    • support for DA and DB white dwarf subtypes (PR #213)
  • update test dependencies (PR #214)

0.17.1 (2016-12-05)

  • Fix bug when obsconditions contain tiles that don’t overlap catalog
  • Add surveysim --start_epoch option

0.17.0 (2016-12-02)

  • fixes tests for use with latest desitarget master
  • Refactor quickgen and quickbrick to reduce duplicated code (PR #184)
  • Makes BGS compatible with desitarget master after isBGS -> isBGS_faint vs. isBGS_bright
  • Refactor quickcat to include dependency on observing conditions
  • Update quicksurvey to use observing conditions from surveysim
  • Fixes use of previous zcatalog when updating catalog with new observations

0.16.0 (2016-11-10)

  • Requires specsim >= v0.6
  • Add integration test for quickgen (PR #179)
  • Cache specsim Simulator for faster testing (PR #178)
  • Add lya_spectra.get_spectra (PR #156)
  • Add quickgen and quickbrick unit tests and bug fixes (PR #176, #177)

0.15.0 (2016-10-14)

  • Fix some build_sphinx errors.
  • Run coverage tests under Python 2.7 for now.
  • Update template Module file to new DESI+Anaconda infrastructure.
  • quickbrick unit tests and bug fixes (#166)
  • new quickgen features (PR #173 and #175)
    • fix exptime and airmass for specsim v0.5
    • new –frameonly option
    • moon phase, angle, and zenith options
    • misc cleanup and unit tests

0.14.0 (2016-09-14)

  • updates for python 3.5

0.13.1 (2016-08-18)

  • fix batch.pixsim seeds vs. seed typo

0.13.0 (2016-08-18)

  • desi_qa_zfind: fixed –reduxdir option; improved plots
  • PR#132: major refactor of template generation, including ability to give input redshifts, magnitudes, or random seeds from metadata table.
  • desisim.batch.pixsim functions propagate random seeds for reproducibility

0.12.0 (2016-07-14)

  • desi_qa_zfind options to override raw and processed data directories
  • PRODNAME -> SPECPROD and TYPE -> SPECTYPE to match latest desispec
  • remove unused get_simstds.py
  • fix #142 so that pixsim only optionally runs preprocessing
  • fix #141 to avoid repeated TARGETIDs when simulating both bright and dark tiles together
  • add io.load_simspec_summary() convenience function to load and merge truth information from fibermap and simspec files.
  • adjusts which magnitudes were plotted for each target class

0.11.0 (2016-07-12)

Pixsim updates:

  • simulate fully raw data, then call preprocessing
  • bug fix for simulating tiles in parallel
  • fix pixsim loading of non-default PSFs

0.10.0 and prior

  • No changes.rst yet