desisim change log

0.38.1 (unreleased)

  • No changes yet

0.38.0 (2024-03-05)

  • Fixed bug on quickquasars quasar sampling method to reproduce z distribution from SV causing a wrong shape in cross-correlation (PR #577).

  • Updates for DESI-Y1 LyA mocks with quickquasars (PR #578).

0.37.1 (2023-01-13)

  • Added sort to io.find_basis_template() (PR #576).

0.37.0 (2023-01-12)

  • Smoothing source contribution to noise in quickquasars (PR #566).

  • Quickquasars updates to reproduce actual z and mag distribution as obtained in SV for DESIY5 mocks (PR #569).

  • Make multiprocessing Pool safe in quickquasars (PR #570).

  • Renamed master -> main (PR #571).

  • Updated emission line and continuum models (PR #572).

  • Fix pixsim (PR #573).

0.36.0 (2022-01-20)

  • Major fixes to desisim unit tests, particularly for templates (see PR thread for details about algorithmic changes; PR #559).

  • Restore template-generating code to a working state (PR #556).

  • Flux bug fix in quicktransients simulator (PR #541).

0.35.6 (2021-03-31)

  • lighterweight quickquasars (PR #552).

0.35.5 (2021-02-15)

  • Migrated unit tests to GitHub Actions (PR #546).

  • Fix negative arc line ringing (PR #548).

  • Fix sim header keywords for TSNR calc (PR #550, PR #551).

0.35.4 (2020-11-12)

0.35.3 (2020-08-04)

  • desisim.spec_qa.redshifts.zstats support for astropy 4 (hotfix to master).

0.35.2 (2020-08-04)

  • Support astropy/4.x and fitsio/1.x (PR #539 and PR #542).

  • New keyword in quickcat to indicate which HDU to read in fba files (PR #538)

  • Fix sky level Travis test failure (#534) and “low QSO flux” template unit test failure (#507) (PR #536).

  • Add freeze_iers to more functions in simexp (direct to master).

  • Add the option to run quickquasars in eBOSS mode (PR #481)

0.35.1 (2020-04-15)

  • Add freeze_iers to quickgen (direct fix to master).

0.35.0 (2020-04-13)

  • Use desiutil.iers.freeze_iers instead of desisurvey (requires desiutil >= 2.0.3) (PR #530).

  • Update BAL_META columns (PR #527).

0.34.3 (2020-04-07)

  • Add functionality to simulate transients into galaxy spectra; includes several example notebooks (PR #525).

  • Added a new table with a development emission line table (PR #523).

0.34.2 (2019-12-27)

  • Add desisurvey.utils.freeze_iers() to any code that uses astropy.time (PR #520).

0.34.1 (2019-12-20)

  • New fiberassign file names (PR #519).

  • Minor change to DLA metadata (PR #517).

  • Use desitarget.io.find_target_files to find (mock) target catalogs (PR #514).

  • Update desisim.module to use latest v3.2 basis templates (PR #513).

0.34.0 (2019-10-17)

Requires desispec/0.30.0 or later.

  • Support mocks in bright/dark subdirs (PR #508).

  • Support FIBERASSIGN_X/Y instead of DESIGN_X/Y from fiberassign (PR #512).

0.33.1 (2019-10-01)

  • No code or API changes in this tag.

  • Pinned Numpy version to fix broken tests (PR #505).

  • Minor changes to documentation configuration and docstrings.

0.33.0 (2019-09-30)

  • Running quickquasar on recent London mocks (PR #495, PR #497).

  • Update eBOSS to DR16 (PR #498).

  • Updates to pixsim for SV (PR #502).

  • Fix bug in counting repeat observations (PR #503).

0.32.0 (2019-05-30)

0.31.2 (2019-02-28)

  • Update quickquasars default redshift error (PR #466).

  • Support for London mocks v5.0 + DLAs (PR #467).

0.31.1 (2018-12-14)

  • quickquasars updates:

    • support eBOSS (PR #450).

    • mimic redshift fitter uncertainties (PR #452).

    • adding shift to redshift (PR #454).

    • fix error in size of Z_noFOG (PR #455).

    • Fix quickquasars targetid truth (PR #457).

  • Precompute colors for star and galaxy templates. (PR #453).

  • Refactor S/N qa to load cframes only once (also updates OII for new TRUTH table) (PR #459, PR #465).

  • Use basis_templates v3.1 and matching desisim-testdata 0.6.1 (PR #464).

0.31.0 (2018-11-08)

  • Update to new fibermap format for consistency with targeting and fiber assignment; requires desispec >= 0.26.0 (PR #446).

  • Update desisim.templates.BGS to use latest selection cuts (PR #439).

  • Fix quickquasar to work with Saclay mocks (PR #435).

  • Add support for >v3.0 stellar templates, with notebook to boot (PR #434).

  • Update notebook describing the construction of the LRG templates (PR #433).

  • Fix quicksurvey (PR #431).

  • Update quickcat model (PR #430, PR #427).

  • Fix archetype computation for redrock (PR #429).

  • Change electron to count for FITS compliance (PR #428).

  • Do not include Mg II emission by default (PR #426).

  • Add and adjust the nebular emission line spectra added to galaxy templates (PR #424).

  • quickquasar options for random z, ignoring transmission, random seeds, desisim.templates.SIMQSO vs. QSO (PR #419, PR #408, PR #406, PR #401).

  • Read and write select_mock_targets style simspec file (PR #416).

  • Restore quickquasars to a functioning state, after being broken in PR #409 (PR #413).

  • Add optional nside and overwrite arguments to wrap-newexp and obs.new_exposure, respectively (PR #412).

  • Major (and backwards-incompatible) refactor of how the template/simulated metadata are returned by desisim.templates (PR #409).

  • Adding reading metals from LyA transmission files (PR #407).

0.30.0 (2018-08-09)

  • Update templates to DR7+ standard-star designation (FSTD–>STD) (PR #400).

  • Update standard star bit name again STD -> STD_FAINT; requires desitarget 0.23.0 (PR #402).

0.29.0 (2018-07-26)

  • Option in quickspectra to write the full sim table (PR #392).

  • Option to use Gaussian instead of Poisson for QSO DLA. Requires specsim >= v0.12 (PR #393).

  • Use overwrite instead of clobber for astropy.io.fits (PR #395).

0.28.0 (2018-07-18)

  • Add BALs to templates.QSO class (PR #321).

  • Enable redshift QA using input summary catalogs of truth and redshifts (PR #349).

  • Add zstats-like good/fail/miss/list QA method from desitest mini notebook and refactor previous code to enable it (PR #351).

  • quickquasar mags and random seed (PR #350 and PR #352).

  • New pixsim and pixsim_nights (PR #353, PR #354, and PR #358).

  • Generate confusion matrix related to Spectype (PR #359).

  • Update QA to use qaprod_dir

  • Fix newexp-mock wrapper when first expid != 0 (PR #361).

  • newexp-mock options for production running (PR #363).

  • Add BALs to QSO spectra outside of desisim.templates (PR #370).

  • Add rest-frame option to templates.SIMQSO (PR #377).

  • Optionally change output wave vector in templates.SIMQSO when noresample=True or restframe=True (PR #383).

  • Fix newexp-mock and wrap-fastframe file parsing for NIGHT/EXPID/*.* vs. NIGHT/*.*.

  • Speed up emission line simulation when using MKL >= 2018.0.2 (PR #390).

0.27.0 (2018-03-29)

  • Fix pixsim_mpi; make it faster with scatter/gather (PR #329, PR #332, and PR #344).

  • Fix PSF convolution for newexp-mock (PR #331).

  • BGS redshift bug fix (PR #333).

  • Astropy 2 compatibility (PR #334).

  • Fix newexp-mock –nspec option (PR #340).

  • Fix fibermap EXTNAME (PR #340).

  • Fix PSF convolution for newexp_mock (PR #331).

  • Match desispec renaming and relocating of of pix -> preproc (PR #337 and PR #339).

  • More robust handling of unassigned fiber inputs (PR #341).

0.26.0 (2018-02-27)

Requires desitarget >= 0.19.0

  • Update BGS fiber acceptance vs. z (PR #326)

  • Update desitarget imports for desitarget/0.19.0 (PR #328)

0.25.1 (2018-02-23)

Requires desitarget < 0.19.0

  • Fix set_xscale(…) nonposy -> nonposx for qa_zfind

0.25.0 (2018-02-23)

  • Fix double PSF convolution in pixsims (PR #320).

  • Additional edits to QA scripts and doc to run with mini Notebook (PR #322).

  • Optional specsim config for simulating spectra (PR #325)

0.24.0 (2018-01-30)

  • Support new LRG templates (v2.0). (PR #302).

  • Bug fixes and additional features added to SIMQSO template maker. (PR #303).

  • Fixes quickspectra (broken by desispec change) (PR #306).

  • Fixes quickspectra random seed (never worked?) (PR #306).

  • Improves pixsim_mpi performance (PR #312).

  • Optionally do not wavelength resample simqso templates (PR #310).

  • Default to basis templates v2.4 instead of 2.3

  • Minor edits to QA scripts and doc (PR #311).

  • Adds quickspectra –skyerr option (PR #313).

  • Correct fastframe output BUNIT (PR #317).

0.23.0 (2017-12-20)

  • Fixed crash in newexp-mock success print message.

  • Refactor DLA code into its own module (PR #294).

  • Adds reader for LyA skewer v2.x format (PR #297).

  • Removed deprecated brick output from quickgen.

  • Preliminary support for simqso based QSO templates (PR #293).

  • fastframe can directly output cframes (PR #287).

  • adds BGS efficiency notebooks (PR #285 and PR #286).

0.22.0 (2017-11-10)

  • Scaling updates to wrap-fastframe and wrap-newexp (PR #274).

  • Fix a minor units scaling bug in lya_spectra (PR #264).

  • newexp takes exposures list with EXPID and arcs/flats (PR #275).

  • lyman alpha QSOs with optional DLAs (PR #275).

  • Update arc lamp line list (PR #272).

  • Fix MPI pixsim wrappers (PR #265 and PR #262).

  • quicksurvey updats for latest surveysim outputs (PR #270).

  • Adds fastfiber method of fiber input loss calculations (PR #261).

  • Fix quickgen moon input parameters (PR #263).

  • Adds quickspectra script (PR #259).

0.21.0 (2017-09-29)

  • Major refactor of newexp to add connection to upstream mocks, surveysims, and fiber assignment (PR #250).

  • Support latest (>DR4) data model in the templates metadata table and also scale simulated templates by 1e17 erg/s/cm2/Angstrom (PR #252).

  • Add desi_qa_s2n script (PR #254)

  • Refactor desi_qa_zfind script (PR #254)

  • Refactor redshift QA for new data model (PR #254)

  • Refactor shared QA methods to desisim.spec_qa.utils (PR #254)

  • New plots for S/N of spectra for various objects (ELG, LRG, QSO) (PR #254)

  • Add BGS, MWS to z_find QA

  • Miscellaneous polishing in QA (velocity, clip before RMS, extend [OII] flux, S/N per Ang)

  • Bug fix: correctly select both “bright” and “faint” BGS templates by default (PR #257).

  • Updates for newexp/fastframe wrappers for end-to-end sims (PR #258).

0.20.0 (2017-07-12)

  • Adds tutorial on simulating spectra (PR #244).

  • Fixes QSO template wavelength extrapolation (PR #247); requires desispec > 0.15.1.

  • Uses desitarget.cuts.isLRG_colors; requires desitarget >= 0.14.0 (PR #246).

  • Uses desiutil.log instead of desispec.log.

0.19.0 (2017-06-15)

  • “FLAVOR” keyword is arc/flat/science but not dark/bright/bgs/mws/etc to match desispec usage (PR #243).

  • Add nocolorcuts option for LyA spectra (PR #242).

  • Fixes for targets.dat to targets.yaml change (PR #240).

  • Changed refs to desispec.brick to its new location at desiutil.brick (PR #241).

  • Remove LyA absorption below the LyA limit (PR #236).

  • Refactor and speed-up of QSO templates; add Lya forest on-the-fly (PR #234).

0.18.3 (2017-04-13)

  • Add DLAs to lya spectra (PR #220)

  • Fix quickgen for specsim v0.8 (PR #226).

  • Add verbose output to templates code (PR #230).

  • Much faster quickcat (PR #233).

0.18.2 (2017-03-27)

0.18.1 (2016-03-05)

  • Update desisim.module to use DESI_BASIS_TEMPLATES v2.3.

0.18.0 (2016-03-04)

  • pixsims add new required keywords DOSVER, FEEVER, DETECTOR.

  • Small bug fixes in quickcat; drop unused truth,targets columns to save memory in quicksurvey loop (PRs #198, #199).

  • quickgen update to support white dwarf templates (PR #204)

  • several enhancements of the templates code

    • optionally output rest-frame templates (PR #208)

    • rewrite of lya_spectra to achieve factor of 10 speedup; use COSMO (astropy.cosmology setup) as a new optional keyword for qso_desi_templates; updated API (PRs #210, #212)

    • various small changes to desisim.templates (PR #211)

    • support for DA and DB white dwarf subtypes (PR #213)

  • update test dependencies (PR #214)

0.17.1 (2016-12-05)

  • Fix bug when obsconditions contain tiles that don’t overlap catalog

  • Add surveysim --start_epoch option

0.17.0 (2016-12-02)

  • fixes tests for use with latest desitarget master

  • Refactor quickgen and quickbrick to reduce duplicated code (PR #184)

  • Makes BGS compatible with desitarget master after isBGS -> isBGS_faint vs. isBGS_bright

  • Refactor quickcat to include dependency on observing conditions

  • Update quicksurvey to use observing conditions from surveysim

  • Fixes use of previous zcatalog when updating catalog with new observations

0.16.0 (2016-11-10)

  • Requires specsim >= v0.6

  • Add integration test for quickgen (PR #179)

  • Cache specsim Simulator for faster testing (PR #178)

  • Add lya_spectra.get_spectra (PR #156)

  • Add quickgen and quickbrick unit tests and bug fixes (PR #176, #177)

0.15.0 (2016-10-14)

  • Fix some build_sphinx errors.

  • Run coverage tests under Python 2.7 for now.

  • Update template Module file to new DESI+Anaconda infrastructure.

  • quickbrick unit tests and bug fixes (#166)

  • new quickgen features (PR #173 and #175)

    • fix exptime and airmass for specsim v0.5

    • new –frameonly option

    • moon phase, angle, and zenith options

    • misc cleanup and unit tests

0.14.0 (2016-09-14)

  • updates for python 3.5

0.13.1 (2016-08-18)

  • fix batch.pixsim seeds vs. seed typo

0.13.0 (2016-08-18)

  • desi_qa_zfind: fixed –reduxdir option; improved plots

  • PR#132: major refactor of template generation, including ability to give input redshifts, magnitudes, or random seeds from metadata table.

  • desisim.batch.pixsim functions propagate random seeds for reproducibility

0.12.0 (2016-07-14)

  • desi_qa_zfind options to override raw and processed data directories

  • PRODNAME -> SPECPROD and TYPE -> SPECTYPE to match latest desispec

  • remove unused get_simstds.py

  • fix #142 so that pixsim only optionally runs preprocessing

  • fix #141 to avoid repeated TARGETIDs when simulating both bright and dark tiles together

  • add io.load_simspec_summary() convenience function to load and merge truth information from fibermap and simspec files.

  • adjusts which magnitudes were plotted for each target class

0.11.0 (2016-07-12)

Pixsim updates:

  • simulate fully raw data, then call preprocessing

  • bug fix for simulating tiles in parallel

  • fix pixsim loading of non-default PSFs

0.10.0 and prior

  • No changes.rst yet