v2.6.0

v2.6.0 introduces the new simulation tracking postgres database, for prenight and progress simulations run using tools in the sim_archive module of rubin_sim. Previously this metadata was held in an h5 file, but moving to a postgres database will allow better scaling through the future. The prenight simulations themselves continue to be stored in an S3 bucket available at USDF.
The prenight simulations themselves moved from the SV configuration to the new LSST survey configuration.

There were also some updates to metrics to move from "filter" to "band", aligning with DM database use of 'band'.

What's Changed

• tickets/SP-2167: Replace prototype metadata tracking of opsim simulations for schedview with one based on a postgresql database by @ehneilsen in #485
• U/yoachim/band again by @yoachim in #489
• tickets/SP-2709: Move from prenight sims and reports for SV to LSST by @ehneilsen in #491
• Add sim_baseline to test data by @rhiannonlynne in #493

Full Changelog: v2.5.1...v2.6.0

v2.5.1

v2.5.1 is a patch for packaging updates.
scikit-learn is now a required dependency.

Full Changelog: v2.5.0...v2.5.1

v2.5.0

v2.5.0 provides an update to support fetch_obsloctap_visits while we finalize the move from the old simulation tracking system to our new Postgres-based system.

It also includes the merge of DESC uniformity metrics into MAF. Thank you to our DESC contributors!

What's Changed

• U/yoachim/desc uniformity rb by @yoachim in #488
• tickets/SP-2719: Minimal change to support using fetch_obsloctap_visits from the vsarch archive before the SP-2167 (vsarchive) branch is merged. by @ehneilsen in #490
• SP-2722: cleanup desc summary metrics by @rhiannonlynne in #492

Full Changelog: v2.4.0...v2.5.0

v2.4.0

v2.4.0

This update introduces a very small new feature, which allows spatial slicers to set the camera radius in the LsstCameraFootprint object. This allows slicers to use the full FOV, or the 317mm 'good aperture' region, or the 350mm 'mostly good' region (the default).

What's Changed

• SP-2631: Add kwargs for spatial slicers to set camera_radius by @rhiannonlynne in #484

Full Changelog: v2.3.0...v2.4.0

v2.3.0

v2.3.0

Important data updates with v2.3.0: the default baseline simulation is now v5.0.0. The kurucz sun sed included with the asteroid seds in $RUBIN_SIM_DATA_DIR/movingObjects is now normalized appropriately for the magnitude of the sun.
Please run rs_download_data --update after updating to this version of rubin_sim (or at any time, but especially here).

Updates primarily affect prenight simulation generation, simplifying the creation of these simulations by using lsst-sims.sims_sv_survey instead of holding all of the work inside rubin_sim. Additional work went into updating the memory and time limits required for the cronjob which runs the prenight simulation; additional documentation of these scripts is now available.

As well as updating the prenight simulation generation, some metrics can now be fetched from the metadata (such as the number of visits in the latest prenight simulation).

The DDF batch radius was updated to 2.1 degrees. DDF and some other batches are now updated to use 'band' instead of filter (for newer simulations). MAF metrics run using "band" instead of "filter" to define the visits in use should now be correctly labelled for show_maf.

What's Changed

• tickets/SP-2209: Make automatic nominal prenight sim run for 3 nights by @ehneilsen in #464
• tickets/SP-2208: Update prenight so that it executes recent config files properly by @ehneilsen in #463
• tickets/SP-2211: Add rubin_sim.sim_archive.fetch_num_visits_in_latest_prenight_sim_for… by @ehneilsen in #465
• tickets/SP-2239: SP-2239 fix default date in rubin_sim.sim_archive.fetch_sim_stats_for_night by @ehneilsen in #466
• Update DDF batch radius to 2.1 degrees by @yoachim in #467
• tickets/SP-2322: bump memory requestef for prenight sims to 6G by @ehneilsen in #468
• SP-1908: Update incremental template metric by @yoachim in #440
• tickets/SP-2366: If running the prenight sim on simonyi always use the SV survey by @ehneilsen in #470
• SP-2370: use band for DDF batch instead of filter by @rhiannonlynne in #469
• tickets/SP-2389: Make output of slurm batch jobs distinct by @ehneilsen in #471
• SP-2453: Use band OR filter in SRD batch and metrics by @rhiannonlynne in #473
• filter to band update by @yoachim in #474
• tickets/SP-2485: fix force of sv by @ehneilsen in #476
• update fbs_tracking_db creation by @rhiannonlynne in #475
• tickets/SP-2447: pre-load completed visits, and implement with sims_sv_survey by @ehneilsen in #477
• tickets/SP-2369: Add instructions for running pre-night simulations "by hand" by @ehneilsen in #478
• add Johnson R and I filters by @yoachim in #479
• update baseline sim by @yoachim in #480
• SP-2453: Update rs_download_data to point to new movingObjects (2025-07-15) data by @rhiannonlynne in #472
• tickets/SP-2576: Fixes to get pre-night slurm jobs to run again by @ehneilsen in #481
• SP-2495: fix info label when 'band' used instead of 'filter' by @rhiannonlynne in #483

Full Changelog: v2.2.4...v2.3.0

v2.2.4

Minor update v2.2.4

This updates some of the fetch_obsloc_tap_visits function so that the actual returned values match the docstring. Logging surrounding the use of this function has also been extended, to help with debugging.

New stacker to identify the healpix matching the boresight of a visit and adding timestamp format time values were added to maf.

New prenight simulations for lsstcam were added.

Additional small bugfixes included a stellar magnitude recarray creation fix, likely related to moving to numpy 2.

What's Changed

• tickets/SP-2115: fix return type of fetch_obsloc_tap_visits to match docstring by @ehneilsen in #458
• stellar mag fix by @yoachim in #461
• tickets/SP-2005: Add healpix and timestamp stackers in support of comparing completed to simulated visits by @ehneilsen in #460
• tickets/SP-2149: Improved logging and regularization of archive bucket in prenight sim archive code by @ehneilsen in #459
• tickets/SP-2165: Set up automatic pre-night opsim simulations for lsstcam by @ehneilsen in #462

Full Changelog: v2.2.3...v2.2.4

v2.2.3

v2.2.3 is a minor update for rubin-sim.
The major changes involve updates in the requirements specified in requirements.txt and pyproject.toml.
Some additional packages (george and scikit-learn) have been moved to "optional-requirements.txt" as they are only used for a single metric. The current packages in optional-requirements.txt include:

openorb
openorb-data-de405
george
scikit-learn
jinja2
tornado

which are used for moving object metrics, the 3x2pt FoM metric, and the show_maf webpages.
Running conda install --file optional-requirements.txt after installing rubin-sim will provide these packages if needed for a conda installation; they are also listed under 'optional' requirements in the pyproject.toml and are available via pip by running pip install "rubin-sim[extras]".

Other changes include updates to the sim_archive code used to generate simulations, including generating simulations for the next three nights (to provide 48 hour look-ahead) instead of just two nights.

An internal update to how gather_summaries runs and identifies the simulation source means that this will now work on results databases hosting summary stats from more than one simulation.

What's Changed

• SP-2099: gather_summaries reads run_name per metric from resultsDb by @rhiannonlynne in #456
• tickets/SP-2093: Change default pre-night nights from 2 to 3 by @ehneilsen in #454
• tickets/SP-2094: Fix and expand version metadata in pre-night briefing archive by @ehneilsen in #455
• SP-2104: update dependency requirements by @rhiannonlynne in #457

Full Changelog: v2.2.2...v2.2.3

v2.2.2

v2.2.2

The sim_archive module is moved from rubin_scheduler as of rubin_scheduler v3.7.0 and into rubin_sim as of v2.2.2.
This module is used to generate pre-night simulations, as well as potentially long-term simulations during operations.

Support for fetching visits from these pre-night simulations for obsloctap 24-hour lookahead is added.

Show_maf now will automatically update its tracking database information, for easier updates of the MAF metric results data.

We begin support for vector metrics to more easily and efficiently evaluate metrics over time.

Between sqlite3 and python 3.12, requirements are stricter about using string-literals in sql queries - these must be single quotes, rather than double quotes. MAF queries that are part of our codebase have been updated; users will also need to look out for errors when doing queries such as "select * from observations where scheduler_note not like 'DD%'" (note the order of the single/double quotes).

Bugfixes in the scripts to run metrics over batches allow the proper setting of "clobber" so that data is overwritten when desired rather than added onto in the resultsDb.

Build updates - import rubin_scheduler.version is no longer supported, but import rubin_scheduler.__version__ continues to work (this coincides with an update to our versions of setuptools and setuptools_scm).
And github actions workflows are updated

Many future deprecation warnings have been addressed
Even more improvements to align with the DM style guide have been implemented

What's Changed

• SP-1922: Bugfixes in scripts - set clobber properly, set order of batches by @rhiannonlynne in #441
• sqlite3 compatibility + note-scheduler_note fixes by @humnaawan in #444
• updates to align more with DM guide by @humnaawan in #443
• U/yoachim/futures by @yoachim in #442
• update SQL queries to proper quotes by @yoachim in #445
• Tickets/sp 1966 by @yoachim in #446
• Update requirements and version info by @rhiannonlynne in #447
• use fresh example database to test batches by @yoachim in #448
• update for vector metrics by @yoachim in #449
• SP-2039: Update workflows - miniforge conda and py3.12 by @rhiannonlynne in #450
• tickets/SP-2004: move opsim simulation archive submodule out of rubin_scheduler into rubin_sim by @ehneilsen in #451
• show_maf refresh when tracking database file changes by @yoachim in #453
• tickets/SP-2082: Support getting obsloctac visits from the pre-night sim archive by @ehneilsen in #452

Full Changelog: v2.2.1...v2.2.2

v2.2.1

Patch v2.2.0 release to ensure backward compatibility with numpy 1.26
Also adds compatibility with skyproj 2.0.0.

What's Changed

• SP-1906: backwards compatibility with numpy 1. by @rhiannonlynne in #439

Full Changelog: v2.2.0...v2.2.1

v2.2.0

Updates with v2.2.0 --

IMPORTANT:
OpenOrb has been removed as a required dependency. This means, if you desire to use openorb to calculate ephemeris values (the utilities are still present in rubin_sim.moving_objects) you will need to install openorb separately.
This needed to happen to allow the overall Rubin environment (rubin_env) progress to Python 3.12, as the conda-forge distribution of openorb is not available for 3.12 at the moment. Work is in progress to update this, but it has been challenging. OpenOrb should still install for python 3.11 and numpy < 2, or from pip.
Hopefully, a future update will either restore openorb as a dependency or will move to an alternate python-compatible ephemeris generator.

Utilities added to support use of MAF or predicted values, now that visits are starting to arrive in the ConsDB:

• Added DayObs and other time related stackers to support schedview relating to information about visits in the consdb -- i.e. dayObs is available as a stacker,
• Added an "Age" metric was added to show the time since the last visit at a given point to support schedview plots
• Function to calculate predicted zeropoints for any given observation are now available as functions in rubin_sim.phot_utils

Metric updates

• An error in handling the stellar luminosity function when calculating crowding effects was fixed - this means stellar counts which include crowding will change if calculated with MAF 2.2.0 compared to earlier calculations.
• The run_selfcal script is updated to send an appropriate subset of visits to the selfcal metric.
• magtype is used to set cometary magnitudes for cometary populations properly.
• Some plots that took significant time to generate are removed or simplified in the default metric outputs.
• Some issues relating to calculating SNR in the SN metrics are updated, to allow for (more) variable exposure times.
• Additional stackers to handle scheduler_note labels more easily for calculating statistics or identifying types of visits

Other work

• The survey_start_mjd function was deprecated in rubin_scheduler and has been updated appropriately here to SURVEY_START_MJD.
• scheduler_note is used by default instead of note.
• Support for building a docker container for use at usdf-maf.slac.stanford.edu has been added.

What's Changed

• swap in usual m52snr by @yoachim in #419
• tickets/PREOPS-5360: clean up the nightsum and prenight Times Square notebooks by updating schedview to support them better by @ehneilsen in #418
• U/yoachim/fo plot fix by @yoachim in #417
• Tickets/opsim 1140 by @yoachim in #416
• Add dockerfile and workflow by @rhiannonlynne in #420
• Docker Build by @rhiannonlynne in #421
• Move dockerfile to port 8080 by @rhiannonlynne in #422
• DM-45888: Remove mambaforge for miniforge by @roceb in #424
• update sim_baseline to v4.0 by @yoachim in #426
• remove survey_start function by @yoachim in #423
• SP-1601: clean up rubin-sim developer guide issues by @rhiannonlynne in #425
• Have sed.resample_sed actually resample rather than interpolate. by @yoachim in #427
• tickets/SP-1685: handle unknown filters gracefully by @ehneilsen in #428
• update selfcal by @yoachim in #430
• remove slow plots from batch by @yoachim in #431
• SP-1663: moving object magtype being used appropriately by @rhiannonlynne in #432
• add option to clip trailing index value to StringCountMetric by @yoachim in #433
• SP-1763: Add predicted zeropoint utilities by @rhiannonlynne in #435
• update sky generation by @yoachim in #434
• SP-1791: update some stats to make analyzing scheduler_note values easier by @yoachim in #436
• SP-1776 : interpret LF as cumulative and use appropriately by @rhiannonlynne in #437
• tickets/SP-1600: updates to pass ruff checks by @humnaawan in #429
• SP-1305: Remove openorb dependency by @rhiannonlynne in #438

New Contributors

• @roceb made their first contribution in #424
• @humnaawan made their first contribution in #429

Full Changelog: v2.1.0...v2.2.0