1 of 5

Release Updates

Tim Theisen

OSG-PATh Staff Meeting - 2022-12-14

2 of 5

Summary (since 2022-08-10, 4 months)

  • OSG 3.6 - 11 releases total
    • 7 Software Releases
    • 4 Data Only Releases
      • 4 VO Package Release
      • 1 contained an IGTF Release (met 1 day turnaround goal)
  • Devops - Open Science Pool (able to fix critical bugs quickly)
    • 1 HTCondor Beta releases (9.12.0)
    • 5 HTCondor Update releases (9.11.1 RC1, 9.11.1 final, 10.1.1, 10.1.2, 10.1.3)
      • Special 10.1.2 version with on bug fix removed (OSPool depended in buggy behavior)
    • 9.11.0 RC3 on execution points (Singularity Path Problem)
  • HTCondor-CE 5.1.6
  • HTCondor
    • 4 LTS releases (9.0.16, 9.0.17, 10.0.0)
    • 3 Feature releases (9.11.0, 9.12.0, 10.1.0)
    • 4 Update releases (9.11.1, 9.11.2, 10.1.1)

3 of 5

Notable Events

  • October 17 - Condor shadows crashing on login04
    • Team member submitted test to jobs to confirm bug fix, tripped over a different bug
    • Sudo granted to me on login04 and login05
    • Held jobs, fixes for shadow and preen code implemented in next release
  • November 4 - HTCondor tarballs fail at one site
    • Locally compiler version of HTCondor being picked up
    • Modified tarball construction to avoid problem for next release
  • November 10 - HTCondor 10.1.1 incompatible with condor_submit wrapper
    • Bug fix caused a problem with the condor_submit wrapper
    • Release Special HTCondor 10.1.2 without that fix to get OSPool functional
  • December 9 - Schedd crashing
    • Bug in handling of submit transform caused condor_schedd to crash and stay down
    • Submit transform rewritten to avoid bug, fixed in next release.
  • Defects found in testing (not really notable)
    • XRootD 5.5.1, problem with third-party copy (patched in OSG release)
  • Defects discovered in OSG within a month after release: none

4 of 5

Devops Synergy

  • We have reaped benefits from close partnership with login04 and login05 administrators
    • Developers can diagnose and intervene when requested by administrators
    • Developers learn where HTCondor rough edges are and improve HTCondor
    • Finally got rid of the condor_submit wrapper
      • Condor_submit wrapper could break with new releases
      • Wrapper taking advantage of HTCondor improvements
      • Smart users could sidestep the wrapper

5 of 5

Challenges

  • Testing for Major Packages (update)
    • Implemented new policy for major packages
      • If major package is adequately tested by automated testing, release after a month
      • Two major packages released under this new policy
  • Working on additional automation of releases
    • Since we have a more "rolling" release model, eliminated data release procedure
    • Release cadence of HTCondor releases is now monthly (instead of every other month)
    • Update (patch releases) are more frequent
    • More automated checking are built into the release process