Jun 7, 2024 11:00 AM CDT | ICARUS Production Meeting
Summary
Attendees
Requests
Request # | Email Address | Name/tag of the request | Status | Type | Size | Output | WG | File Processing location | Campaign | Path |
9 | cerati@fnal.gov | New compression | Done | Data | - | raw | AI | OSG | Mateus | /data/compression |
13 | petrillo@slac.stanford.edu | ICARUSrun11816full | Running | Data | 110k | stage1, caf | PMT | OSG | Promita | /data/Data_OpticalReconstructionWG_Run3_11816_* |
14 | petrillo@slac.stanford.edu | ICARUSrun11813full | Running | Data | 110k | stage1, caf | PMT | OSG | Promita | /data/Data_OpticalReconstructionWG_Run3_11813_* |
15 | justin.mueller@colostate.edu | LArCV Production for Run 2 | Done | Data | - | LArCV | ML | OSG | Mateus | - |
29 | usher@slac.stanford.edu | Reprocess Run 2 for Neutrino'24 | Running | Data | - | stage1, caf | Analysis | OSG | Promita | /data/Run2_DataReprocess |
30 | jzettle@fnal.gov | jzettle_systematics_cv_nuonly | Done | MC | 200k | stage1, caf, LArCV | Osc. Analysis | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_MC_CV_Sys |
31 | jzettle@fnal.gov | jzettle_systematics_tpcsignalshape_variation_nuonly | Done | MC | 200k | caf, LArCV | Osc. Analysis | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR1_untunedtpcsigshape |
32 | drielsma@slac.stanford.edu | MPVMPR | Done | MC | 300k | LArCV | ML | OSG | Francois | - |
33 | daniel.carber@colostate.edu | NuMI LArCV data processing | Done | Data | 1M | LArCV | ML/NuMI | OSG | Francois | - |
34 | betan009@fnal.gov | standard NuMI fcl | Pending | MC | 3M | stage0, stage1, caf | NuMI | |||
36 | justin.mueller@colostate.edu | Justin Mueller | Running | MC | 336096 | LArCV | ML | OSG | Francois | - |
37 | jzettle@fnal.gov | Detector Systematics - Middle Induction Minimal Transparency | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR1_tpcsignalshape |
38 | jzettle@fnal.gov | Detector Systematics - Middle Induction Maximal Transparency | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR3_tpcind2transparent |
39 | jzettle@fnal.gov | Detector Systematics - Front Induction Increased Gain Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR4_tpcind1increasegain |
40 | jzettle@fnal.gov | Detector Systematics - Front Induction Decreased Gain Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR5_tpcind1decreasegain* |
41 | jzettle@fnal.gov | Detector Systematics - PMT Quantum Efficiency Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR6_pmtdecreasedqe |
42 | jzettle@fnal.gov | Detector Systematics - Recombination Model Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR7_ellipsoidalrecomb* |
43 | jzettle@fnal.gov | Detector Systematics - TPC Coherent Noise Increase Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR8_tpccohnoisep1sigma |
44 | jzettle@fnal.gov | Detector Systematics - TPC Coherent Noise Decrease Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR9_tpccohnoisem1sigma |
45 | jzettle@fnal.gov | Detector Systematics - TPC Intrinsic Noise Increase Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR10_tpcintnoisep1sigma |
46 | jzettle@fnal.gov | Detector Systematics - TPC Intrinsic Noise Decrease Variation | Done | MC | 200k | caf, LArCV | BNB | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR11_tpcintnoisem1sigma |
47 | koh0207@stanford.edu | ICARUS BNB Nue Only + CORSIKA | Assigned | MC | 1M | stage1, caf, LArCV | ML | OSG | Francois | |
48 | farnese@pd.infn.it | New Light Variation | Done | MC | 200k | stage1, caf, LArCV | Analysis | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR12_pmtdecreasedqe2 |
49 | jzettle@fnal.gov | Detector Systematics - Null Variation | Done | MC | 200k | caf, LArCV | Osc. Analysis | OSG | Mateus | 2024A_ICARUS_MC_CV_Sys/2024A_Sys_VAR0_null |
50 | petrillo@slac.stanford.edu | ICARUSmajorityOnlyRuns | Pending | Data | stage1 | Trigger | Ivan? | |||
51 | petrillo@slac.stanford.edu | ICARUSrun11926_32_33 | Pending | Data | 4130 | Stage1 (+ calib.) | Trigger | Ivan? |
Link to spreadsheet
Monitoring
User Grid Usage | ||||||||||||
User Job Efficiency | ||||||||||||
Icaruspro Jobs Exit Code | ||||||||||||
SBN Data Pools | ||||||||||||
|
Active Campaigns in POMS
Campaign Name | ID | Creator | Note |
NuMI_MC_reprocess_LArCV_wRUCIO_SLAC | 8505 | drielsma | ? |
2024A_ICARUS_Run2_Reprocess_DATA_v09_89_01_bnbmajority | 8433 | promitar | Request #29 |
2024A_ICARUS_Run2_Reprocess_DATA_v09_89_01_numimajority | 8431 | promitar | Request #29 |
2024A_ICARUS_Run2_Reprocess_DATA_v09_89_01_bnbminbias | 8430 | promitar | Request #29 |
Run2_NuMI_reprocess_LArCV_wRUCIO_SLAC | 8420 | drielsma | Request #33 |
icarus_keepup_Physics_allstreams_Run3 | 8401 | icaro | Keepup |
2024_Run3_Run11816_OpticalReconstruction_WG_offbeambnbminbias | 8140 | promitar | Request #16 |
icarus_keepup_production_OffbeamBNBMinbias_run2 | 7404 | icaro | Keepup |
MCC1.1_icarus_prod_mu_proton_bnblike_center | 4522 | drielsma | ? |
MCC1.1_icarus_prod_mu_proton_bnblike_cathode | 4521 | drielsma | ? |
Link here
Notes
- SBND data production will start within 2 two weeks:
- Monitor free disk space
- Availability of Mateus will decreases at least temporarily
CNAF
- RUCIO transfers?
FNAL
Keepup
- ICT:
Infrastructure
- GC:
Software
- TU:
- MT: Is it possible to profile production releases in terms of RAM, output file size, execution time along the different but almost standard stages (gen, g4, detsim, stage0, stage1, caf, larCV)?
Computing
- VDB:
Action items
- ALL: Pushing on NuMI WG to get trimmering applied to stage1 (Joseph Zennamo)
- ALL: Define a policy for production location and name
- ALL: Define a reference set of metadata fields that should be always filled properly: see here
- GC: Organize a meeting with calibration WG (1- calib. from keepup in the dedicated area, 2- calib. area management under the responsibility of the WG)
- DDF: Run compression at CNAF or transfer compressed files
- MT: Figure out the campaign parameters that impact on the disk location of the campaign
- GC: Point us to the script for deleting productions
- ALL: Create a repository for our tools (i.e. scripts, code, etc..)
- ALL: Create a sort of database/list of issues faced during productions with the solution or strategy