MVTX AC/DC Power Distribution
Cameron Dean, Ho-San Ko, Ming Liu, Yuan Mei, Yasser Corrales Morales, Michael Peters, Jo Schambach, Zhaozhong Shi, Walter Sondheim
Nov 15, 2021
1
2
2
Outline
3
Clean & simplify the slides & focus on the concerns.
Use p.9 in various slides to remind people.
4
PP3
PP2
PP1
MVTX rack location: 2E1 & 2E3
5
2E1: Power Board and Readout Unit
2E3: CAEN power supplies for Power Board and Readout Unit
1.32 m
12 m
11 m
Patch panel 2
Patch panel 3
6
10
Detail of the cabling between the racks: [2]https://docs.google.com/drawings/d/1_jeF-l10jnqIwcAkbsub0Q9S3dJP-C4aZ1vbrgAuEIc/edit?usp=sharing
208 Vac 3-phase (~1.3kW) & 110 Vac (~800W)
Water cooling for each module
is used in 2E1
Rack 2E3 powers rack 2E1: Problem at 2E1 → 2E3 shuts down power
2E1
2E3
Update: Mar/10/2022
At the bottom, fan from the back will be installed
7
6
2E1
2E3
Quick summary
8
EASY3000
stave
stave
stave
stave
stave
stave
...
48 X staves
RU
RU
PU
PU
PB
RU
RU
PU
PU
PB
RU
RU
PU
PU
PB
RU
RU
PU
PU
PB
RU
RU
PU
PU
PB
...
24 X (PB + 2 RU)
= 4 VME crates
LV
12 ch
LV
12 ch
LV
12 ch
LV
12 ch
EASY3000
LV
12 ch
LV
12 ch
LV
12 ch
LV
12 ch
48 Vdc Bulk Power
Mainframe
controller
RB LV
Rack 2E1
Rack 2E3 (all CAEN)
Interaction Region
high speed data & control
1.8 V, 0.9 A ( dig) & 0.115 A (ana), GND, -3 V, 0.01 A (bias)
PU: 3.3 V, 1.5 A
RB: -5 V, 0.1 A
RU: 7 V, 1.9 A
High voltage:
CAEN modules (2E3): all non-NRTL. Plan to have inspection when arrive at BNL
all modules and their software have interlock system
Voltage sense: 2E3 - 2E1 (yes), 2E1 - Stave (no)
10.7 m cables
13.32 m cables
RU : Readout Unit
PU : Power Unit
PB : Power Board (2 X PU)
RB : Reverse Bias
LV : Low Voltage
MVTX Readout, Power Overview
9
9 sensors
FPC
Stave
Cold plate
high speed data & control
1.8 V, 1 A (dig) & 0.1 A (ana), GND, -3 V, 0.01 A bias
Readout Unit
Power Unit
I2C
Power Unit (PU) requires power: 3.3 V, 1.5 A
Readout Unit (RU) requires power: 7 V, 1.9 A
Reverse Bias (RB) input to Power Board (PB): - 5 V, 0.1 A
→ All the power to the PB and RU are supplied by CAEN modules at 2E3.
Interaction Region / Stave
Rack 2E1
Two Power Units constitute one Power Board.
48 staves = 48 Power Units & 48 Readout Units
= 24 Power Board & 48 Readout Units
MVTX Readout, Power Overview
10
Readout Unit
PTC fuse: 10 A
Power Unit
PTC fuse: 1.1 A (RB)
10 A (PU)
Power Unit (PU) requires power: 3.3 V, 1.5 A
Readout Unit (RU) requires power: 7 V, 1.9 A
Reverse Bias (RB) input to Power Board (PB): - 5 V, 0.1 A
→ All the power to the PB and RU are supplied by CAEN modules at 2E3.
→ Problem at 2E1 ⇒ 2E3 shuts down
Rack 2E1
3.3 V, 1.5 A*
7 V, 1.9 A
Rack 2E3: CAEN + fans
A3486 48 Vdc Bulk Power
2 ch
208Vac-48Vdc converter.
max input 5kW (3 X 25 A ext. fuse required)
(5 X 4mm2 cable: 33 A @ 440 V rated)
(2 A Fuse for service)
max output 4kW (one ch)
max output 2kW (two ch) : 10 AWG used
SY5527 Mainframe
Houses A1676A & A2518
110Vac input
max input 20 A (Fuse)
Max output 550 W
A2518: RB to PB
8 floating ch. 3~8 V. max 10 A. or max 50 W.
A1676A: controls A3009B/EASY3000 & A3486
CAEN: Programmable voltage & current limit
A3009B: trimmer to set hardware threshold
trimmer: physical voltage/ current limit
*: During power on, the current can go up to 6 A for milliseconds
EASY3000 crate
100 A Fuse on 48 V power input
A3009B
12 ch floating
1.5 ~ 8 V
max 9 A or
max 45 W
ALICE ITS
11
2E1
RUs, PBs, and Fanout Board
Modules do not directly connect to long cables.
Exception:
-power cables from PB
-readout cables from RU
2E3
Rack 2E3 powers rack 2E1: Problem at 2E1 → 2E3 shuts down power
2E1 crates backplanes are used only for GNDs
CAEN modules
At 2E3: all CAEN
12
DIN rail connectors will be used to handle large amount of cables
→ Reduce cable weight at the connector
LV power sense will use CAT5E cable
Interlock cable (coaxial): TTL-LEMO,
Low voltage
SY5527 mainframe
(control & RB)
A3009
A3009B
EASY3000
A3486 Bulk Power
~500W/EASY3000
Short cables from A3009B (16 AWG): VW-1
Long cables from 2E3 (16 or 12 AWG): CMR or CL2P
Sense cables (CAT5E): VW-1
DIN rail (10~24 AWG, 28 A, 600 V): 94V-0
DIN rail
All CAEN modules are non-NRTL. Will have them inspected by a lab EEI when arrive at BNL.
Long cables for reverse bias (RB): CMR
RB sense cables (CAT5E): VW-1
Bulk Power (48Vdc, ~500W) (10 AWG): VW-1
Bulk Power sense: VW-1
Service to Bulk Power (48 Vdc): 12 AWG: VW-1
Service to EASY3000 crate: 12 AWG: VW-1
Power
Sense
Interlock
At 2E1 (Example from ALICE ITS)
13
Patch panel is used to reduce the weight at the connection at the modules & easier cabling between 2E3 & 2E1.
Cables from PB & RU to the detectors go directly without patch panel.
Need to enable PB for daisy-chaining by putting resistor
PB
RUs
Sense
Power IN
RB
Fibers
SAMTEC
Power OUT
These cables are not MVTX will use. Shown for description only.
Our cable specification can be found at: [4]https://docs.google.com/spreadsheets/d/1lBSwMTf62VBQ3n_o2NKDXxLzVPyyf5eS3rzE1_oteCo/edit?usp=sharing
At 2E1
14
FB : Fanout Board
Distributes RB to the PBs in the subrack.
CAN-Bus to RU.
Inf. GND
→ Cables at the patch panels to modules (both at 2E1 & 2E3)
Long cables screwed at the screw terminal
At 2E1
15
FB : Fanout Board
Mainly distributes RB to the PBs in the subrack
To Staves
1.32 m
12 m
11 m
Power & readout cables
16
Data and control between stave and RU
12 m
Non-NRTL
Power to two staves from one PB
Breakout board (PCB): 94V-0
Fischer Connector
(stainless steel or brass).
PEEK: 94V-0
email discussion: [10]https://drive.google.com/file/d/1Zt-NrsKALlKYb5QtC-fK6XLh9ANbVKOi/view?usp=sharing
Power cable (inside the TPC)
17
MVTX Power Connectors
More information --- [11]https://www.phenix.bnl.gov/WWW/publish/mxliu/sPHENIX/Staves/Stave-power-cables/
Non-NRTL
Non-NRTL
Power to two staves from one PB
PCBs: 94V-0
Fischer Connector
(stainless steel or brass).
PEEK & PBT: 94V-0
Data and control between stave and RU*
1.32 m
*Signal cable is 30 cm longer (PP3 to PP1 where power cable goes PP3 to PP2)
List of connectors
From 2E3 to 2E1 (for PB & RU)
Ring tongue terminal (Multicomp Pro) ZMVV
DSUB connector (Amphenol ICC) 94V-0
TE connectivity with crimp contact 94V-0
DSUB connector (Metal hood) ECBT2
terminals Non-NRTL
In 2E3 (for CAEN)
18
Cables have UL ratings
Except the power cables shown in the previous two slides
Power calculation
19
2E1 to staves | Analog 1.8 V (at the stave) | Digital 1.8V (at the stave) |
Current | 0.1 A | 1 A |
Wire gauge / Length | 22 AWG / 14 m (one way) | 16 AWG / 14 m (one way) |
Voltage drop / Power Loss | 0.15 V / 15 mW (round trip) | 0.37 V / 0.37 W (round trip) |
2E3 to 2E1 | PU 3.3 V (at the board) | RU 7 V (at the board) |
Current | 1.5 A | 1.9 A |
Wire gauge / Length | 12 AWG / 11 m (one way) | 16 AWG / 11 m (one way) |
Voltage drop / Power Loss | 0.17 V / 0.26 W (round trip) | 0.55 V / 1.0 W (round trip) |
voltage drop calculator: https://www.rapidtables.com/calc/wire/voltage-drop-calculator.html
Grounding scheme
20
Based on ALICE/ITS power and grounding paths - L. Greiner
Power Boards
CAEN Crates, 2E3
Regulators
V
RDO Boards
DC-DC
V
“VME” type crates, 2E1
Power Supply
Power Return
Instrumentation GND
Infrastructure GND
CF Support
Cylinders
Inner HCAL
or
Support ring
A3009
modules
A3009
modules
Magnet support
(Main GND)
Stave CP and SF
PB
RU
Regulators
Backplane/FanoutBoard
CAEN modules GND
21
PB & RU GND
22
← Breakout Board of the PB
Possible voltage exposure: 1.8 V X 1 A
Consider conformal coating
Backplane VME J1 pin assignment. Only used for GND →
GND
Power
GND
Power
Bias
Inf. GND
PT100
Read externally
Inf. GND shared between two backplanes of the crate
Stave GND
23
Stave GND
24
~ 80 cm long
Fanout Board
Main purpose: distributes Reverse Supply Voltage, GND, and CAN-Bus.
CAN-Bus: comes from the counting house. It interfaces to the slow controls in the RU.
25
Instr. GND
Inf. GND
RB IN sense
RB OUT 1
RB OUT 2
RB OUT 3
CAN-Bus IN
CAN-Bus OUT 1
CAN-Bus OUT 2
RB IN
All custom boards are FR4
Safety system
26
Safety requirements: [12]https://docs.google.com/document/d/1KMz8V25055OjJRDhqXZHrsppUulV6mGPZYM765eXIBY/edit?usp=sharing
safety flowcharts: [8]https://docs.google.com/presentation/d/1wIxI_JdaZ-722CcVdQ9fJHtw7MgYn_YJ/edit?usp=sharing&ouid=115313506692148889725&rtpof=true&sd=true
Safety system example
An example from the flow chart: [8]https://docs.google.com/presentation/d/1wIxI_JdaZ-722CcVdQ9fJHtw7MgYn_YJ/edit?usp=sharing&ouid=115313506692148889725&rtpof=true&sd=true
27
Safety system example
An example from the flow chart: [8]https://docs.google.com/presentation/d/1wIxI_JdaZ-722CcVdQ9fJHtw7MgYn_YJ/edit?usp=sharing&ouid=115313506692148889725&rtpof=true&sd=true
28
Stave Cooling System
Connected to PLC
29
picture with higher quality: [13]https://drive.google.com/file/d/1oLH5b2HjO5Br8qE2XPSTyS6kyuB9PjQ7/view?usp=sharing
Stave Cooling
30
Water cooling hoses
PP1
PP2
PP3
Electronics Cooling System
Connected to PLC
31
picture with higher quality: [14]https://drive.google.com/file/d/1YfWWN24NepLSJas6xdVoF2u_Fgmaxe8h/view?usp=sharing
32
Backside of the rack 2E1.
Each RU, PB has cooling plates
References
https://drive.google.com/file/d/16Rj95IU4c__ech1yJB2aT5o_jVOlaPLg/view?usp=sharing
https://docs.google.com/drawings/d/1_jeF-l10jnqIwcAkbsub0Q9S3dJP-C4aZ1vbrgAuEIc/edit?usp=sharing
https://docs.google.com/presentation/d/1a-ujNMfXiKW3dAr9v_zFhHZrBSRbYB-kZNK8O92azwA/edit?usp=sharing
https://docs.google.com/spreadsheets/d/1lBSwMTf62VBQ3n_o2NKDXxLzVPyyf5eS3rzE1_oteCo/edit?usp=sharing
https://drive.google.com/drive/folders/1c30wGXaAdvo8N90Atr6rs-mKn3xqTsKe?usp=sharing
33
References
10. SAMTEC data cable AHJ approval email: https://drive.google.com/file/d/1Zt-NrsKALlKYb5QtC-fK6XLh9ANbVKOi/view?usp=sharing
11. MVTX detector power cable connectors:https://www.phenix.bnl.gov/WWW/publish/mxliu/sPHENIX/Staves/Stave-power-cables/
12. Safety system requirements: https://docs.google.com/document/d/1KMz8V25055OjJRDhqXZHrsppUulV6mGPZYM765eXIBY/edit?usp=sharing
13. Stave cooling system schematic: https://drive.google.com/file/d/1oLH5b2HjO5Br8qE2XPSTyS6kyuB9PjQ7/view?usp=sharing
14. Electronics cooling system schematic: https://drive.google.com/file/d/1YfWWN24NepLSJas6xdVoF2u_Fgmaxe8h/view?usp=sharing
34
35
Back Up
Power consumption budget
36
| | | | | Comments | | Power in Watts | |
| | | channels | 48 | | | IB = IB stave (HIC) | |
| | | RU | 48 | 1 per ch | | | |
| | | PU | 48 | 1 per ch | | | |
| | | LV CAEN ch | 96 | ch needed | | | |
| | | BB CAEN | 24 | -5V * 0.1A * 48 | | | |
| | | service Pw | 20 | 20W per dev | | | |
| | | IB HIC Pw | 5 | 3.3V*1.5A per HIC incl PU | | | |
| | | RU Pw | 13.3 | 7V*1.9A per RU | | | |
| | | | | | | | |
CAEN | Comments | # devices | ch/device | ch total | max pow/ch | service power | chann pow | |
SY4527 | Mainframe (incl A1676 and A2518) | 1 | | | | 200 | | |
| Integrated Mainframe Fans | 9 | | | 20 | 180 | | |
A1676 | branch Controller | 1 | | | | 0 | | |
A3486 | bulk power | 1 | 2 | 2 | 2000 | 100 | | |
EasyCrate | 5 dev/crate | 2 | 5 | 10 | | 20 X 2 | | |
A3009R | LV: 12W / ch (RU), 5W/ch PU | 8 | 12 | 96 | 45 | 20 X 8 | 879 = (5+13.3)*48 | PU+RU |
A2518 | LV in Mainframe | 2 | 8 | 8 | 45 | 0 | 24 | BB |
| | | | | | 680 | | |
FAN Trays | | 3 | | | 120 | | 360 | |
| | | | | | cable loss | 300 | |
| | | | | | TOTAL | 2243 | |
37
| | | | | | | | | |
| Route Name | Length from PP to Rack | Length over Beampipe | Contingency (~10%) | Length in Rack | Total | | | |
| | In Rack | |||||||
| Power PP3 to 2E1 | 7.17 m | 0.3 m | 0.72 m | 4.0 m | 12.19 m | | 1.25m | Top-Bot |
| Samtec PP3 to 2E1 | 4.96 m | 0.3 m | 0.5 m | 3.25 m | 9.01 m | <- Purchase 10m | 1m | Left-Right |
| | | | | | | 1m | Front-Back | |
| Fibers 2E1 to 1E2 | 4.36 m | - | 0.64 m | 7.0 m | 12.0 m | | Or | |
| | | | | | | | ||
| | | | | | | | In Rack | |
| | | | | | | | 2m | Top-Bot |
| | | | | | | | 1m | Left-Right |
| | | | | | | | 1m | Front-Back |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
Things to modify
38
Clean & simplify the slides & focus on the concerns.
Use p.9 in various slides to remind people.
39
PP3
PP2
PP1
MVTX Readout, Power Overview
40
9 sensors
FPC
Stave
Cold plate
high speed data & control
1.8 V, 1 A (dig) & 0.1 A (ana), GND, -3 V, 0.01 A bias
Readout Unit
Power Unit
I2C
Power Unit (PU) requires power: 3.3 V, 1.5 A
Readout Unit (RU) requires power: 7 V, 1.9 A
Reverse Bias (RB) input to Power Board (PB): - 5 V, 0.1 A
→ All the power to the PB and RU are supplied by CAEN modules at 2E3.
Interaction Region
Rack 2E1
Two Power Units constitute one Power Board.
48 staves = 48 Power Units & 48 Readout Units
= 24 Power Board & 48 Readout Units
MVTX Readout, Power Overview
41
Readout Unit
PTC fuse: 10 A
Power Unit
PTC fuse: 1.1 A (RB)
10 A (PU)
Power Unit (PU) requires power: 3.3 V, 1.5 A
Readout Unit (RU) requires power: 7 V, 1.9 A
Reverse Bias (RB) input to Power Board (PB): - 5 V, 0.1 A
→ All the power to the PB and RU are supplied by CAEN modules at 2E3.
Rack 2E1
3.3 V, 1.5 A*
7 V, 1.9 A
Rack 2E3: CAEN + fans
A3009B
12 ch floating
1.5 ~ 8 V
max 9 A or
max 45 W
A3486
2 ch
208Vac-48Vdc converter.
max input 5kW (3 X 25 A ext. fuse required)
(5 X 4mm2 cable: 33 A @ 440 V rated)
(2 A Fuse for service)
max output 4kW (one ch)
max output 2kW (two ch) : 10 AWG used
SY5527
Mainframe: houses A1676A & A2518
110Vac input
max input 20 A (Fuse)
Max output 550 W
A2518: RB to PB
8 floating ch. 3~8 V. max 10 A. or max 50 W.
A1676A: controls A3009B/EASY3000 & A3486
CAEN: Programmable voltage & current limit
A3009B: trimmer to set hardware threshold
trimmer: physical voltage/ current limit
Housed in EASY3000 crate
100 A Fuse on 48 V power input
*: During power on, the current can go up to 6 A for milliseconds
Too much color/information scattered around!
42
2E1. 27’’-wide, 40U
2E3. 19’’, 40U
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Detail of this picture: [2]https://docs.google.com/drawings/d/1_jeF-l10jnqIwcAkbsub0Q9S3dJP-C4aZ1vbrgAuEIc/edit?usp=sharing
208 Vac 3-phase (~1.3kW) 110 Vac (~800W)
Fan. 1U. 120 W
Fan. 1U. 120 W
Fan. 1U. 120 W
Main frame. 4U Service: 200+180W
Bulk Power. 4U. Service: 100W
EASY3000 crate 6U:
4 X LV Power
Service: 4 X 20W
Patch Panel. 2U
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Water cooling for each module
is used in 2E1
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Fan. 1U. 120 W
EASY3000 crate
4 X LV Power. 6U
Service: 4 X 20W
Patch Panel. 2U
2E3. 19’’-wide, 40U
Fan. 1U. 120 W
EASY3000 crate 6U:
4 X LV Power
Service: 4 X 20W
Patch Panel. 2U
Fan. 1U. 120 W
Patch Panel. 2U
PLC remote I/Os
43
MVTX Cooling System and Interlock
44
45
2E1. 27’’-wide, 40U
2E3. 19’’, 40U
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Detail of this picture: [2] https://docs.google.com/drawings/d/1_jeF-l10jnqIwcAkbsub0Q9S3dJP-C4aZ1vbrgAuEIc/edit?usp=sharing
208 Vac 3-phase (~1.3kW) 110 Vac 1-phase (~800W)
Fan. 1U. 120 W
Fan. 1U. 120 W
Fan. 1U. 120 W
Main frame. 4U Service: 200+180W
Bulk Power. 4U. Service: 100W
EASY3000 crate 6U:
4 X LV Power
Service: 4 X 20W
Patch Panel. 2U
→ All the powers are supplied at 2E3 and distributed to 2E1.
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Water cooling for each module
is used in 2E1
Patch Panel. 2U
27’’ VME 6U
6 X PB + 12 X RU
= 12 X (PU + RU)
12 X (5 + 12) W
Cable harness. 2U
Fan. 1U. 120 W
EASY3000 crate
4 X LV Power. 6U
Service: 4 X 20W
Patch Panel. 2U
2E3. 19’’-wide, 40U
Fan. 1U. 120 W
EASY3000 crate 6U:
4 X LV Power
Service: 4 X 20W
Patch Panel. 2U
Fan. 1U. 120 W
Patch Panel. 2U
At 2E3
46
Bulk Power supply
48 Vdc, 500 W X 2 ch
Mainframe.
A1676A controls CAEN. A2518 supplies RB
RB: -5 V & sense
→ Cables:
MTW OR TW 600V OR AWM 1015/1230 VW-1
AC power
Patch panel
At 2E3
47
A3009B
Fan
48 Vdc 500 W Bulk Power with sense
→ Cables (5~10 m):
12 AWG single-conductor. 48 V, 20 W MTW OR TW 600V OR AWM 1015/1230
VW-1
Powers are distributed from the patch panel in 2E3 to the patch panel in 2E1.
All cables from CAEN modules to PB and RU go through patch panels in each rack.
→ To reduce the direct tension at the connection in the modules due to the weight of the cables (5~10 m)
A3009B
A3009B
A3009B
EASY3000
At 2E1
48
FB : Fanout Board
Distributes RB to the PBs in the subrack.
CAN-Bus to RU.
Inf. GND
→ Cables at the patch panels to modules (both at 2E1 & 2E3)
Fanout Board
49
Instr. GND
Inf. GND
RB IN sense
RB IN
RB OUT 1
RB OUT 2
RB OUT 3
CAN-Bus IN
CAN-Bus OUT 1
CAN-Bus OUT 2
At 2E1
50
FB : Fanout Board
Mainly distributes RB to the PBs in the subrack
To Staves
1.32 m
12 m
11 m
At 2E1 (Power Distribution Patch Panel)
51
Voltage Sense RJ45 port
Long cables screw terminal
Short cables connectors
List of connectors
From 2E3 to 2E1 (for PB & RU)
Ring tongue terminal (Multicomp Pro) ZMVV
DSUB connector (Amphenol ICC) ECBT2
TE connectivity with crimp contact UL 94V-0 (not listed)
DSUB connector (Molex) ECBT2
In 2E3 (for CAEN)
52
Cables have UL ratings
Except the power cables shown in the previous two slides
53
“negative” pressure water cooling
54
CAEN supply electrical safety
55
This is the only unit that sees the AC mains.
A different 48V DC supply that is compliant to US/BNL electrical safety standards can be used.
Other CAEN crates are all CE certified, running off of the 48V DC power.
Power system
56
Test system at LBNL
Power board
PB & RU in rack
Power supplies
Taken from ALICE ITS
57
Grounding scheme
58
CAEN modules GND
59
2 mm & 20 AWG banana connector
https://www.newark.com/radiall/r921330/connector-2mm-plug-black/dp/10R0723?st=r921
Non-NRTL
Please, leave your comments!
60