Yosemite V3.5 & Crater Lake�

Yeshaswy Rajupalepu (Yesh)

Hardware Engineer - Meta

Abe Garcia

Hardware Engineer - Meta

Specification contribution review

Agenda

1. Contribution summary�
2. Background and Overview�
3. Yosemite v3.5 Overview
4. Crater Lake summary and configurations
5. OCP tenets�

Contribution

• Hardware specification for Crater Lake Server Board
• Hardware specification for Yosemite V3.5
• Wiwynn will follow up with the supplier specification with the next 120 days

Background

• YV3.5 is the follow on platform and a mid-life incremental update for YV3.0.
• Primary updates made to YV3.5 chassis include
• ORv3 support - Medusa board, VPDB
• Improved thermal performance using 15K fans
• Higher sled power support- upto 3KW
• PCIe Gen4 shared MHNIC

​

YV1.0

YV2.0

YV3.0

Yosemite V3.5 Overview

• Meta’s next generation 1-socket server platform based on YV3.0
• 1/3 width per blade, OCP Open Rack v2/v3 compatible
• Capable of using up to 12x 1OU servers in 4OU Chassis
• 4:1 Gen4 Multi-host OCP 3.0 NIC Compatible
• Supports 15K fans for improved thermal performance
• One OCP USB debug port
• All Servers are independently front hot-serviceable
• Supported programs include “Crater Lake” using 4th Gen Intel® Xeon® processors

​

YV3.5 Blade

YV3.5 Sled

YV3.5 Chassis

Yosemite V3.5 Chassis changes

• Retains the same blade/sled/chassis architecture of Yosemite V3​
• Support higher TDP CPU SKUs​ with heat sink design changes
• YV3.5 chassis to ORv3 Integration
• Chassis height reduction from 189mm(ORV2) to 188.3mm(ORV3 Rev04)
• New vertical restraint feature​

YV3.5 Sled Chassis

YV3.5 Cubby Chassis

YV3.5 vs YV3.0 Architecture

• 15K fans to enable higher cooling capability for higher thermal impedance SKUs​
• BMC/BIC supports eSPI, I3C, and secure boot​
• YV3.5 Sled to ORv3 Integration​
• 48V vertical power distribution board (VPBD) with onboard DC-DC integration allowing ORv3 Integration​
• 48V Medusa board with optional cable health sensing feature​

Crater Lake Overview �(Dimensions in mm)

Crater Lake will be the first server designed for the YV3.5 architecture,

• Single Socket 1OU server design
• Supports 4th Gen Intel® Xeon® processor SKUs up to 165W TDP
• 6 channels of DDR5 at 4800MTs
• x8 Gen5 PCIe link to OCP MHNIC on baseboard
• Expansion ports
• 2OU - X16 (CXL enabled) + x8 Gen5 capable
• 1OU front expansion - X16 (CXL enabled) + x8 Gen5 capable
• 22x80 M.2 boot drive slot
• Platform Root of Trust (PRoT) module Header

​

Crater Lake System architecture

Potential Configurations

YV3.5 Sled

YV3.5 Blade

YV3.5 Cubby

YV3.5 Blade with Vernal Falls 2.0 E1.S expansion

YV3.5 Blade with 2OU DPv2 expansion

OCP Tenets

Openness – Yv3.5 & Crater Lake server specification describes a design which can be used to support many configuration types. It can be leveraged by other OCP partners as a standalone server, or it can drive other use cases with support for expansion options, oBMC, ORv2/ORv3.

Efficiency – Yv3.5 continues to utilize shared resources such as fans, MHNIC along with support for ORv3 racks, improved thermal efficiency and 4th Gen Intel® Xeon® processors.

Impact – Yv3.5 & Crater Lake has been designed to improve over Yv3.0 and Delta Lake in terms of compute/power density, power/thermal efficiency and IO bandwidth resulting in an overall performance/Watt gains.

Scale - Yv3.5 & Crater Lake are designed for large scale data center deployment and operations. The system is designed with debug hooks, ease of serviceability, and reliability as a focus. YV3.5 sled design continues to be front serviceable, hot-pluggable and support service touch point indicators. The Design continues to support openBMC architecture and the OCP debug options such as OCP debug card and At Scale Debug.

Sustainability - Yv3.5 & Crater Lake have been designed for sustainability. The spec submission will maximize transparency of environmental impacts of the contribution, with the aspiration of improvement over time.

​

Call to Action

• Please vote to approve the OCP Acceptance of the Yosemite V3.5 and Crater Lake Design Spec.
• If any additional questions, feel free to contact me at yesh@meta.com, abegarcia@meta.com

Appendix A from Spec