Cheyenne | Computational and Information Systems Laboratory Skip to main content Software DART VAPOR GeoCAT NCL Data Portals DASH Climate Data Gateway Research Data Archive User Support For New Users Help & Consulting Allocations Resource Status System Documentation Visualizations Training Systems Accounting Manager Resources Resources Overview High Performance Computing Data Storage Resources Data Analysis & Visualization VisLab Machine Learning About Us Director's Office Organizational Chart Advisory Committees Annual Report Outreach Visitor and Internship Programs Careers OpenSky Publications Database Our Campuses NCAR Supercomputing History NWSC Data Center Computational and Information Systems Laboratory Sub Menu Daily Bulletin Resource Status Newsroom Events Search You must enable JavaScript to view the search results. Resources Resources overview Derecho Cheyenne Quick start User environment Software on Cheyenne Code development support Cheyenne use policies Submitting jobs with PBS Casper CMIP Analysis Platform Campaign Storage GLADE File Spaces HPSS Software for HPC users NCAR HPC User Group Research Data Archive Using data-access nodes Data transfers and sharing Getting Started New user orientation Best practices Allocations Managing allocations and charges User accounts and access Authentication and security User responsibilities Acknowledging NCAR/CISL Help Desk Resource Status Call 303-497-2400 NCAR Research Computing NCAR|UCAR Staff Support Walk-ins (closed temporarily) Consulting: ML 1B Suite 55 Help Desk: ML 1B Suite 31 Home » Resources » Cheyenne Cheyenne We’re getting a makeover! Here's what's up... Hardware | Estimating core-hours Cheyenne is a 5.34-petaflops, high-performance computer built for NCAR by SGI. The system was released for production work on January 12, 2017. An SGI ICE XA Cluster, the Cheyenne supercomputer features 145,152 Intel Xeon processor cores in 4,032 dual-socket nodes (36 cores/node) and 313 TB of total memory. Cheyenne's login nodes give users access to the GLADE shared-disk resource and other storage systems. Data storage components provided by DataDirect Networks (DDN) give the GLADE system a total usable capacity of 38 PB. The DDN system transfers data at the rate of 200 GBps, more than twice as fast as the previous file system’s rate of 90 GBps. Go to Quick start: Cheyenne Hardware 145,152 processor cores 2.3-GHz Intel Xeon E5-2697V4 (Broadwell) processors 16 flops per clock 4,032 computation nodes Dual-socket nodes, 18 cores per socket 6 login nodes Dual-socket nodes, 18 cores per socket 256 GB memory/node 313 TB total system memory 64 GB/node on 3,168 nodes, DDR4-2400 128 GB/node on 864 nodes, DDR4-2400 Mellanox EDR InfiniBand high-speed interconnect Partial 9D Enhanced Hypercube single-plane interconnect topology Bandwidth: 25 GBps bidirectional per link Latency: MPI ping-pong < 1 µs; hardware link 130 ns 3 times Yellowstone computational capacity Comparison based on the relative performance of the CISL High Performance Computing Benchmarks run on each system. > 3.5 times Yellowstone peak performance 5.34 peak petaflops (vs. 1.504) Estimating core-hours needed Cheyenne allocations are made in core-hours. The recommended method for estimating your resource needs for an allocation request is to perform benchmark runs. Some guidance is provided here. The core-hours used for a job are calculated by multiplying the number of processor cores used by the wall-clock duration in hours. Cheyenne core-hour calculations should assume that all jobs will run in the regular queue and that they are charged for use of all 36 cores on each node. Quick start: Cheyenne User environment Software on Cheyenne Code development support Cheyenne use policies Submitting jobs with PBS Submitting jobs Quick start: Cheyenne › Related training courses NCAR courses Intro to CISL HPC Systems Introduction to NCAR HPC Systems JupyterHub at NCAR Optimizing Resource Use in Scheduled Jobs Facebook Twitter Contact Us Directions Staff Directory CISL Organization CISL High Performance Computing Advisory Panel Enterprise System and Services Division High Performance Computing Division Information Systems Division Technology Development Division For Staff Management/Administrative Information Networking Administration Login
