Research PortalRAC 2017 Overview and Stats
2017 Resource Allocations Competition Results
– CPU Allocations
– GPU Allocations
– Cloud Allocations
– Scaling for Compute Requests
Monetary Value of the 2017 Allocations
Compute Canada reserves 80% of its resources to the Resource Allocation Competitions (RAC), leaving 20% for use via our Rapid Access Service. Unlike other countries around the world, in Canada, we do not have a specialized provider serving very high-end needs, separate from general-purpose need.
We have done an analysis of our largest users compared to the bulk of our users (who do not have RAC awards) and have found the quality of their publications (by field-weighted citation impact) to be similar. In other words, both large and small Compute Canada users achieve high levels of scientific impact with the research performed with the assistance of Compute Canada resources. View our bibliometrics report here.
If you have questions about the terminology used in this page, please consult the Compute Canada Technical Glossary. For other questions or general inquiries, email email@example.com or visit our Frequently Asked Questions page.
(Please note: all data contained within these pages is current as of April 29, 2017.)
Table 1: Applications submitted to the Resource Allocation Competitions
between 2011 and 2017
|Year||Resources for Research Groups
|Research Platforms and Portals (RPP)||CFI Cyberinfrastructure Challenge 1||Total|
Based on available computing resources for 2017, Compute Canada was only able to allocate 58% of the CPU (core years) requests. However, as Tables 2 shows, the allocation success rate for CPU improved slightly in 2017 compared to 2016. Note that more than 50,000 of the cores available in 2017 are new and are higher performance than those they replace.
Table 2: Historical CPU demand vs. supply (core years)
|Year||Total CPU Capacity||Total CY Requested||Total CY allocated||Allocation success rate|
Table 3: 2017 CPU demand vs. supply by system
|CPU System||2017 Allocatable Capacity (core-years)||
2017 Total Request (core-years)
|2017 Total Allocation (core-years)||Fraction Allocated|
* Total capacity of the CAC cluster is 2600 core-years, but the allocatable capacity for 2017 is 840 core-years. So in this case the allocation target is 100% of 840 and not 80% like in the other systems.
** Allocation in Graham will increase to more than 85% in September 2017 when GPC is decommissioned and some of its current users are moved to the new system.
Constraint in GPU resources was greater than in CPU. As Table 4 shows, the demand for GPUs has increased 4.5x since 2015. In spite of the increase, the allocation success rate was 38%, compared to 20% in 2016. GPUs in the newest systems have much greater performance than legacy GPU devices
Table 4: Historical GPU demand vs. supply (GPU years)
|Year||Total GPU capacity||Total Requested||Total allocated||Allocation success rate|
Table 5: 2017 GPU demand vs. supply by system
|GPU System||2017 Allocatable Capacity (GPU-years)||2017 Total Request (GPU-years)||
2017 Total Allocation (GPU-years)
*Monk-GPU is out of warranty but available for opportunistic use at the user’s risk.
The installation of Arbutus at the University of Victoria campus increase our cloud computing capacity from 104 nodes to 290 at UVic, plus 36 nodes in Cloud East at U. de Sherbrooke. Storage at UVic was quadrupled, to over 2.2petabytes. We received requests for 9,152 VCPU’s and our capacity was 23,040 VCPU’s. As the need and awareness for cloud computing resources grows we anticipate more requirements in this area.
Table 6: 2017 VCPU demand vs. supply by system
|Cloud system||2017 Allocatable Capacity (VCPU)||
2017 Total Request (VCPU)
2017 Total Allocation (VCPU)
*East-cloud is available for users needing cloud resources without an allocation via our Rapid Access Service.
The incorporation of the new systems Cedar (SFU), Graham (Waterloo), and Arbutus (Victoria) made possible for Compute Canada to meet the storage demand in 2017, as Table 7 shows.
Table 7: 2017 Storage Supply vs. Demand by Storage Type (TB)
|Storage type||2017 cluster capacity||2017 Total Requested||2017 Total Allocated||Success rate|
Table 8: 2017 Project Storage Supply vs. Demand (TB)
|Project Storage||2017 Allocatable Capacity||2017 Total Request||2017 Total Allocation||Fraction Allocated|
Table 9: 2017 Nearline Storage Supply vs. Demand (TB)
|Nearline Storage||2017 Allocatable Capacity (TB)||2017 Total Ask (TB)||2017 Total Allocation (TB)||Fraction Allocated|
* NDC = National Data Cyberinfrastructure
Table 10: 2017 Cloud Storage Supply vs. Demand (TB)
|Cloud storage (Ceph)||2017 Allocatable Capacity (TB)||2017 Total Request (TB)||2017 Total Allocation (TB)||Fraction Allocated|
Submissions are evaluated for both technical feasibility and scientific excellence. For the 2017 competitions, 414 applications were submitted and 390 allocations were awarded. Note that virtually all of applicants are requesting resources to support research programs and HQP that are already funded through tri-council and other peer-reviewed sources.
This year’s resource allocations competition awarded 58% of the total compute requested and 98% of the total storage requested. Due to the competitiveness of the proposals and the limited amount of computing resources available, all projects, across all disciplines, received final allocations less than their original request.
Table 11: Requests vs. Allocations (broken down by resource)
|Number of Requests Granted|
- Compute Canada Technical staff review each proposal;
- A peer review panel evaluates each proposal:
- Each proposal receives multiple independent reviews;
- Scientific committees meet to discuss the applications;
- The peer review panel may or may not recommend specific cuts for an application;
- The peer review panel gives a final science score on a 5-point scale;
- The committee of RAC chairs endorses a scaling function based on science score. That scaling function is applied to all compute requests.
Scaling for Compute Requests
As in previous years, in 2017 the available compute resources were not enough to satisfy the demand. This is because a considerable number of legacy systems are being removed from service at the same time that the new systems are coming online.
The scaling function applied to the 2017 competition (see chart below) was set so that only applications with a science score of 2.25 or higher received an allocation, with a maximum of 87.5% for those with a score of 5. Note that those who did not receive a compute allocation can still make opportunistic use of system via our Rapid Access Service.
Monetary Value of the 2017 Allocations
These values represent an average across all Compute Canada facilities and include the total capital and operational costs incurred by Compute Canada to deliver the resources and associated services. These are not commercial or market values. For the 2017 competition, the value of the resources allocated was calculated on a per-year basis using the following rates:
- $188.84 / core-year
- $566.52 / GPU-year
- $128.00 / TB-year
- $40.50 / VCPU-year
- $178.50 / cloud storage TB-year (Ceph)
Please note that the valuation of each of of these resources goes down each year as older, more expensive, resources are retired and replaced with newer, more cost effective, resources.