Research PortalResources for Research Groups (RRG) Competition

French

Competition Opens Submission Deadline
September 23, 2020 November 5, 2020, 11:59 PM Eastern Standard Time
Extension of this deadline is not possible.

The Resources for Research Groups (RRG) Competition is a peer-reviewed competition created to enable faculty members, and their sponsored research groups, to access compute and storage resources beyond what can be obtained via the Rapid Access Service. For more information about our Resource Allocation Competitions, please click here.

Please read this year’s guide carefully and refer to the Appendices for the RRG Evaluation Criteria and scoring matrix.

If you have questions, please consult our Frequently Asked Questions (FAQ) page. If you have questions about the terminology, please consult the Technical Glossary.

If you have additional questions, please contact us at rac@computecanada.ca.

Table of Contents

Eligibility
Submission Procedures & Deadlines
Online Application Form
Assessment Process
Questions & Additional Information
Appendix A: Scientific Evaluation Criteria
Appendix B: Scoring Matrix
Appendix C: Privacy Policy, NDA and Conflict of Interest Policy

Eligibility

To be eligible to submit an application to any of the Resource Allocation Competitions, Principal Investigators (PI) and co-PIs must:

  1. be a faculty member at a Canadian academic institution, and
  2. be eligible to apply for funding from a Canadian granting agency, and
  3. have an active Compute Canada account with one of the following roles: Faculty, Adjunct Faculty or Librarian.

A Principal Investigator (PI) can apply as a lead submitter for only one RRG application but can be involved in multiple RRG submissions as a participant.

Important: “Departmental” applications will not be accepted. (I.e. applications submitted on behalf of a group of PIs that may be from the same department but are not collaborating in a common research project with clear goals and outcome.)

Co-PIs and Collaborators

In the context of this competition, Co-PIs are any co-lead investigators in your project with a Compute Canada account. Both the Principal Investigator (PI) and any Co-PI listed in an application must upload an updated CCV with their application (see CCV Requirement section). To update a CCV on the CCDB, Co-PIs must go to My Account → View Reporting.

International investigators or colleagues without a Compute Canada account can be listed as collaborators.

Fast Track Application Process

A Fast Track process is available for users with existing RRG allocations who meet specific criteria. For more information, please read the Fast Track guidelines.

Only eligible Principal Investigators (PIs) will receive an invitation by email to Fast Track. This email will be sent in early September 2020.  Fast Track applications are due October 28, 2020, at 11:59 PM Eastern Standard Time (Extension of this deadline is not possible).

If you believe you meet the eligibility criteria, yet did not receive an invitation to Fast Track, please email rac@computecanada.ca

Minimum Request

Only applications needing more than the amounts listed below will be accepted:

HPC Cloud
  • CPU> 50* Core years, OR
  • GPUs > 10 GPU years, OR
  • Project storage > 10 TBs, OR
  • Nearline storage > 10 TB
  • Compute Cloud > 80 VCPUs, OR
  • Persistent Cloud > 25 VCPUs, OR
  • Volume and Snapshot Storage > 10 TB, OR
  • Shared Filesystem Storage > 10 TBs, OR
  • Object Storage > 10 TBs

*If you require <50 core years but high memory per core, please use the following formula to calculate the Core Equivalent to know whether you should submit an application or use Rapid Access Service for your compute needs.

Core Equivalent =MAX(cores, mem requested / 4GB)
Mem requested = CY* mem per core requested

If your resource needs are less than the limits mentioned in the table above, you should use our Rapid Access Service and do not need to submit a RRG application.

If you don’t understand some of the terms listed above, please visit the Technical Glossary.

For more information about compute allocations, core equivalent and scheduler priority, please visit this page. If you have additional questions, email rac@computecanada.ca.

Return to Table of Contents

Submission Procedures & Deadlines

Proposals must be submitted electronically through the CCDB no later than November 5, 2020 at 11:59 PM Eastern Standard Time. The applicant is responsible for ensuring that the application is complete, with all additional documentation uploaded, and that there is no discrepancy between the application document and the online form.

Following the review process, applicants will be informed regarding the status of their applications via e-mail in Spring 2021.

Apply Now
Pre-submission Consultations

If you are applying for the first time to this competition, we strongly encourage you to consult with us prior to submitting your application. Consultations should happen prior to October 31, 2020, to allow adequate time for support by Compute Canada Federation (CCF) technical staff.

The goal of the consultation is to:

  • determine whether the resources needed for your project justify submitting a RAC application;
  • verify the project’s eligibility to the right program (RPP vs RRG);
  • provide technical assistance with the calculation of the resources needed.

To schedule a consultation with technical staff, please send an email to rac@computecanada.ca or contact your regional support team.

Return to Table of Contents

Online Application Form

All applications to the RRG Competition are submitted online via the CCDB (Compute Canada Database). Users must log in using an existing Compute Canada account or register for a new account.

Important:

  • You must apply with your primary, most up-to-date position. If you recently moved to a different institution and have not yet applied for a new faculty role in the CCDB, please do so before submitting your RAC application.
  • If you have more than one faculty role on the CCDB, please make sure that your most up-to-date position is set as your primary role. On the CCDB, go to the Account Details to see which of your roles is currently set as primary and, if needed, click on the Make this role primary button next to the new role that you want to set as primary.

Failing to do any of the above could create problems if your application is successful. If you have questions or concerns about any of the items above, please contact rac@computecanada.ca.

CCV Requirement

An up-to-date Canadian Common CV (CCV) is required for the scientific review process of all RAC applications and is also important for reporting to the Compute Canada Federation’s funders.

Failing to provide an updated CCV will negatively impact the overall score of your application.

The PI and all co-PIs are required to:

  • Upload an up-to-date CCV with any RAC application.
  • Report publications enabled by your use of resources provided by the Compute Canada Federation.

The PI can view in the online application form the date in which any CCV linked to the application was last uploaded and whether any action is required.

Note: while PI’s can update their CCVs directly in the online application form, co-PIs must do so by going to My Account → View Reporting. Once co-PIs have updated their CCV in the latter page, the status of the CCV will be automatically updated in the RAC online application form.

Please plan ahead to avoid delays or the risk of missing the submission deadline due to this requirement. Deadline extensions due to missing CCVs are not possible.

Please carefully read the CCV Submission Guide for further instructions.

Requesting Resources

Please visit the Available Resources page to see the list of systems available for this competition and to understand how resources must be requested in the online form.

It is extremely important that you remember to fill in the online application form with all of your requests. There should be NO DISCREPANCIES between your attached Application Document and what you request in the online form. In case of discrepancy, what was requested in the online form will prevail.

Application Document

Please use the following templates for the required document that must be submitted with your online application. This document MUST be submitted in .pdf format.

Important: Page limits will be enforced. Applications exceeding the maximum page limit allowed will be automatically withdrawn from the competition and not evaluated. Details about page limits are included in the first page of the application template below—please read the instructions carefully.

Download Template (Word) Download Template (LaTeX)

Return to Table of Contents

Assessment Process

We established our annual Resource Allocation Competitions (RAC) in response to the Canada Foundation for Innovation’s (CFI) requirement to award advanced research computing (ARC) resources based on the scientific merits of the research proposed. In addition to this requirement, we must evaluate the technical merits of allocation requests.

To meet these two requirements, RAC involves two review processes each year:

  • a scientific review, which is a peer-review process involving more than 80 discipline-specific experts from Canadian academic institutions. These volunteers assess and rate the merits of the computational research projects submitted. The scientific review results in a single score that provides a critical and objective measure to guide allocation decisions; and,
  • a technical review that is undertaken by Compute Canada Federation (CCF) staff who are responsible for verifying the accuracy of the computational resources needed for each project based on the technical requirements outlined in the application and for making recommendations about the national system to which the resources should be allocated to meet the project’s needs.

The overall process is overseen by the RAC Administrative committee, which includes representatives from each of the national system host sites.

Guiding Principles

RAC is guided by the following principles:

  • All applications are given fair consideration through both a scientific and technical review process.
  • Resources are awarded based on the merits of the computational research project presented, rather than the merits of the overall research program.
  • There is no direct correlation between the amount of computational resources needed and the quality (excellence) of the research outcomes of a project. Important research can be done with a small amount of computational resources.
  • The challenges arising from the shortage of resources and other constraints within the system are shared among all applicants.

To schedule a consultation with technical staff, please send an email to rac@computecanada.ca.

Technical Review

The technical review is conducted by technical experts of the Compute Canada Federation who:

  • ensure the appropriate system is requested by the PI and the required software is available;
  • evaluate application efficiency and scalability;
  • identify groups that may need help with application and workflow optimization;
  • identify discrepancies between the online request and the complete description of the project;
  • identify special software requirements;
  • provide a technical opinion on the reasonableness of the request.

Technical reviewers are required to sign a Non-Disclosure Agreement prior to accessing any RAC application.

During the technical review process, staff may require additional information from applicants and will engage them directly. In order to ensure an application can progress beyond the Technical Review, applicants are expected to respond to requests from the technical team within 48 hours of the request.

Science Review

All applications submitted to the RAC are peer-reviewed and scored. Scientific reviewers are required to sign a Non-Disclosure Agreement and accept the Conflict of Interest Policy prior to accessing any RAC application.

The final RAC score is based on the following:

  • the scientific excellence of the specific research project for which computational resources are being requested;
  • the scientific and technical feasibility of the proposed research project;
  • the appropriateness of the resources requested to achieve the project’s objectives; and,
  • the likelihood that the resources requested will be efficiently used.

Please carefully read the RRG Evaluation Criteria and scoring matrix at the end of this Guide.

Applications will be reviewed in one of the committees below. Applicants can select a peer-review committee of their choosing; however, we reserve the right to move the application to a different committee following consultation with the committee Chairs.

  • Astronomy, Astrophysics and Cosmology
  • Bioinformatics
  • Chemistry, Biochemistry and Biophysics
  • Computer Sciences and Mathematics
  • Engineering
  • Environmental and Earth Sciences
  • Humanities and Social Sciences
  • Nano, Materials and Condensed Matter
  • Neurosciences, Medical Imaging and Medical Physics
  • Subatomic Physics, Nuclear Physics and Space Physics
Resource scaling

Resources provided by the Compute Canada Federation are limited; therefore, applications are scaled based on supply and demand.

A scaling function, endorsed by the Chairs of the Expert Review Committees, is applied to compute requests to provide a means by which decisions on RAC allocations in a context of insufficient capacity can be made.

For RAC 2020, this function was set so that only applications with a science score of 2.5 or higher received an allocation. Visit the 2020 Resource Allocations Competition Results page for more details about the scaling function and other RAC stats.

Return to Table of Contents


Questions & Additional Information

For any questions on the RRG Competition, please contact us at rac@computecanada.ca.

You may also wish to consult our Frequently Asked Questions (FAQ) page or the Technical Glossary.

For more information about other competitions, please see our main Resource Allocation Competitions page.

Feel free to  also contact your regional support team:

ACENET:

support@ace-net.ca

Calcul Québec:

support@calculquebec.ca

Compute Ontario:

CAC: cac.help@queensu.ca

SciNet: support@scinet.utoronto.ca

SHARCNET: help@sharcnet.ca

WestGrid:

rac@westgrid.ca

Return to Table of Contents

Appendix A: Scientific Evaluation Criteria

RRG applications are evaluated against the two following criteria: Research Methods and Resource Management.

Research Methods (70%)

This criterion evaluates the methods proposed to achieve project objectives and the appropriateness of the resources requested. It focuses more on assessing what research will be done with the resources requested and on the technical justification provided, than on why the research is important.

Research Outline

  • The research problem is clearly presented.
  • The overall goal and objectives of the project are well-defined and clear, and they state what the project is ultimately expected to achieve.
  • Key milestones and deliverables are clearly described, are aligned with the objectives of the project, and are feasible.

Expected Outcomes

  • The application presents anticipated outcomes and indicates the means by which these will be measured.
  • The proposed project outputs (i.e., the anticipated results of the project) and impact are clearly described, are aligned to the objectives, are of relevance and are realistic and attainable.
  • The proposed research project is likely to lead to advances in the research area.

Methodology

  • The application describes appropriate tools, methods and approaches for addressing the research objectives. These methodologies may be community codes or models, data analysis methods, algorithmic formulations expressed in user-developed scripts or tools, as well as trials or test implementations.

Progress Over the Past Year

  • The application shows achievements, outcomes and/or evidence of progress resulting from the utilization of resources provided by the Compute Canada Federation over the past year.
  • When applicable, a justification for low utilization (or lack thereof) of an existing allocation is provided and deemed reasonable.

Resource Request Justification

  • The amount of resources requested is deemed appropriate to achieve the project objectives, and the technical justification provided is excellent.
  • The application describes necessary and sufficient computational experiments to answer the research questions posed.
Resource Management (30%)

This criterion evaluates the capacity of the Team as a whole to manage the project and its ability to make efficient use of the resources requested. It also assesses the overall feasibility of the project based on the research and computational expertise of the Team.

The Team includes the Principal Investigator (PI) and, if applicable, co-PIs and any Highly Qualified Personnel (HQP) actively participating in the project.

HQP includes all research personnel involved in the applicant’s research project, whether from academia, government, or industry. The number of HQP using resources provided by the Compute Canada Federation directly is expected to be appropriate to the scope of the project.

The nature, breadth and depth of the applicants’ (PI and, if applicable, co-PIs) experiences and contributions should be assessed in the context of their career stages. Committee members must not impart, refer to or consider information about the applicants that does not appear in the application and the provided Canadian Common CV (CCV).

It is not mandatory that an application includes co-PIs or HQP to obtain the full Resource Management score. However, the proposed research must be achievable by the listed team members, particularly if it is only one PI and/or if there is no funding available. It is expected that applications asking for large amounts of resources will have funding to justify the request.

The level of detail needed to get a high score for the Resource Management criterion is a function of team size and resource ask.

Considerations of this review criterion include the following:

Funding

  • Funding is available for the research project to justify the request for computational resources; when funding is not available, a reasonable explanation for how the compute resources will be utilized is provided.

Computational Expertise of the Team

  • The Team shows sufficient computational expertise to make effective and efficient use of the resources requested.

Management Strategy

  • Information about each team member (PI, co-PIs and HQP, when applicable) and their requested resources are clearly described.
  • The roles and responsibilities of the PI and co-PIs, if applicable, are clearly described with respect to making efficient use of the resources requested and are linked to the objectives of the project (co-PIs contribute to the Resource Management score in accordance with their involvement).
  • The Team demonstrates the combined expertise and experience needed to execute the project, i.e., deliver the proposed outputs as well as achieve the proposed contribution(s).

Return to Table of Contents


Appendix B: Scoring Matrix

Descriptor Range Definition
Excellent 4.0-5.0 The application excels in all relevant aspects of the review criteria. Any shortcomings are minimal.
Good 3.0-3.9 The application excels in most relevant aspects of the review criteria and reasonably addresses all others. Certain improvements are possible.
Fair 2.0-2.9 The application excels in some relevant aspects of the review criteria. Relevant aspects could be better addressed and/or need to be revised or improved.
Poor 1.0-1.9 The application broadly addresses relevant aspects of the review criteria. Relevant aspects of the review criteria are unclear, are missing or require major revisions or improvements.
Insufficient 0-0.9 The application fails to provide convincing information, has serious inherent flaws or gaps and/or relevant aspects of the review criteria are missing. Extensive revisions will be required.

Return to Table of Contents

Appendix C: Privacy Policy

Confidentiality of Information

Compute Canada safeguards the information it receives from applicants. All reviewers are required to sign a Non-Disclosure agreement and accept the Conflict of Interest Policy. They are instructed to keep all proposal information confidential and to use it only for review purposes. All proposals are available for review by all reviewers and the RAC Administrative Committee.

Use of Personal Information

Any personal information collected by Compute Canada is used only to review applications. Such information may be shared with relevant officials in the relevant consortium and/or with their research institution.

Public Information

If approved for an allocation, Compute Canada will post the following project information on our website:

Full name of the lead PI
Department/Institution/Organization
Platform or Portal Title
Project Summary
Allocation

Return to Table of Contents

Top