Audit of the Management Framework of the Canadian Space Agency's (CSA) Space Astronomy and Planetary Missions Programs

Criterion 1

The sub-sub-programs' activities are planned appropriately.

Condition

Conclusion about the criterion:

The audit showed that the sub-sub-programs' operations are planned appropriately.

Investment priorities are determined based on a complete analysis of opportunities.

We found that investment priorities for Space Astronomy and Planetary Missions are established once opportunities have been identified and analyzed. The resulting projects take account of affected scientific communities' needs and priorities, in addition to being in line with CSA and GoC priorities. The process followed is in accordance with the CSA's Investment Governance and Monitoring Framework (IGMF).

CSA's Investment Governance and Monitoring Framework (IGMF)

The two aspects of the IGMF that were taken into consideration for this sub-criterion were the "idea generation" and "pre-phase 0" project phases. The purpose of the "idea generation" phase is to identify a proposed initiative or idea that recognizes a need or opportunity. The information required at this stage consists of a high-level description of a technology development need or opportunity. During this stage, options are identified, concept studies are conducted, and investments can be planned. The work done during this phase determines whether and, if applicable, how the CSA can carry out a future project, either alone or with a partner. Viable options are identified. At the end of this phase, approval is required from the CSA's Integrated Investment Review Board (IIRB) before the next phase can begin. Given the exploratory nature of the work carried out during this phase, it does not necessarily result in a specific project.

Identification of potential missions and ideas

Ideas are identified to establish new missions that are based on an analysis of both national and international priorities for space exploration. The CSA derives ideas for future space astronomy and planetary missions from scientific communities involved in those fields, including but not limited to the Canadian Astronomical Society (CASCA), Joint Space Exploration Consultation Committee (JSECC), Planetary Exploration Consultation Committee (PECC), and Canadian Space Exploration Workshop (CSEW). Other ideas emerge from discussions with international partners at conferences and through advisory groups, as well as from direct dialogue with foreign space agencies, in addition to consulting their space strategies.

In 2015, the CSA helped establish topical teams devoted to space science to identify scientific objectives as well as related activities and research in space exploration fields (space astronomy and planetary exploration). Topical team members mainly consisted of university and industry professionals. Each topical team had to submit a report summarizing results from consultations and discussions within the team, in accordance with the CSA's prioritization criteria. Each team was tasked with identifying opportunities, priorities and steps required for that field to conduct space missions over the next decade and beyond, based on work conducted by Canada's scientific community, among other things.

Selection of potential missions and ideas

Based on a prioritization approach, consultations are held on a regular basis with the Space Exploration sector's directors, technical experts, managers and scientists to identify and compile a list of priority ideas. Ideas related to space astronomy missions and planetary missions that, first of all, are consistent with Government of Canada and CSA priorities, and that are of great interest to Canada's space sector, priorities are identified. These results prepare Canada for providing informed contribution options to mission partners.

The CSA's space exploration planning group establishes a pool of potential missions based on ideas that have passed the initial screening. This list of potential missions is updated twice a year to include new ideas and remove those that have become obsolete. The planning group recommends ideas that it considers correspond with the CSA's priorities, available budgetary allocations and scheduling. The strategic planning group proposes investigations, consultations and studies to identify, develop and validate the options provided in support of strategic planning for Space Exploration Branch activities as well as short-term decision making. Everything is compiled in a document entitled "Space Exploration Preparatory Activity Priorities", which is presented to the Space Exploration Management Committee (SEMC) once a year. The Director General can approve the document only once approval has been received from all committee members. IIRB approval is then required before the actions proposed by the planning group can be carried out. Consequently, the Director General, Space Exploration, presents a document to the IIRB that is similar to the one presented to the SEMC.

To validate that investment priorities are established based on a complete opportunity analysis, we reviewed documentation from a mission (WFIRST) included on the CSA's March 2017 list of potential missions. We found that all steps taken were consistent with the process described above, and that a comprehensive document had been prepared describing the analyses conducted, alignment with priorities and expected benefits.

The "Mission Datafile Prototype" register was updated with the 10 or so potential missions listed based on identified ideas. Key information for identified ideas was also included in the register in a set format.

This register is separated into three parts: the first part lists ideas that have been selected; the second lists ideas that may be selected following additional research; and the third lists rejected ideas.

The information recorded in the register related to identified ideas includes but is not limited to the source of the idea; the mission's name, description, objectives, partners; key dates; money the CSA has already invested; and potential ways the CSA can contribute. One section of the register also includes comments as well as occasional references to stakeholder priorities.

This register serves as a basis for compiling the pool of potential missions (mission roadmap).

This document could be more comprehensive by systematically including how missions align with CSA priorities as well as expected benefits. This would provide clearer justification for the decision on whether to participate in these missions.

Plans for financial resources have been made for planned activities.

We found that financial planning was done for planned activities in terms of both operating costs and capital expenditures. Plans were made taking into account both overall expenses and the specifics of each mission. Planning was continuously updated, and some capital expenditures were carried forward to next year based on project circumstances, in compliance with the established criteria. For 2016-2017, we found that 27% of planned capital expenditures had been carried over to 2017-2018. As for operating costs, a budget surplus of slightly over 20% was noted for 2016-2017, based on a comparison of the revised budget with actual spending. Management provided justifications to explain this variance, and preventive measures have been implemented for 2017-2018 to ensure that planned spending is more consistent with actual spending.

Organization

N/A

Function

N/A

Action plan details

N/A

Deadline: N/A

Criterion 2

The sub-sub-programs' activities are monitored appropriately.

Condition

Conclusion about the criterion:

The audit demonstrated that the sub-sub-programs' activities are monitored appropriately.

Roles and responsibilities are clearly defined.

We found that roles and responsibilities are well defined and communicated. A reorganization of the Space Exploration Branch was carried out during the 2016-2017 fiscal year. A new directorate was created that encompasses all management planning activities. Notably, the position of Director, Space Exploration Strategic Planning was created. A new Director, Space Exploration Development was also appointed. The number of Space Astronomy and Planetary Missions SSP managers decreased from four to two. The job description for managers was also re-written to establish new roles and responsibilities.

Senior engineers are project managers who report to the Manager, Projects/Programs Portfolio, who in turn reports to the Director, Space Exploration Development.

Projects are monitored and tracked as per the CSA's Investment Governance and Monitoring Framework and Project Management Policy.

We found that projects were monitored and tracked as per the CSA's IGMF and Project Management Policy.

We selected two active projects (JWST and OLA)—one for each SSP—to observe the practices in place. We noted that both projects are managed based on the assessment of their level of complexity and risk. The expected results are clearly established, documented and demonstrated throughout the project's life cycle. Activities are monitored and tracked. Appropriate approvals are obtained when required. In addition, reliable information on project status is produced when appropriate to support decision making. The results of activities are compared with their expected results, and corrective action is determined and taken promptly, when necessary. Cost and scheduling forecasts are updated periodically.

Spending authorizations are controlled, expenditures are approved and made in accordance with laws and regulations, and transactions are recorded appropriately.

We reviewed a sample of 14 financial transactions related to operating costs, capital expenditures, and grants and contributions. The selection was based on the various projects and their monetary value. The total value of expenses reviewed was $1.5 million, representing approximately 20% of total expenses for the 2016-2017 fiscal year.

We found that the program complies with relevant CSA and central agencies acts, policies, regulations and guidelines. Operations are authorized and approved in accordance with the Financial Administration Act (sections 32, 33, and 34). Transactions are made on the basis of payment relating to contractual agreements, legislation and guidelines. In addition, the trips reviewed were justified, and the most economical means were used.

In one reviewed transaction, however, an additional $50K in funding was verbally authorized for a collaborative agreement. In our opinion, authorization should have been provided in writing. The associated risk was quite limited given that the agreement was with another GoC department. Measures were implemented to specify what process to follow in these cases and thereby ensure that collaborative agreements are amended, if necessary.

Grants and contributions are awarded as per the TBS Policy, Directive and Guideline on Transfer Payments as well as the terms and conditions of the CSA's grant and contribution programs.

For grant and contribution awards, we selected a sample of two grants and one contribution. Based on all documentation reviewed, the grants and contribution were awarded as per the TBS Policy, Directive and Guideline on Transfer Payments. They were also authorized by the IIRB.

Organization

N/A

Function

N/A

Action plan details

N/A

Deadline: N/A

Criterion 3

The sub-sub-programs' activities are subject to accountability.

Condition

Conclusion about the criterion:

The audit demonstrated that there is accountability for the sub-sub-programs' activities.

The sub-sub-programs' activities are subject to accountability.

We noted that there is an appropriate accountability for the sub-sub-programs' activities.

A monthly dashboard is prepared for the Director, Space Exploration Development as well as the Director General, Space Exploration. That information is also used to prepare the quarterly dashboard for all CSA projects that is presented to the President of the CSA. The dashboard includes information on the progress, recent highlights, issues, risks, scheduling, costs, and scope of projects.

Electronic work plans are also used as an accountability mechanism. The information contained in these work plans is focused on activity performance. Work plans are prepared annually and used in preparing the Departmental Results Report.

Organization

N/A

Function

N/A

Action plan details

N/A

Deadline: N/A