Economic impacts

Impacts where the beneficiaries may include businesses, either new or established, or other organisations which undertake activity that creates jobs and revenue. Beneficiaries may also include graduates, employees, trained scientists and the general public. The following are examples of Economic Impacts:

• A new business sector or activity has been created or expanded through new or improved products/services or a significantly improved technology or process
• A spinout or start-up has been created around a new product, service or licence
• Research has attracted and nurtured developing businesses, for example, through the licensing of technologies.
• Industry or other organisations or charitable foundations have invested in their own research and development through research collaboration.
• Performance has been improved, or new or changed technologies or processes have been adopted, in companies or other organisations through highly skilled people having taken up specialist roles that draw on their research, or through the provision of consultancy or training that draws on their research.
• Employment has been created or increased through the production of a highly educated and relevant workforce in demand by industry and academia.

Societal impacts

Impacts where the beneficiaries may include individuals, groups of individuals, organisations or communities whose quality of life, knowledge, behaviours, creative practices or other activity have been influenced positively. The following are examples of Societal Impacts:

• Public debate has been stimulated or informed by research. 
• Public interest and engagement in science, engineering and mathematics (STEM) has been stimulated, for example, through the enhancement of STEM related education in schools and the increased number of children taking up STEM subjects at 3rd level
• The awareness, attitudes, education and understanding of the public have been enhanced by engaging them with research activities
• The work of an NGO, charitable or other organisation, including international agencies or institutions, has been enhanced by the research, for example through improved access to healthcare or improved water quality
• Quality of life has been improved through improved access to healthcare.
• Research has contributed to community development and regeneration
• Research supports creativity and increases appreciation and/or design of cultural services, for example, museums, galleries, libraries, through improving cultural awareness or improving the design and accessibility of public facilities thereby having a positive impact on cultural life of population and/or national identity.
• Mitigation of risks to public health, for example, through preventative measures for communicable and non-communicable diseases

International engagement impacts

Impacts where the beneficiaries include Irish based research scientists who are striving to improve their international reputation and international scientists who wish to relocate their research groups to Ireland. Irish businesses and Irish headquarters of MNCs may also benefit from increased international engagement. The following are examples of International Engagement Impacts:

• Significant contribution to global challenges, for example in the areas of health, the environment and poverty reduction
• Contribution to international relations and the international profile and reputation of Ireland
• Attraction of international scientists and talented people
• Leveraging of international funding through industrial and collaborative research
• New connections to international expertise have been developed providing access to new markets and state-of-the art knowledge

Policy & public service impacts

Impacts where the beneficiaries may include government, non-governmental organisations (NGOs), charities and public sector organisations and society, either as a whole or groups of individuals in society. Impact can occur top-down through policy changes and bottom up, through changing behaviours at the delivery level. The following are examples of Policy & Public Service Impacts:

• Implementation, revision or verification of policy to improve efficiency, efficacy and responsiveness of public services and / or Government regulation 
• Policy decisions or changes to legislation, regulations or guidelines have been informed by research evidence
• Changes to education or the school curriculum have been informed by research.
• Improvements in best practice of those delivering public services, have been made
• Risks to national security have been reduced 
• Improvements in risk management in public services/public sector

Health and wellbeing impacts

Impacts where the beneficiaries may include individuals (including groups of individuals) whose health outcomes have been improved or whose quality of life has been enhanced (or potential harm mitigated) through the application of enhanced healthcare for individuals or public health activities. The following are examples of Health and Wellbeing Impacts:

• Patient health outcomes have improved through, for example, the availability of new drug, treatment or therapy, diagnostic or medical technology, improvements to patient care practices or processes, or improvements to clinical or healthcare guidelines.
• Public mental and social health and well-being has improved.
• Increased efficiency of delivery of public health services.
• Decisions by a health service or regulatory authority have been informed by research.
• Quality of life in a developed or developing country has been improved by new products or processes through, for example, improved water quality or access to healthcare.
• Animal health and welfare has been enhanced by research.
• Reduction in cost for treatment for an equivalent outcome through a new drug, device or improved diagnostics 
• Mitigation of risks to public health, for example, through preventative measures for communicable and non-communicable diseases
• Disease prevention or markers of health have been enhanced by research
• Public awareness of a health risk or benefit has been raised
• Improved nutrition and food security

Environmental impacts

Impacts where the key beneficiaries are the natural and built environment with its ecosystem services, together with societies, individuals or groups of individuals who benefit as a result. The following are examples of Environmental Impacts:

• Debate on the environment, environmental policy decisions or planning decisions have been stimulated or informed by research and research outputs
• The management or conservation of natural resources, including issues around global competition for energy, water and food resources, has been influenced or improved.
• The management of an environmental risk of hazard has been improved (e.g. risk to stakeholders/community has been decreased and or resilience of community has been increased)
• The operations of a business or public service have resulted in the meeting of relevant environmental objectives
• New/improved technology or process has led to direct reduction in pollution and/or reduction of impact of pollutants on ecosystems and humans
• Improvement in sustainable use of resources and reduced overall consumption of constrained resources
• The management of natural resources, including issues around global competition for energy, water and food resources, has been improved.
• Understanding of health risks to livestock and disease risks to crops have improved, enabling improved health and increased security in food production.
• In the built environment, infrastructure or housing quality and/or longevity have been increased.

Professional services impacts

Impacts where beneficiaries may include organisations or individuals involved in the development of and delivery of professional service. The following are examples of Professional Service Impacts:

• Changes to professional standards, guidelines or training have been informed by research.
• Practitioners/professionals/lawyers have used research findings to improve the standard of their working practices
• The quality or efficiency or productivity of a professional service has improved.
• Professional bodies and learned societies have used research to define best practice.
• Practices have changed, or new or improved processes have been adopted, in companies or other organisations, through the provision of training or consultancy.
• Forensic methods/technologies have been improved as a result of research

Human capacity impacts

Impacts where beneficiaries cover the entire population, primary school students studying STEM subjects, the general workforce including science teachers, health professionals, policy makers, business leaders in SMEs and MNCs and the general public. The following are examples of Human Capacity Impacts:

• The production of a highly educated and relevant workforce in demand by industry and academia 
• Increased productivity of the workforce through improvements in health and general work environment 
• Improved scientific and technical skills of current and future workforce 
• Increased uptake of STEM subjects at secondary and University level
• Public interest, discussion and engagement in science, engineering and mathematics has been stimulated 
• Attraction of international scientists and talented people to Ireland, 
• Performance has been improved, or new or changed technologies or processes have been adopted, in companies or other organisations through the employment of highly skilled people having taken up specialist roles that draw on their research, or through the provision of consultancy or training that draws on their research
• Increased leveraged funding though programmes such as Horizon 2020 due to the increased number and level of highly skilled researchers in Ireland

View the presentation for a webinar designed to help applicants understand impact with guidance on what makes a good impact statement.

The statement should be as specific as possible and provide information that SFI and external reviewers will find helpful in assessing the potential impact of the proposed research activity. Innovative and creative approaches to engaging beneficiaries and creating impact are strongly encouraged. Appropriate milestones and deliverables associated with the potential impact should be indicated. SFI funds research in very disparate domains hence depending on the nature of the research, the impacts may be short-term, medium-term or longer-term. A credible implementation plan outlines the pathways to impact citing realistic timelines.

As examples, applicants should briefly outline previous indicators of the relevance of their research: 

• Changes to the state of knowledge within a field
• Where past group members have found employment
• Industrial interest in their past or current work
• Collaborative projects
• VC funding obtained
• Companies formed
• Problems solved
• Documented changes to public policy or guidelines
• Improvements in public health

Impact statements should be written primarily in lay non-technical language, be as specific and comprehensive as possible and cover potential impacts by answering the following questions:

• Who will benefit from this research?
• How will they benefit from this research?

In thinking about potential impacts, the following points should be considered:

• What is the activity’s potential impact on the development of science, technology and industry in Ireland and Ireland’s economy and competitiveness?
• Are there potential international beneficiaries, collaborations with international industry or partner organisations? Letters of support may be included where appropriate.
• How will industry collaborators enable increased impact? What supports are they offering? Have routes to commercialisation been considered?
• What is the activity’s potential impact on the education and training of Ireland’s students, the career development of research team members and the infrastructure for further research and education, e.g. facilities and instrumentation?
• What is the activity’s potential impact on society and the quality of life of Ireland’s citizens?
• Are there potential beneficiaries within the private sector, public sector, third sector or any others (e.g. professional or practitioner groups, charities or patient groups)? 
• Applicants are encouraged to give due regard to the SFI Agenda 2020 and the Report of the Research Prioritisation Steering Group March 2012, and other relevant publications.
• How will the potential impacts from your research best be realised?
• How do you propose the impact from your project could be measured?

Common characteristics of high quality impact statements

• Good knowledge of the relevant beneficiaries of the proposed research and the needs of the sector(s)
• Clear description of how the applicant intends to reach and engage with the beneficiaries of the research, including clear deliverables and milestones
• Genuine inclusion of appropriate collaborators in the research programme, especially in the application area of the research if interdisciplinary in nature. 
• Involvement of beneficiaries and end users from the outset taking this input into the design of the research programme. Industry collaborators may not be a requirement but where appropriate is encouraged.
• Brief description of track record and relevant accomplishments for knowledge exchange and impact-generating activities in the context of the proposed research project
• Good knowledge of national priorities and activities in the relevant areas
• Applicant demonstrates clear commitment to maximising the impact of their research

In summary, a high quality impact statement will include a credible implementation plan outlining pathways to impact citing realistic timelines and stakeholders.

Common characteristics of poor impact statements

• Statement is vague, lacks specificity and clear deliverables
• Activities are not project specific, but are routine activities for academic research positions
• Lack of inclusion of appropriate collaborators in the research programme, especially in the application area of the research, if interdisciplinary in nature. Vague, non-committal letters of support
• Too much focus on track record rather than what will be done as part of the proposed research project
• Lack of knowledge of beneficiaries, likely impacts and appropriate mechanisms for realising the potential impacts
• Too focused on outputs for their own sake rather than their contribution to impact generation
• Unrealistic expectations (not to be confused with setting ambitious goals)

In summary, a poor quality impact statement lacks a credible implementation plan.

What should not be included?

As outlined above, on their own the following are not impacts but are considered research outputs:

Publications; presenting research at a conference

While the dissemination of research output is very important, in articulating how it will lead to the utilisation of the outputs, applicants should be specific as to why that publication or conference presentation is important, how it ensures the potential beneficiaries have the opportunity to engage with the research, and how this will be followed up.

Invention disclosures; patent filings

Without being exploited, patents are not impacts, thus applicants should articulate why that intellectual property is important and how it will potentially be utilised subsequently.

How will impact statements and impact be reviewed and evaluated?

The requirements for Impact Statements will vary from programme to programme and will be based on the objectives of a particular programme and the specific call. Details of Impact Statement requirements and how they will be reviewed will be included in the call document for each particular programme call. In nearly all cases, SFI will use international experts with specific/documented interests in impact evaluation from other jurisdictions to review and rank the impact statements of scientifically excellent projects. These impact reviewers have included Company R&D Directors, Heads of Translational Institutes, Senior Technology Transfer Professionals, Investors in scientific/technology early-stage companies, for example.

Annual reporting

SFI researchers (or award holders) are required to complete an Annual Report on the progress of their award. Since 2014, the majority of SFI annual reports are managed through its online grants and awards management system, SESAME. Each SFI researcher or Centre has a “Researcher Profile” in SESAME which they update with their outputs continuously throughout the year. These outputs, in turn, can be used to populate the researcher’s or centre’s Annual Report.

The Annual Report template for the majority of the awards that SFI makes contains a section on “Strategic Impact” in which the award holder is asked to prioritise at least five relevant Impact declarations from a list of options provided (see below).

SFI are using this self-assessment type approach, since it goes in some way towards quantifying the types of impact arising from the awards it makes. This approach, however, may be subject to bias and so in addition to providing outputs through the Researcher Profile in SESAME in support of their chosen impact declarations, the award holders are required to provide narrative/details justifying the options they have selected.

Impact statements/declarations 

As part of the annual reporting guidelines, all of SFI award holders are provided with a list of 11 Impact ‘declarations’ or statements. At least one statement must be selected but award holders are encouraged to rank up to 5 statements, starting with the number 1 (being the most relevant). They are then asked to provide more details justifying the statements selected. The Impact statements help SFI to quantify the types of impacts coming from the various SFI Programmes. Each statement can be aligned with at least one of the “Types of Impact” discussed here. The Impact type is listed in parenthesis after each statement.

1. The research conducted through my award has enabled me to leverage international funding through industry/collaborative research [Economic and Commercial, International]
2. The research conducted through my award has resulted in the start or expansion of a company which has resulted in the creation of high value jobs [Economic and Commercial]
3. The research conducted through my award has attracted developing and nurturing businesses [Economic and Commercial]
4. The research conducted through my award has attracted international scientists and talented people [Human Capacity; International Engagement] 
5. The research conducted through my award has resulted in a new policy being implemented and/or an improvement to the delivery of a public service [Public Policy and Services] 
6. The research conducted through my award has enhanced the quality of life and health of Irish citizens [Health & Wellbeing, Societal Impact]  
7. The research conducted through my award has improved the environment and/or the sustainable relationship between society, industry and the environment [Environmental Impact] 
8. The research conducted through my award has increased the knowledge, appreciation and understanding of science, engineering and technology amongst the general public. The research conducted through my award has developed the country’s international reputation [Societal Impact, International Engagement] 
9. The research conducted through my award has resulted in the creation of employment through directly influencing and inspiring the future workforce and/or the production of a highly educated and relevant workforce in demand by industry and academia [Human Capacity, Economic and Commercial]
10. The research conducted through my award has impacted in other areas not reflected in the choices provided, for example by enhancing the creative output of Irish citizens [Environmental, Professional Services, Societal] 
11. The research conducted through my award has not yet realised any significant Impact

Mid-term programme progress review

Many of SFI’s awards, in particular awards of scale and Investigator-led awards, are subject to a mid-term programme progress review. International experts in the relevant discipline, including those with expertise in relevant areas of industry, commercialisation and translation, are required to evaluate the progress being made against the original Impact Statement as submitted in the funded proposal. There is specific guidance provided to direct the reviewers to ‘score’ with reference to indicators of impact, as defined by SFI, and not simply to ‘rate’ the outputs on the award, some of which may have little relevance to impact. Furthermore, all Research Centre awards are asked to provide targets for specific outputs which are considered in direct support of delivering Impact. These are examined internally by SFI staff, and used to gauge progress and report on their progress to the SFI Executive and Board, and our parent department.

Programmatic evaluation

Programme evaluation is a critical process towards ensuring that the mechanisms for providing funding are aligned with the relevant strategy du jour, with particular focus on delivering scientific excellence and impact. Specifically, data collated for the annual stocktake of SFI Research Outputs (formerly referred to as the SFI Census) and collected in the annual reporting process are used to support detailed programmatic evaluations. This ensures that the success of a particular programme in delivering against its original objectives and the collective metrics gathered in support of Key Performance Indicators (KPIs) as defined in SFI’s Agenda 2020, can be determined. Furthermore, the associated narrative in support of the metrics gathered (typically found in the annual report) can be used to provide case studies and additional context to this data. This is particularly important for scenarios where rationale in support of impacts arising from specific programmatic activities is required to be articulated to our parent department as justification for the investment made.

The information on SFI’s Research Impact webpages is a collection of knowledge and experience from a variety of sources; SFI would like to acknowledge the Small Advanced Economies Initiative, the Economic and Social Research Council UK (ESRC), the European Science Foundation (ESF), the European Commission, and the SFI research community and stakeholders for material used to build our impact knowledge base.

• Small Advanced Economies Initiative - Broadening the Scope of Impact: Defining, assessing and measuring the impact of major public research programmes
• Economic and Social Research Council Impact Toolkit
• European Commission Impact Assessment Guidelines
• European Science Foundation report on Impact Assessment

Case studies are not impact statements. They are examples of the impact possible after years of investment. The Case Studies showcase longer-term impact generated from the scientific research community. Society reaps many benefits from excellent research, some of which occur immediately, while others develop over years or generations. This repository of Case Studies will show examples from a wide spectrum of endeavour over a wide range of impact categories - Economic and Commercial, Societal, Health and Wellbeing, Environmental, International Engagement, Human Capacity, Public Policy, Services and Regulation and Professional Services.

Each case study will outline how a researcher or group used their knowledge and research ideas to help change the world. Each one will contain the challenge the researcher faced, the response of the researcher to that challenge, the engagement they had with other academics, industry and/or agencies, the impact generated from their work and the next steps they plan to take. 

• Significant Breakthrough in Battery Technology
• Transforming ICT Education in Ireland
• World-First Graphene Innovation

Each year the Irish Government spends a significant amount of public funds on scientific research, training and development. As with all public spending it is both desirable and necessary to show value for money and within this to demonstrate and articulate the economic, social and cultural benefits of scientific research projects to the wider society.

The following webinar is designed to assist applicants to SFI Programme calls in formulating their impact statement. Impact can be described as the “demonstrable contribution that excellent research makes to society and the economy”. Scientific excellence of both the applicant(s) and the research programme is both necessary and paramount, but is not sufficient; applicants must also demonstrate the potential impact arising as a result of the programme of research.

Applicants are asked to give thoughtful consideration in relation to how the proposed research will deliver impact with emphasis on the pathways to impact as well as the milestones and deliverables within the project duration and beyond. We hope that this impact webinar will be a useful resource when planning your impact statement as part of an application to an SFI programme.

View the SFI Research Impact webinar on YouTube here

View PDF of the SFI Impact Webinar here.