Niall Kerr Archives | ClimateXChange

This report reviews the scholarly literature and case study data regarding the role of public sector agencies in accelerating technological innovation. The aim is to inform heat decarbonisation policy discussions in Scotland, and the developing plans for a Scottish ‘low-carbon heat hub’.

The report is split into three main sections: design principles for innovation agencies; types of innovation agencies; and specific activities of innovation agencies.

Themes and conclusions

Persistent issues relevant to the Scottish policy discussion surrounding innovation agencies and energy sector transition heat decarbonisation are:

The limits of general classification: the importance of tailoring an innovation agency to meet the particular policy goals, and the strengths and weaknesses of a given region.
The need for a system-wide approach: while the design and function of a specific agency is important, it is vital to consider their complementary role within a wider innovation system
The tension between autonomy and embeddedness: the need to consider the effect that close linkages between innovation agencies and public and private sectors can have on institutional autonomy, and the impact this can have on the balance between urgent policy implementation goals and more emergent and perhaps radical long-term innovations.

The report is split into three main sections: design principles for innovation agencies; types of innovation agencies; and specific activities of innovation agencies.

Themes and conclusions

Persistent issues relevant to the Scottish policy discussion surrounding innovation agencies and energy sector transition heat decarbonisation are:

The limits of general classification: the importance of tailoring an innovation agency to meet the particular policy goals, and the strengths and weaknesses of a given region.
The need for a system-wide approach: while the design and function of a specific agency is important, it is vital to consider their complementary role within a wider innovation system
The tension between autonomy and embeddedness: the need to consider the effect that close linkages between innovation agencies and public and private sectors can have on institutional autonomy, and the impact this can have on the balance between urgent policy implementation goals and more emergent and perhaps radical long-term innovations.

In order to achieve Scotland’s net-zero target, a low-carbon heating system will be required in virtually every property in Scotland by 2045. This is a significant policy and technological challenge.

This report seeks to inform the design of policy for the phase-out of fossil fuel heating by reviewing relevant historical and ongoing experiences of technology phase-out policy, and, by extension, phase-in, in the energy sector.

The case studies reviewed include natural gas grids, personal transport, electricity supply, electricity metering, transport biofuels and condensing boilers.

Key findings

Major infrastructure transitions, such as gas grid repurposing, necessarily rely on an area-based approach rather than individual decision-making. Transitions in off-grid heating, by contrast, may involve individual household decision-making at the point of replacement.
As is being seen in the transport sector, some phase-outs are driven by proactive supply side policies and international market competition. Close collaboration between government and businesses were also seen.
Hybrid technologies, such as hybrid gas and electric heat pumps, are appealing ways of ameliorating the effects of phase-out because they offer less disruptive and perhaps more affordable solutions.
A number of cases reviewed highlight the importance of how policy decisions are justified and communicated, suggesting careful attention as to how heat decarbonisation policy is developed and presented.

European countries vary greatly in terms of how residential buildings are heated. These differences, built up over decades, reflect national resource endowments, economic resources and technical infrastructures. They also reflect different governance approaches and policy choices.

In this report, we review the heating technologies and heat policies of nine European countries: the UK (with a focus on Scotland), the Netherlands, Norway, Sweden, Finland, Denmark, France, Germany and Ireland). We assess how government policy has been used to change the way heat has been delivered, and current approaches to policy-driven heat decarbonisation. We set out in detail the policy instruments – financial incentives, regulations and tax structures – that are used to drive countries toward zero-carbon heating. Where available, we also present information on how each country is developing policies and targets for the decarbonisation of heating.

Ruth Bush and Niall Kerr, ClimateXChange Research Fellows looking at retrofit policy in Scotland, set out lessons on how evaluation can play a role in helping Scotland to meet its climate targets.

The Energy Efficient Scotland Route Map was launched in May 2018, setting out the Scottish Government’s plans for large-scale energy efficient retrofit of Scotland’s building stock alongside heat decarbonisation. Chapter 7 of the route map details plans to establish a monitoring and evaluation framework that will demonstrate the programme’s progress and “will allow [Scottish Government] to adapt and flex the programme where necessary”.

As ClimateXChange Research Fellows we use different types of evaluation to inform energy efficiency policy in Scotland. Experiences in our projects offer lessons about how to ensure evaluation can play a meaningful role in helping Scotland to meet its climate targets in the future.

At the European Environmental Evaluators Forum (EEEN) conference at the end of 2017 we came together with environmental agencies, consultancies and academic colleagues from across Europe to hear how other countries are using evaluation in policy development and to discuss Scotland’s approach.

From left to right: University of Edinburgh researchers Ruth Bush and Niall Kerr, Jack Causley from Scottish Government and Mark Winskel a Chancellor’s Fellow at UoE and the session chair at the EEEN.

Evaluation approaches

Niall Kerr’s research:

Evidence use in energy policy-making: decision making under social, technological and political uncertainty
Systematic evidence reviews: systematically and transparently gathering potentially contradictory evidence
Multiple criteria for policy effectiveness: efficient, equity and institutional fit
Dedicated method of energy policy effectiveness in Scotland
Pilot evidence review findings: encouraging households to invest in home energy efficient retrofit

Ruth Bush’s research:

Learning lessons from local pilot projects, led by local authorities delivering energy efficiency retrofit in domestic and non-domestic buildings
Using social surveys: To understand investment drivers and barriers in different contexts
In-depth interviews: to understand programme design and management approaches
Building capacity amongst local authorities – Sharing lessons from local pilots with other local authorities and Scottish Government

The importance of embedding a culture of evaluation into policy and delivery.

As retrofit programmes start to focus on some of the more challenging areas of energy retrofit like private non-domestic buildings, or moving away from gas central heating, we’re not going to get things right first time.

Embedding this type of learning culture takes time. Starting this process of embedding culture of evaluation at national and local levels will help us to innovate and learn from when things go wrong.

In the local SEEP pilots, many of the pilot leads had little or no experience of evaluation. They were in charge of coordinating technical monitoring and survey data collection within their projects, and we did training and workshops to develop a way of working that would deliver good quality and consistent data that would allow us to compare across the projects as well as draw local lessons.

The pilot leads now have a much more developed understanding of evaluation; not only about how to make the practicalities of data collection work, but also about what they can learn to help their own work.

Whilst the process of national policy decision-making may be unpredictable, many of the findings from a systematic evidence review are likely to have relevance over medium to long-term time periods. Reviewing multiple sources of evidence on a particular topic in energy policy entails summarising the most relevant details often from a mix of qualitative and quantitative sources. Inevitably some detail from the reviewed sources will be excluded. Whilst seeking to offer insight by identifying trends in the assembled evidence our reviews will also act as something of a reference document for those interested in the details of the policy question.

For readers that have a particular interest in a sub-section of the review the gathered evidence will allow an initial introduction to a potentially much more comprehensive evidence base. Building a consolidated knowledge base on the particularly complex issues of energy system transition is critical so that lessons are learned from historical and international policies.

The importance of the timing of evaluation?

Policy processes don’t wait for pilot projects to finish and outcomes of an evaluation to be published. It was important for our evaluation team to create opportunities to feedback what we were learning to Scottish Government and local authorities on the local pilots on an on-going basis. We did that formally through interim reports, but also held workshops with everyone involved and facilitated discussions on key emerging themes from our data. National policy makers could get a more in-depth insight into how delivery was working at the local level, and they also provided an opportunity for local authorities and their partners to exchange experiences and learn from one another.

An on-going relationship is important to making sure the evaluation is contributing to delivery and policy processes – no matter the speed of policy development.

Systematic evidence reviews do involve a trade-off between the rigour of evidence examination and the length of time taken; more time means more evidence gathering and more consideration of potentially complex and contradictory findings. Policy decisions are, however, often made in an unpredictable and dynamic environment. This mismatch has led to the use of Rapid Evidence Assessments (REA) for energy policy. REAs are designed to apply a comprehensive and un-biased approach to evidence gathering, and are intended to take place over a relatively brief, roughly 6-month period. Certain policy questions may be suitable to longer reviews of 12 months or more, while shorter scoping reviews of around 1 month can be applied to more urgent issues. Our project intends to trial different lengths of evidence review throughout the energy policy effectiveness project.

Presentations and more information about the EEEN Forum 2017 can be found on the European Environment Agency Website: https://www.eea.europa.eu/themes/policy/events/eeen2017/6th-european-environmental-evaluators-network-forum

This report is an introduction to the issue of effective government policy with respect to energy efficient retrofit in the private rental sector, and to some of the evidence that relates to the topic. It is intended to be relevant to both the development of energy retrofit policy in the private rental sector in Scotland, and to anyone with a general interest in the topic.

It contains background information on the private rental sector and energy use in Scotland, and on the existing approach to government policy in this area, both in Scotland and across the UK. It follows this with a summary of some of the evidence on the issue from the academic and non-academic sources that were gathered for this scoping report.

Like the owner-occupier sector, policy interventions in the PRS are complicated by the level of actors that need to be addressed i.e. many thousands of individual landlords and tenants. Alongside this, the difficulty which is most commonly cited in the literature reviewed in this report is that of a split incentive between those who are most liable to pay the costs of energy retrofit – the property owners – and those who will most likely reap the benefits – the property occupants.