Review of 'Decarbonising Existing Homes in Wales: A Participatory Behavioural Systems Mapping Approach'

Summary of paper: this paper describes how a systems mapping approach which built an additional behavioural and actor focus into causal systems mapping was used to inform national policy recommendations for making existing homes in Wales more energy-efficient.

Summary of review: The paper is very clear and well-written, and is well embedded in the literature and policy debates. It presents an interesting and ambitious project, which clearly took a lot of hard work and thinking. The findings and discussion are interesting, and there are some honest and refreshing reflections. I felt there was an under-discussion of some key methodological elements, for example there was not enough discussion of whether systems and behavioural approaches are complements or alternatives, and there was no obvious analysis or deeper use of the map beyond creating it and interpreting it in a generic way. Overall, I felt the paper, despite these criticisms, was strong and a welcome addition to the literature in these domains.

Detailed comments:

• Abstract
  • Clear and well-written
  • The abstract could hint more at the connection of behavioural and systems worldviews – it reads as if these are natural companions, but to me it is more intuitive to think of them as alternatives (e.g. many systems thinkers are critical of the narrow focus of behavioural approaches). This comes out in the introduction a bit, but is missing in the abstract.
• Introduction
  • I would ideally like more discussion of the tension between behaviour and systems approaches – the critiques they make of each other, and whether they can fit neatly together. I think they can, but it warrants more consideration.
• Participatory Approaches to Systems Mapping
  • It would be helpful to acknowledge the distinction between complexity approaches and systems thinking here I think. ABM in particular, and arguably network analysis too, come more from a complexity science/theory angle than systems thinking. I think it is fine to lump them together in general, but I would acknowledge this distinction here.
  • There is some unfortunate duplication of the use of the term ‘Participatory Systems Mapping’ in the literature – it would be helpful to explain the difference between Artunes et al and Barbrook-Johnson and Penn more clearly. My understanding is that Artunes et al is causal loop diagrams, whereas Barbrook-Johnson and Penn is more like fuzzy cognitive mapping but using network analysis for analysis, not turning the map into a simulation. The paper skims over these nuances too quickly.
  • It would be helpful to make clearer the real difference between (i) the method used/developed here and (ii) annotated versions of causal loop diagrams or the PSM proposed by Barbrook-Johnson and Penn. In the early text of the paper, it seems like there is a big difference, but it is a little vague, then when you see the maps in results, it looks like an annotated causal loop diagram. More commentary on how this is helpful, but also the issues it introduces would be beneficial too.
• Process
  • Was any analysis of the maps done – how were the maps interpreted with and without stakeholders?
  • The researchers take a lot of control of the process, refining and merging maps, and asking stakeholders to build simple versions. Could you comment on any bias or shifts in focus this brought, if any?
• Discussion
  • Very clear discussion, and nice connection to policy process and behavioural framework.
  • Refreshing and good to see honest reflections in imperfections in the process/method.