01 August 2022

These resources provide useful guidance on evaluation, information on aspects of evaluating cross-agency initiatives, and examples of evaluations of cross-agency initiatives

Guidance on evaluation

Australasian Evaluation Society. (2013). ‘Guidelines for the Ethical Conduct of Evaluations’. Retrieved from Code of ethics, Guidelines for the Ethical Conduct of Evaluations — Australian Evaluation Society

Better Evaluation (2014). ‘Rainbow Framework’. Retrieved from Rainbow Framework — Better Evaluation

Superu, & ANZEA. (2016). ‘Evaluation Standards for Aotearoa New Zealand’. Retrieved from Evaluation Standards for Aotearoa New Zealand — Better Evaluation

Better Evaluation. (n.d.). ‘Contribution Analysis’. Retrieved from Contribution Analysis — Better Evaluation

Mayne, J. (2008). ‘Contribution analysis: an approach to exploring cause and effect. Institutional Learning and Change Brief, 1–4’. Retrieved from Contribution Analysis: An approach to exploring cause and effect — Better Evaluation

Social Wellbeing Agency. (various). ‘Guidance’. Retrieved from Guidance — Social Wellbeing Agency

The Treasury. (2016). The Treasury’s CBAx Tool. Retrieved from The Treasury's CBAx Tool— The Treasury 

Information on aspects of evaluating cross-agency initiatives

Buffardi, A. L., & Hearn, S. (2015). ‘Multi-project programmes. Functions, forms and implications for evaluation and learning’. Retrieved from Multi-project programmes: functions, forms and implications for evaluation and learning — ODI: Think change

Kania, J, and Kramer, M.R. (2011). ‘Collective impact.’ Retrieved from Collective Impact — Stanford Social Innovation Review 69(Winter): 36–41.

Mackenzie, J., & Hearn, S. (2016). ‘Impact evaluation for portfolio programmes on policy influence’. Retrieved from Impact evaluation for portfolio programmes on policy influence — ODI: Think change

Ógáin, E. N., Svistak, M., & de Las Casas, L. (2013). ‘Blueprint for shared measurement: Developing, designing and implementing shared approaches to impact measurement’. Retrieved from Blueprint for shared measurement — NPC

Preskill, H. Parkhurst, M. Juster, M. (2014). ‘Guide to Evaluating Collective Impact 03. Supplement: Sample Questions, Outcomes, and Indicators’. Retrieved from Guide to Evaluating Collective Impact — FSG

Preskill, Hallie, Parkhurst, M., Splansky Juster, J. (2014). ‘Guide to Evaluating Collective Impact 01. Learning and Evaluation in the Collective Impact Context’. Retrieved from Guide to Evaluating Collective Impact — FSG

Preskill, H., Parkhurst, M., & Splansky Juster, J. (2014). ‘Guide to Evaluating Collective Impact 02. Assessing Progress and Impact’. Retrieved from Guide to Evaluating Collective Impact — FSG

Productivity Commission. (2021).  ‘Together alone: A review of joined-up social services'. Retrieved from Together alone: A review of joined-up social services — Productivity Commission   

UN Evaluation Group Task Force on Joint Evaluation. (2013). ‘Resource Pack on Joint Evaluations’. Retrieved from Detail of Resource Pack on Joint Evaluations — United Nations Evaluation Group

Examples of evaluations of cross-agency initiatives

Family violence and sexual violence (New Zealand)

Controller and Auditor-General. (2021).  ‘Working in new ways to address family violence and sexual violence’. Retrieved from Working in new ways to address family violence and sexual violence — Office of the Auditor-General New Zealand

Ministry of Social Development. (2019).  ‘E Tū Whānau Mahere Rautaki: Framework for Change’. Retrieved from E Tū Whānau Mahere Rautaki — Framework for Change 2019–2023 — Ministry of Social Development

Mossman, E. (2019) ‘Evaluation of the family violence Integrated Safety Response pilot Phase II – Years 2 & 3’.  Retrieved from  Final report: Evaluation of the family violence Integrated Safety Response pilot, Phase II – Years 2 & 3  — Ministry of Justice

Wehipeihana, N. (2019). ‘What’s working for Māori? A Kaupapa Māori perspective on the responsiveness of the Integrated Safety Response pilot to Māori Synthesis Evaluation Report’.  Retrieved from What’s working for Māori? A Kaupapa Māori perspective on the responsiveness of the Integrated Safety Response pilot to Māori Synthesis Evaluation Report — Ministry of Justice

Place-based initiatives (New Zealand)

Smith, Liz, Lamb-Yorski, Rachael et al (2019). ‘Implementation and emerging outcomes evaluation of the Place-Based Initiatives. Retrieved from Implementation and emerging outcomes evaluation of the Place-Based Initiatives — Social Wellbeing Agency

Smith, Liz, et al. (2020). ‘Success frameworks for Place-Based Initiatives: Design and toolkit Retrieved from Success frameworks for Place-Based Initiatives: Design and toolkit — Social Wellbeing Agency

Healthy Housing Programme (New Zealand)

Baker, M., Zhang, J., Keall, M., & Howden-Chapman, P. (2011). ‘Health Impacts of the Healthy Housing Programme on Housing New Zealand Tenants: 2004-2007’. Wellington: He Kainga Oranga/Housing and Health Research Programme, University of Otago, (April), 2004–2008. Retrieved from Measuring the wellbeing impacts of public policy: social housing — Social Wellbeing Agency

Clinton, D. J., Mcduff, I., Bullen, D. C., Prof, A., Kearns, R., & Mahony, F. (2005). ‘The Healthy Housing Programme: Report of the Outcomes Evaluation (Year One) ISBN 0-477-10016-3’. Retrieved from Healthy Housing Evaluation (Year One) August 2005 — Social Wellbeing Agency

Clinton, J., Mahony, F., Irvine, R., Bullen, C., & Kearns, P. R. (2006). ‘The Healthy Housing Programme : Report of the Outcomes Evaluation (Year Two) Prepared for: Housing New Zealand Corporation’. Retrieved from Healthy Housing Evaluation (Year Two) Sept 2006 — Social Wellbeing Agency

Housing New Zealand. (2007). ‘The healthy housing programme outcomes evaluation’. Retrieved from Healthy Housing Evaluation (Year Three) July 2007 — Social Wellbeing Agency

Partnership Arrangement for Customs Sector development in the Pacific and Timor Leste (New Zealand)

Sapere. (2016). ‘Evaluation of the Partnership Arrangement for Customs Sector development in the Pacific and Timor Leste’. Retrieved from Sapere Evaluation of the Partnership Arrangement for Customs sector development in the Pacific and Timor Leste — Sapere

Better Public Services performance targets (New Zealand)

Scott, R., & Boyd, R. (2017). ‘Interagency Performance Targets. A Case Study of New Zealand’s Results Programme’. Retrieved from Interagency Performance Targets: A Case Study of New Zealand’s Results Programme | IBM Center for The Business of Government

Children’s Teams (New Zealand)

Superu. (2014). ‘Assessment of the Design and Implementation of the Children’s Teams to January 2014’. Retrieved from Assessment of the Design and Implementation of the Children's Teams to January 2014 — Social Wellbeing Agency 

Youth Mental Health Project (New Zealand)

Superu. (2015). ‘Youth Mental Health Project: Formative evaluation report’. Retrieved from Youth Mental Health Project: Formative Evaluation Report Summary — Social Wellbeing Agency

Superu. (2016). ‘The Prime Minister’s Youth Mental Health Project. Summative evaluation report’. Retrieved from The Prime Minister’s Youth Mental Health Project: Summative Evaluation Report — Social Wellbeing Agency 

Social Sector Trials (New Zealand)

The Centre for Social Research and Evaluation. (2013). ‘Final Evaluation Report Social Sector Trials —Trialling New Approaches to Social Sector Change’. Retrieved from Final Evaluation: Social Sector Trials – Trialling New Approaches to Social Sector Change - Ministry of Social Development

Non-NZ examples

Ford, Chris and Mason, Katy. (2018).’The Open Innovation Team: An Independent Evaluation of a Cabinet Office Initiative.  Retrieved from Full report: Independent evaluation of the Cabinet Office Open Innovation Team - December 2018 — Lancaster University 

Murray, K., Mcguinness, P., Burman, M., & McVie, S. (2015). ‘Evaluation of the Whole System Approach to Young People Who Offend in Scotland’. Retrieved from Whole system approach to young people who offend: evaluation — Scottish Government

Nies, Henk et al. (2021). ‘A Decade of Lessons Learned from Integration Strategies in the Netherlands.  Retrieved from A Decade of Lessons Learned from Integration Strategies in the Netherlands — Integrated Journal of Integrated Care

OECD Observatory of Public Sector Innovation. (2017). ‘Working with Change: Systems approaches to public sector challenges. Retrieved from Systems Approaches — OECD

System architecture and design

Appropriate structures, strong governance and clear accountability help the Public Service and wider public sector organisations to work together to deliver better outcomes for the public. 

Read more