These resources provide useful guidance on evaluation, information on aspects of evaluating cross-agency initiatives, and examples of evaluations of cross-agency initiatives
Guidance on evaluation
Australasian Evaluation Society. (2013). ‘Guidelines for the Ethical Conduct of Evaluations’. Retrieved from Code of ethics, Guidelines for the Ethical Conduct of Evaluations — Australian Evaluation Society
Better Evaluation (2014). ‘Rainbow Framework’. Retrieved from Rainbow Framework — Better Evaluation
Superu, & ANZEA. (2016). ‘Evaluation Standards for Aotearoa New Zealand’. Retrieved from Evaluation Standards for Aotearoa New Zealand — Better Evaluation
Better Evaluation. (n.d.). ‘Contribution Analysis’. Retrieved from Contribution Analysis — Better Evaluation
Mayne, J. (2008). ‘Contribution analysis: an approach to exploring cause and effect. Institutional Learning and Change Brief, 1–4’. Retrieved from Contribution Analysis: An approach to exploring cause and effect — Better Evaluation
Social Wellbeing Agency. (various). ‘Guidance’. Retrieved from Guidance — Social Wellbeing Agency
The Treasury. (2016). The Treasury’s CBAx Tool. Retrieved from The Treasury's CBAx Tool— The Treasury
Information on aspects of evaluating cross-agency initiatives
Buffardi, A. L., & Hearn, S. (2015). ‘Multi-project programmes. Functions, forms and implications for evaluation and learning’. Retrieved from Multi-project programmes: functions, forms and implications for evaluation and learning — ODI: Think change
Kania, J, and Kramer, M.R. (2011). ‘Collective impact.’ Retrieved from Collective Impact — Stanford Social Innovation Review 69(Winter): 36–41.
Mackenzie, J., & Hearn, S. (2016). ‘Impact evaluation for portfolio programmes on policy influence’. Retrieved from Impact evaluation for portfolio programmes on policy influence — ODI: Think change
Ógáin, E. N., Svistak, M., & de Las Casas, L. (2013). ‘Blueprint for shared measurement: Developing, designing and implementing shared approaches to impact measurement’. Retrieved from Blueprint for shared measurement — NPC
Preskill, H. Parkhurst, M. Juster, M. (2014). ‘Guide to Evaluating Collective Impact 03. Supplement: Sample Questions, Outcomes, and Indicators’. Retrieved from Guide to Evaluating Collective Impact — FSG
Preskill, Hallie, Parkhurst, M., Splansky Juster, J. (2014). ‘Guide to Evaluating Collective Impact 01. Learning and Evaluation in the Collective Impact Context’. Retrieved from Guide to Evaluating Collective Impact — FSG
Preskill, H., Parkhurst, M., & Splansky Juster, J. (2014). ‘Guide to Evaluating Collective Impact 02. Assessing Progress and Impact’. Retrieved from Guide to Evaluating Collective Impact — FSG
Productivity Commission. (2021). ‘Together alone: A review of joined-up social services'. Retrieved from Together alone: A review of joined-up social services — Productivity Commission
UN Evaluation Group Task Force on Joint Evaluation. (2013). ‘Resource Pack on Joint Evaluations’. Retrieved from Detail of Resource Pack on Joint Evaluations — United Nations Evaluation Group
Examples of evaluations of cross-agency initiatives
Family violence and sexual violence (New Zealand)
Controller and Auditor-General. (2021). ‘Working in new ways to address family violence and sexual violence’. Retrieved from Working in new ways to address family violence and sexual violence — Office of the Auditor-General New Zealand
Ministry of Social Development. (2019). ‘E Tū Whānau Mahere Rautaki: Framework for Change’. Retrieved from E Tū Whānau Mahere Rautaki — Framework for Change 2019–2023 — Ministry of Social Development
Mossman, E. (2019) ‘Evaluation of the family violence Integrated Safety Response pilot Phase II – Years 2 & 3’. Retrieved from Final report: Evaluation of the family violence Integrated Safety Response pilot, Phase II – Years 2 & 3 — Ministry of Justice
Wehipeihana, N. (2019). ‘What’s working for Māori? A Kaupapa Māori perspective on the responsiveness of the Integrated Safety Response pilot to Māori Synthesis Evaluation Report’. Retrieved from What’s working for Māori? A Kaupapa Māori perspective on the responsiveness of the Integrated Safety Response pilot to Māori Synthesis Evaluation Report — Ministry of Justice
Place-based initiatives (New Zealand)
Smith, Liz, Lamb-Yorski, Rachael et al (2019). ‘Implementation and emerging outcomes evaluation of the Place-Based Initiatives’. Retrieved from Implementation and emerging outcomes evaluation of the Place-Based Initiatives — Social Wellbeing Agency
Smith, Liz, et al. (2020). ‘Success frameworks for Place-Based Initiatives: Design and toolkit’ Retrieved from Success frameworks for Place-Based Initiatives: Design and toolkit — Social Wellbeing Agency
Healthy Housing Programme (New Zealand)
Baker, M., Zhang, J., Keall, M., & Howden-Chapman, P. (2011). ‘Health Impacts of the Healthy Housing Programme on Housing New Zealand Tenants: 2004-2007’. Wellington: He Kainga Oranga/Housing and Health Research Programme, University of Otago, (April), 2004–2008. Retrieved from Measuring the wellbeing impacts of public policy: social housing — Social Wellbeing Agency
Clinton, D. J., Mcduff, I., Bullen, D. C., Prof, A., Kearns, R., & Mahony, F. (2005). ‘The Healthy Housing Programme: Report of the Outcomes Evaluation (Year One) ISBN 0-477-10016-3’. Retrieved from Healthy Housing Evaluation (Year One) August 2005 — Social Wellbeing Agency
Clinton, J., Mahony, F., Irvine, R., Bullen, C., & Kearns, P. R. (2006). ‘The Healthy Housing Programme : Report of the Outcomes Evaluation (Year Two) Prepared for: Housing New Zealand Corporation’. Retrieved from Healthy Housing Evaluation (Year Two) Sept 2006 — Social Wellbeing Agency
Housing New Zealand. (2007). ‘The healthy housing programme outcomes evaluation’. Retrieved from Healthy Housing Evaluation (Year Three) July 2007 — Social Wellbeing Agency
Partnership Arrangement for Customs Sector development in the Pacific and Timor Leste (New Zealand)
Sapere. (2016). ‘Evaluation of the Partnership Arrangement for Customs Sector development in the Pacific and Timor Leste’. Retrieved from Sapere Evaluation of the Partnership Arrangement for Customs sector development in the Pacific and Timor Leste — Sapere
Better Public Services performance targets (New Zealand)
Scott, R., & Boyd, R. (2017). ‘Interagency Performance Targets. A Case Study of New Zealand’s Results Programme’. Retrieved from Interagency Performance Targets: A Case Study of New Zealand’s Results Programme | IBM Center for The Business of Government
Children’s Teams (New Zealand)
Superu. (2014). ‘Assessment of the Design and Implementation of the Children’s Teams to January 2014’. Retrieved from Assessment of the Design and Implementation of the Children's Teams to January 2014 — Social Wellbeing Agency
Youth Mental Health Project (New Zealand)
Superu. (2015). ‘Youth Mental Health Project: Formative evaluation report’. Retrieved from Youth Mental Health Project: Formative Evaluation Report Summary — Social Wellbeing Agency
Superu. (2016). ‘The Prime Minister’s Youth Mental Health Project. Summative evaluation report’. Retrieved from The Prime Minister’s Youth Mental Health Project: Summative Evaluation Report — Social Wellbeing Agency
Social Sector Trials (New Zealand)
The Centre for Social Research and Evaluation. (2013). ‘Final Evaluation Report Social Sector Trials —Trialling New Approaches to Social Sector Change’. Retrieved from Final Evaluation: Social Sector Trials – Trialling New Approaches to Social Sector Change - Ministry of Social Development
Non-NZ examples
Ford, Chris and Mason, Katy. (2018).’The Open Innovation Team: An Independent Evaluation of a Cabinet Office Initiative’. Retrieved from Full report: Independent evaluation of the Cabinet Office Open Innovation Team - December 2018 — Lancaster University
Murray, K., Mcguinness, P., Burman, M., & McVie, S. (2015). ‘Evaluation of the Whole System Approach to Young People Who Offend in Scotland’. Retrieved from Whole system approach to young people who offend: evaluation — Scottish Government
Nies, Henk et al. (2021). ‘A Decade of Lessons Learned from Integration Strategies in the Netherlands’. Retrieved from A Decade of Lessons Learned from Integration Strategies in the Netherlands — Integrated Journal of Integrated Care
OECD Observatory of Public Sector Innovation. (2017). ‘Working with Change: Systems approaches to public sector challenges’. Retrieved from Systems Approaches — OECD
System architecture and design
Appropriate structures, strong governance and clear accountability help the Public Service and wider public sector organisations to work together to deliver better outcomes for the public.