MONITORING AND EVALUATION

Developing monitoring and evaluation systems, and bringing together and interpreting a range of evidence, are key areas of our work. Recent examples include:

Project: Establishment of evaluation process and framework for BIG Lottery funded Play England initiative
Client: National Children's Bureau (NCB)
Dates: 2007-08

Play England is one component of a three-pronged 5-year initiative funded by the BIG Lottery to promote access to free, local, inclusive, and creative play provision for all children in England. The objective of the Play England component, managed under the National Children's Bureau, was to develop and provide a regionally based infrastructure support network with the necessary expertise to support local agencies involved in the children's play arena.

Care Equation were engaged to set up the external evaluation structure and mechanisms for Play England, and undertake initial evaluation activities, while the NCB evaluation team was being recruited.

Client feedback:

It was a relief to be able to leave this complex piece of work in such capable hands! I was very impressed with the calm and determined way you set about getting this project into shape, managing both tasks and people in a thoroughly competent and professional manner.

Project: Analysis of consultation responses on New Outcomes Framework for performance assessment of adult social care
Client: Commission for Social Care Inspection (CSCI)
Dates: 2006-07

In August 2006 CSCI issued a consultation document inviting comments on proposals for a new outcomes framework for performance assessment of adult social care 2006-07. The consultation elicited a number of responses from councils with adult social care responsibilities, other public sector bodies, private and voluntary sector organisations, and professional groups. Care Equation analysed these responses and presented the analysis in a report which then formed the basis for adjustments to the proposals. Care Equation also undertook the analysis of subsequent consultation on proposals for the population of the evidence base, against which judgements on performance on individual outcomes would be made.

Client feedback:

I have found working with both of you very easy. We set the scope for the work and the end product from you is of the highest quality. Your knowledge of the policy area helped because it means that you have both been able to apply lots more initiative in handling the responses without needing to refer back to us.

The daily charge for your time is very favourable. Coupled with the quality of the work and delivering to time means that we get value for money.

Project: Performance Assessment Framework
Client: Department of Health
Dates: 1999-2007

The social services performance assessment framework has developed rapidly since 1999. Over this period Care Equation has provided regular support to the Department of Health and subsequently the Commission for Social Care Inspection (CSCI), including development work in the early stages, analyses of monitoring information from local councils, identification of key messages at national and regional level and national overview reports. We have also contributed to training programmes on assessing performance evidence for SSI Inspectors and other Department staff by undertaking training needs analyses and developing a range of interactive training material.

Client feedback:

We have come to rely heavily on Care Equation's input to our performance development work and greatly appreciate the professionalism and commitment that you bring to this complex area of work, often in the face of challenging time scales. But perhaps the most important contribution you have made is through your enabling approach, and the longer term benefits to our team that have flowed from this.

See also Training and Workshops

Project: Designing a common data set for Macmillan services
Client: Macmillan Cancer Relief
Dates: 2005-06

Macmillan Cancer Relief provides a wide range of services, including personal care and support, financial support, information and advice, and support for self help. The aim of the project was to improve information on the number and types of people helped through the various services by providing an initial baseline and developing a common data set for future monitoring. An overriding consideration was to keep the data set manageable and to build on information already collected for operational purposes. The data set we developed will provide information on who is accessing services, what type and level of support they get, when they get it and with what outcomes.

Client feedback:

Our experience of working with Care Equation has been excellent and we look forward to working with you again in the future

Project: Ethnicity Monitoring Action Plans
Clients: Barking & Dagenham PCT, Havering PCT
Dates: 2003, 2004

Targets for development of ethnic monitoring in primary care have been set by London Strategic Health Authorities. We worked with GP practices and with directly provided health services in North East London to develop action plans which would ensure implementation of these targets over a three year period. The work included awareness raising among relevant staff groups, identification of support needs and agreement of detailed action plans.

The main support needs identified by staff were training, including awareness of the purpose of ethnic monitoring and how to explain this to patients, understanding of ethnic categories, the principle of self-classification, and policies and procedures; adjustments to IT systems; and documentation and publicity. The experience of services undertaking monitoring to date has been that patients have no objections to being asked questions about their ethnicity, provided that they understand the reasons for the question, and that providing the information is entirely voluntary.

Project: Evaluation of Learning Partnership
Client: Brighton and Hove Learning Partnership
Dates: 2003

The Brighton & Hove Learning Partnership was established to develop a culture of learning in Brighton & Hove through the co-ordination of, and widening of access to, high quality, effective post-16 education and training.

Care Equation was commissioned to assess the perceived effectiveness of the Learning Partnership and to advise on ongoing monitoring and evaluation. The evaluation included a structured questionnaire to all partnership members followed by detailed discussions with key informants.

The evaluation showed that overall the Partnership has added value in promoting collaboration among providers by engaging a wide range of stakeholders, networking, sharing information and good practice and in reaching a better understanding of the needs of learners.