News - COLLEGE

Evaluation of ‘Audio and Music Technology Zambia’ & ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’

Evaluation of ‘Audio and Music Technology Zambia’ & ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’

Download this page in PDF format

Terms of Reference

January 2025

Acronyms

*BCFE: During the lifetime of the projects detailed in this document BCFE was rebranded as ‘BCFE, City of Dublin FET College, Ballyfermot Road, Southwest Campus’. For the purposes of this document BCFE will be used to reference the college.

1. Outline

City of Dublin ETB is seeking a consultant to conduct an evaluation of two sequential partnership projects between BCFE and EHC, in collaboration with TEVETA:

1. ‘Audio & Music Technology – Supporting Vocational Education and the Creative Economy in Zambia’
2. ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’

These projects aimed to develop Zambia’s first Audio and Music Technology Diploma and introduce three new Diploma qualifications in Creative Music Performance, Animation, and Graphic Design.

The evaluation will independently assess the implementation, impact, and sustainability of these initiatives, examining:

• Project design, coherence, and relevance
• Effectiveness and efficiency in achieving objectives
• Impact and sustainability within Zambia’s creative economy
• Curriculum development and industry collaboration
• Gender equality and inclusion

Key evaluation questions will focus on:

• Alignment with policy frameworks
• Contributions to poverty alleviation
• Effectiveness in achieving intended goals
• Promotion of gender equality

The methodology will include document reviews, stakeholder interviews (BCFE, EHC, City of Dublin ETB, TEVETA, students, and industry representatives), and site visits to observe program operations.

The final deliverable will be a comprehensive evaluation report detailing findings, lessons learned, and recommendations for future initiatives.

2. Background

 ‘Audio & Music Technology – Supporting Vocational Education and the Creative Economy in Zambia’ and ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ are two sequential partnership projects between BCFE and EHC in collaboration with TEVETA, to develop and introduce Zambia’s first Audio and Music Technology Diploma and three new Diploma qualifications in Creative Music Performance, Animation and Graphic Design respectively. The ‘Audio and Music Technology’ project was implemented between 2019 and 2022. The ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ project’s timeline is being implemented between 2022 and 2025.

Both projects were supported by the Embassy of Ireland in Zambia and were built upon the experiences of an initial WorldWise partnership project (2011-2015), funded through the Programme of Strategic Cooporation (PSC). This project led to the development of Zambia’s first Diploma in Creative Digital Media.

International Development Consultant, Lynne Elliott, completed an evaluation of the Creative Digital Media project in 2016. Findings from the evaluation informed many of the key goals and objectives of the subsequent projects.

The overarching finding from the evaluation was that the continued success and sustainability of Creative Digital Media Zambia (CDMZ) require ongoing investment in embedding student-centered learning, supporting teaching staff, influencing vocational education policy, and building long-term partnerships with industry and government to maximise the impact of the program on education, job creation, and poverty alleviation in Zambia.

Audio and Music Technology Project Goals & Objectives

The project goals and objectives are as follows:

• To contribute to poverty alleviation through relevant innovative vocational education which supports skills development, employment and fosters the expansion of the creative economy
• To develop a three-year Diploma in Audio and Music Technology at level 6 on the Zambian National Qualifications Framework which will provide high level skills and creative education in music and audio technology which will enable graduates to contribute to the development of the music and audio industry in Zambia expand its capacity to create employment
• To strengthen the existing collaborative partnership between EHC, BCFE and TEVETA; to share knowledge, support innovative technological and creative development and be an effective partnership for change and development in line with SDG 17
• To introduce the new Diploma in Audio & Music Technology in EHC in 2020 and provide equal access for both male and female to the audio and music technology
• To develop gender sensitive information, education and communication (IEC) materials to sensitize the girl child towards technology-oriented programmes
• To build capacity among the existing members of staff in EHC in various audio and music technology skills
• To identify and procure necessary training equipment in line with the curriculum specifications in line with EHC and City of Dublin ETB procurement guideline
• To consolidate the gains of CDMZ on capacity development and system strengthening in the areas of curriculum development, teaching, assessment and course management
• To deepen links with the creative industries and with BongoHive established through CDMZ and to harness opportunities for collaboration

‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ Project Goals and Objectives

• To contribute to poverty alleviation through supporting the development of innovative vocational education which supports skills development, employment and fosters the expansion of the creative economy and to create opportunities for young people to gain the skills, knowledge and qualifications to access and benefit from the growing global creative economy.
• To support the development of further creative sector courses at level 6 on the Zambian National Qualifications Framework, strengthen the capacity for initiation and development of courses and establish a strong sustainable basis for the development of a Centre for Creative Arts in EHC.
• To work with TEVETA towards classifying EHC as a Centre of Excellence in the Creative Arts
• To strengthen the existing collaborative partnership between EHC, BCFE and TEVETA and to deepen collaboration with the creative sector in Lusaka; to share knowledge, support innovative technological and creative development and be an effective partnership for change and development in line with SDG 17.
• To showcase the potential of the creative sector, and to engage young creatives in Zambia, from both education and industry, in a highly creative collaborative action and to deepen links with the creative industries to generate interest and support for the creative sector.
• To develop three-year Diploma programmes in Creative Music Performance, Animation and Graphic Design.
• To consolidate the gains of CDMZ (Creative Digital Media Zambia) and AMT (Audio and Music Technology) projects, focusing on capacity development and system strengthening in the areas of curriculum development, teaching, assessment and course management in EHC, including a focus on the initiation of new programmes.
• To promote gender equality and access to courses and to liaise effectively with schools to promote creative sector careers as viable and fulfilling pathways for students
• To work with TEVETA on staff development in assessment in creative arts programmes and on sharing learning with TEVETA colleges throughout Zambia.

3. Purpose of the evaluation

 The purpose of the evaluation is to provide an independent assessment of the implementation of the ‘Audio & Music Technology’ and ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ projects, and the development of the Diploma programmes in Audio and Music Technology, Creative Music Performance, Animation and Graphic Design. The evaluation will help inform future collaborative projects in the creative digital arts and vocational education by identifying the successes and challenges within the project, including accountability and overall learnings. The evaluation should consider the design, impact and effectiveness of both projects as innovative collaborative projects in digital media education within the vocational education sector. It should make recommendations in relation to future cooperation which may contribute to the emerging creative sector in Zambia.

4. Audiences for the evaluation

The main audiences for the evaluation and final report will be:

1. The participating institutes
   • City of Dublin ETB
   • BCFE City of Dublin FET College, Ballyfermot Road, Southwest Campus
   • EHC
2. Irish Aid
3. Partners in Zambia
   • TEVETA
   • The Ministry of Technology and Science
4. Industry representatives and the creative community in Zambia
5. Other skills training institutions

5. Scope of evaluation

The evaluation will review the management structure and ways of working, and the lessons from the institutional model where two institutions are linked for knowledge transfer. It will also assess both projects in relation to their objectives in the context of coherence, relevance, effectiveness, efficiency, impact and sustainability. It should look at lessons learned during implementation:

• What worked well and what did not, and why?
• What new insights and understanding were gained along the way?
• What worked to promote gender equality and access to courses?
• What are the key lessons for future projects?

Key questions for the evaluation

In terms of Coherence…

• to what extent has the project been supported or undermined by other internal or external interventions/ policy/ programmes?
• Were the project activities aligned with internal and external policy frameworks or commitments (especially, for example, commitments to gender and inclusion)?
• Have other inventions helped or hindered the implementation of the project?

In terms of Relevance…

• Has the implementation of both projects been consistent with the overall purpose and objectives, as well as the intended impacts and effects of the proposals? Specifically, have the projects developed the creative diploma programmes which are relevant to the needs of young people, the emerging digital media industry and the economy in Zambia?
• Have the projects contributed, in the long-term, to poverty alleviation?
• To what extent are the courses relevant for arts and culture at the college and within the education system in Zambia?
• To what extent did industry provide input into the curriculum development process?
• To what extent did this project contribute to poverty reduction?
• Was the project timeline adequate for the achievement of the project goal?

In terms of Effectiveness…

• To what extent were the objectives of the projects achieved and what were the contributing factors?
• To what extent did the projects build an effective partnership for curriculum development in innovative programmes between BCFE, EHC and TEVETA?
• To what extent did the projects create an enabling environment for the introduction of new programmes in vocational education in Zambia.
• To what extent did the project contribute to gender equality?
• Did the project activities enable young women to benefit from project interventions?
• Were gender dynamics, and how project interventions affect young women as beneficiaries considered?
• How do the results for young women compare to those for young men?
• Was there an enrolment policy and did it ensure equality?
• Were the project results identified realistic?
• Is this for creative programmes, or more broadly all vocational training?

In terms of Efficiency…

• Were project objectives achieved on time?
• Were the projects implemented in the most efficient manner possible?
• Were the project’s activities appropriate, practical, and consistent with the objectives and expected results?
• Were problems, when they occurred, dealt with efficiently and effectively?
• What lessons were learned that would enhance efficiency in future projects?
• Are the management structures in place the right ones to deliver this type of project?
• Did the project have adequate capacity for management and implementation?
• To what extent did the project build capacity for the delivery of the three new courses?

In terms of Impact…

• What difference did the diploma in Audio and Music Technology make for students and what will the new diplomas in Creative Music Performance, Animation and Graphic Design make for students?
• How are the new programmes going to contribute to change in vocational education in Zambia?
• To what extent have the projects and the partnership with TEVETA contributed to new thinking and practice in relation to assessment?
• In case there are specific diversity and inclusion targets (e.g. gender). Did all the intended target groups benefit equally from the intervention?
• To what extent have the projects facilitated dialogue and links between education and the emerging creative industries in Lusaka?
• Has the project contributed to creating an enabling environment for further innovative programmes?
• Has the project established the basis for further work in allied areas including TV, Film, Games and Immersive Media?

In terms of Sustainability…

• Are the diplomas in Audio and Music Technology, Creative Music Performance, Animation and Graphic Design sustainable?
• Have the projects created a sustainable partnership for innovation between BCFE, EHC and TEVETA?
• How is the momentum for innovation and partnership to be sustained?
• Does sustainability include the issue of equity in participation
• To what extent did the project deepen links with the creative industries and harness opportunities for collaboration?
• To what extent did the project enhance the capacity of the college to manage similar partnerships in future?

6. Methodology

It is envisaged this evaluation will:

1. Review relevant documentation including the original ‘Audio & Music Technology’ and ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ applications, reports, results framework and other relevant documents
2. Hold interviews with key participants including:

• The Projects Management Team
• BCFE City of Dublin FET College, Ballyfermot Road, Southwest Campus
  • Senior Leadership Team
  • Teachers
• City of Dublin ETB
• Coordinators and Lecturers in Evelyn Hone College
• Students (present and past) from Diplomas in Creative Digital Media and Audio & Music Technology in EHC
• TEVETA senior managers, Heads of Curriculum Development & Assessment, Representatives from the Centre of Excellence development team
• Members of the projects Advisory Committee
• Representative from the Ministry of Technology and Science, Zambia
• Digital Media industry in Lusaka (a sample of organisations and individuals)
• Irish Aid

A four/five-day visit to Lusaka to interview key participants and to see at first hand the operation of the Diploma programmes linked to the project (including Creative Digital Media and Audio & Music Technology) is considered essential. 

7. Outputs

 The consultant(s) will produce a final report (30 pages maximum) that will include findings, analyses and key lessons from ‘Audio & Music Technology’ and ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ and recommendations for future projects in creative arts and in vocational education.

8. Evaluator profile/selection criteria

Evaluator proposals will be assessed based on the following:

• Quality of proposal including time frame (25%)
• Track record and previous evaluation experience (20%)
• Familiarity with international development, vocational education in Africa and with creative digital media (20%)
• Technical knowledge, facilitation, interviewing and reporting skills (15%)
• Professional fee (inclusive of VAT) (20%)

9. Timeframe for the Evaluation

• The evaluation will take place in February/March 2025, with delivery of the first draft on/before 7^th April 2025. The final delivery deadline is 18th April 2025.
• The ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ project completion date is 30th of April 2025. Final amendments should be made to the evaluation after 30th April 2025 to include information related to project activities in March and April 2025.

10. Terms of Contract

Payment of professional fees to include all costs related to all Travel and Subsistence to/from sites which include BCFE, City of Dublin ETB, EHC, TEVETA, the Ministry of Technology and Science, and any other locations in Zambia deemed relevant to the project (with approximately 4 days in Zambia).

Payment will be made at the end of the consultancy on production of an invoice when work is completed to the satisfaction of ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’. ‘Establishing a Centre for the Creative Arts at Evelyn Hone College’ will not be liable for payment of USC, PAYE or PRSI in respect of this consultancy. Payment of all appropriate taxes remains the responsibility of the Consultant. As per City of Dublin ETB terms, payments are made within 30 days from the date of receipt of invoices. Prompt payment interest and compensation are paid on invoices paid after 30 days in line with Department of Finance regulations. Professional Services Withholding Tax is deducted where required in line with Revenue regulations. Proof of tax clearance and completion of a supplier setup form with the City of Dublin ETB will be required from the successful applicant. Payments are made by Electronic Funds Transfer.

Any queries can be made out to: ‘Zambia Project Manager’

Email: info@bcfe.cdetb.ie

Applications to be submitted by email to: ‘Zambia Project Management Team’

Email: info@bcfe.cdetb.ie

Download this page in PDF format