Albania Thresholds I and II Performance Evaluation 2013
Other (please describe study type in Abstract)
From 2006 to 2011, the government of Albania (GOA) received two Millennium Challenge Corporation (MCC) Threshold Programs totaling $29.6 million. Albania received its first Threshold Program (ATP1) in 2006. As a result of the success of ATP1, MCC approved a Stage II Threshold Program (ATP2) in 2008.
The goal of the $13.9 million ATP1, which lasted from September 2006 to November 2008, was to improve Albania's performance on the control of corruption and business environment indicators by addressing tax administration, public procurement, and business registration legislation and processes. ATP2, a $15.7 million program in place from January 2009 to May 2011, expanded a similar approach of promoting e-government to business licensing and urban planning. ATP2 also supported reforms in public administration and judicial capacity, with the objective of achieving improvements on the control of corruption and rule of law policy indicators.
Upon completion of ATP2, the MCC commissioned this final independent, ex-post performance evaluation to implement an independent and evidence-based study of both Albania threshold programs, examining program effectiveness, impact and sustainability. The evaluation team was directed to focus its efforts on the extent to which activities were undertaken; activities were fully implemented; implemented activities led to outcomes (or meaningful changes in knowledge, attitudes, and practices); implemented activities and outcomes have been sustained to date; and the likelihood that they will be sustained over the short- and long-term, as well as the cost effectiveness of the program activities, where feasible.
The evaluation team collected and analyzed evidence to assess program effectiveness in achieving both output- and outcome-level impacts. In particular, during the program review and evaluation implementation, the evaluation team explored the extent to which:
- Activities were undertaken
- Implementation progressed as planned
- Activities were fully implemented
- Implemented activities led to outcomes (or meaningful changes in knowledge, attitudes and practices)
- Implemented activities and outcomes have been sustained, to date, and the likelihood that they will be sustained over the short- and long-term
The evaluation team explored the factors (internal, including programmatic design and implementation issues, as well as external forces) that enabled or prevented the achievement of these outputs. In particular, and in line with the TOR, the evaluation team collected quantitative and qualitative information from different government representatives, business owners, civil society representatives, project implementers, U.S. government partners and others stakeholders regarding the extent to which the timeframe and Compact incentives hindered or accelerated policy improvements and the implementation of activities. For each ATP component, specific evaluation questions are explored in detail, in the appropriate sections of this report.
- Document review
- Business impact survey
- Reference to ATP-funded surveys
- Focus group discussions
- Open-ended and semi-structured key informant interviews
- GOA data
- Third-party reports and surveys
Kind of Data
Other (please describe in Abstract)
Units of Analysis
Individuals, focus groups, businesses, government data, documents
Doing Business / Business Regulation
Business impact survey (BIS2): The survey covered medium and large businesses (value-added tax [VAT] payers).
Focus group discussions (FGDs): The discussions included small businesses that are exempt from the VAT.
Open-ended and semi-structured key informant interviews (KIIs): KIIs were conducted with government officials, USAID and U.S. Embassy personnel, independent experts, former project staff representatives of consortium members and selected business leaders. Site visits were conducted to project-implementation sites in Tirana and the regions.
GOA data: Data, annual reports, and in-depth interviews were included from GOA agencies working with the ATPs.
Third-party reports and surveys: Findings were used if relevant to assessing project outcomes and impact.