2021:Evaluation/Findings
Evaluation Background
This evaluation primarily explores the conference’s effectiveness in changing behaviors, reducing barriers of entry, and creating opportunities for connections and generation of ideas. It analyzes how participants experienced the conference, accessed the platform, and unique features - such as language translation, scholarships through affiliates, the Hackathon, and the Wikimedian of the Year. It seeks to understand which aspects were most strategic at increasing accessibility, participation, and inclusion. The evaluation unpacks the process of organizing and implementing the conference to gather lessons learned and recommendations for the implementation of future virtual conferences.
Methods: Throughout the evaluation report, a utilization lens is applied to present data in a way that is actionable for the Wikimedia Foundation, the organizing team, and the Movement. The OECD-DAC criteria of effectiveness[1] is used to complement conference objectives and key indicators established through the design process. The Movement Strategy Principles also influenced the conclusion and key evaluation recommendations.
The findings, conclusions, and recommendations of this evaluation are based primarily on three data sets: Registration Form filled out by 3,888 individuals, Remo participants database, and a Post-Event Survey completed by 456 conference participants. In addition, one-hour open-ended interviews were conducted with four Foundation Staff, five Core Organizing Team (COT) members, and three Wikimania Steering Committee members. The evaluation findings are supported by the evaluator’s observation of the conference, a scholarship survey filled out by eleven affiliates, two facilitated in-conference reflection sessions, and one COT post-event focus group. For a more detailed description of the evaluation methods and limitations see Annex A.
References
- ↑ The extent to which stated objectives were achieved or expected to be achieved, considering their relative importance.