Greetings Program Leaders and Evaluators!
Important updates on Learning and Evaluation:
== Program Evaluation & Design meet up at Wikimania 2014 ==
We are organizing a meeting of the Program Evaluation & Design community at
Wikimania. If you are attending the conference, join us! The meet up will
be a loosely structured sessions, where program leaders can share new
findings and experiences on program evaluation. time and date have not been
defined yet. Please vote your most convenient time on the doodle [1] You
can also sign up your name on the event page:
https://wikimania2014.wikimedia.org/wiki/Program_Evaluation_and_Design_Meet…
== Upcoming virtual event: Project & Event Grants review [2] ==
The next virtual meet-up will be held on Tuesday, July 29 (1500 hs UTC - 8
am PDT). ‘Project & Event Grants: an Impact Review of 2013-14’ will go over
the 30+ initiatives funded in the past fiscal year, discuss its outcomes
and share recommendations around program planning and funding decisions.
Join us!
As always, stay up-to-date by following our news and events sections [3] and
connecting on our portal [4].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
*Links references:*
[1] Meet up doodle:
http://doodle.com/3yc3i42imxssdzk5
[2] Project & Events Grants: an Impact Review of 2013-14
https://plus.google.com/u/0/events/c56l0mu03edgtbeqic4g7i607is
[3] Upcoming Events Section in PE&D portal:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News#upcoming-events
[4] Program Evaluation & Design Connect:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Parlor
Greetings Program Leaders and Evaluators!
Important updates on Learning and Evaluation:
== Evaluation Pulse survey ==
If you haven’t done so, please remember to fill out the evaluation survey
that was delivered last week. If you haven’t seen it in your inbox, or your
link has expired, email us at eval(a)wikimedia.org and we’ll resend it to
you.
== Learning & Evaluation Newsletter starting July 30 ==
At the Learning & Evaluation team (L&E) we work to understand what
activities within the movement work and to replicate initiatives that are
appropriate for each context. To this goal, every month we host virtual or
face-to-face events, to share new resources to evaluate programs, do
research and more.
With the newsletter, that will be issued quarterly, we aim to capture the
highlights of the L&E team and share those with the community, in an outlet
that brings stories to users' inboxes, and to encourage participation. You
can sign up to get the newsletter delivered to your user page by including
your name on this list:
https://meta.wikimedia.org/wiki/Global_message_delivery/Targets/Learning_Qu…
== Beyond Wikimetrics series started ==
If you missed the first edition of Beyond Wikimetrics, don’t panic! You can
watch the video online [1] and revisit the presentation [2]. This was the
opening virtual meet-up of a series of 3 online events that will go deeper
into this same topic. Stay tuned for upcoming events on our portal [3]!
== Join the L&E team at Wikimania 2014! [4] ==
If you are attending the global conference in London, join us for a number
of workshops and activities. Watch our news page to find out more about
Learning & Evaluation workshops and presentations in the movement’s largest
convention.
As always, stay up-to-date by connecting on our portal [5].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
Link references:
[1] Beyond Wikimetrics: Using Databases and APIs for Research (1 of 3):
https://www.youtube.com/watch?v=IjvZJ6joQD4
[2] Beyond Wikimetrics presentation (1 of 3):
https://docs.google.com/a/wikimedia.org/presentation/d/1SCD_Yz-cdT6ML2TE0Oq…
[3] Upcoming Events Section in PE&D portal:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News#upcoming-events
[4] Wikimania 2014 Homepage:
http://wikimania2014.wikimedia.org
[5] Program Evaluation & Design Connect:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Parlor
Greetings Program Leaders and Evaluators!
Important updates on Learning and Evaluation:
== Beyond Wikimetrics - Virtual-meet up: July 16 ==
This online meeting [1] is the first in a series of three sessions that
will be hosted by Jonathan Morgan, Learning Strategist of our Learning &
Evaluation team. ‘Beyond Wikimetrics’ is a series that will present a
step-by-step guide to using databases and APIs for evaluation and research.
The workshop will teach you how to use MySQL to make your own queries, and
will also go over some tools on Wikimedia Labs. If you have questions about
how are people editing wiki projects, post them on the event page!
== New Wikimetrics demo available: Metrics for Education Programs ==
Tighe Flanagan, Wikipedia Education Program Manager, hosts this
demonstration video on using Wikimetrics.. This 20 minutes video [2] walks
you through a running a report on an uploaded cohort, spreadsheet
formatting, and basic analysis in the context of an education program
cohort.
== Evaluation Pulse ==
After a year of program evaluation workshops, activities and resources
developed, we kindly invite you to take part in our Evaluation Pulse survey
to briefly feedback on evaluation strategies, resources, and supports. We
will be launching the survey at the end of next week. Be sure to watch your
inbox for your invitation to participate.
== Virtual Meet-Ups Agenda: Send your Suggestions! ==
In the coming months we have slated some interesting virtual meet-ups on
topics from tools and strategies for accessing data about online content
and participation to setting targets, goals, and reporting. The aim of
these meet-ups is to promote and share evaluation strategies and resources
with our broad community of program leaders and evaluators. If you have
suggestions for future topics or if you wish to present your evaluation
work at an upcoming meet-up, please reach out to us! You can post your
comments on our portal discussion page [3] or email us at eval(a)wikimedia.org
.
As always, stay up-to-date by watching the news page [4] and connecting on
our portal [5].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
References
[1] Beyond Wikimetrics: How to Use Databases and APIs for Research
https://plus.google.com/u/0/b/117126229120807344920/events/ccmjivinemvg2bra…
[2] Wikimetrics for Education Programs
http://youtu.be/DgUcoNBARww
[3] Section to suggest a hangout topic:
https://meta.wikimedia.org/wiki/Grants_talk:Evaluation#Suggestions_for_Goog…
[4] Program Evaluation & Design News:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News
[5] Program Evaluation & Design Connect:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Parlor
Greetings Program Leaders and Evaluators!
Important updates on Learning and Evaluation:
== Next virtual meet up ==
Jonathan Morgan, Learning Strategist of the Learning & Evaluation team,
will begin hosting a series of virtual meet-ups that will go over tools for
analyzing on-wiki data, beyond Wikimetrics. The first session will be held
on July 16th, at 3 PM UTC. Sign-up in the event on our Google + page![1] A
detailed look at each tool will take place in different webinars July
through September. Watch our portal news page for updates and details.[2]
== New blogpost on survey resources ==
The Program Evaluation & Design team members are working on building
different resources to build better surveys. The first step in this track
was the launch of the learning module ‘Designing Effective Questions’ [3],
that provides theories behind how survey work, and is filled with examples.
Check out other resources in the blogpost, read and share![4]
== June virtual meet-ups(s) available online ==
It has been a couple busy weeks on air for the Learning and Evaluation
team! If you missed one or both our hangouts, don’t panic: you can watch
them online:
1. Survey Strategies
Daria Cybulska (Wikimedia UK) and James Hare (Wikimedia DC) shared their
experiences using surveys to evaluate programs and activities. Watch the
video of the meeting online [5], check out the resource overview [6] and
Daria’s presentation and links [7].
2. Annual Plan Grants: Results of Year 1
Jessie Wild Sneller overviews a first round of impact reports of the Annual
Plan Grants program. Nearly 11 million USD went toward programmatic work.
What do we know about how far those efforts reached? Read the presentation
[8] and find out more on the video! [9]
== Community Dialogue: Comment before July 15th ==
About a month ago, we opened a request for comment on the current
evaluation capacity building initiative, program evaluation metrics, and
how to evaluate grantmaking. The planned closing date for that dialogue is
July 15th. If you have not commented yet, don’t forget to do so at:
https://meta.wikimedia.org/wiki/Grants_talk:Evaluation/Parlor/Dialogue
Don't hesitate to reach out to me if you have any questions or comments.
Best regards,
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
References:
[1] “Beyond Wikimetrics” virtual meetup sign up:
https://plus.google.com/u/0/b/117126229120807344920/events/ccmjivinemvg2bra…
[2] Evaluation Portal news and events page
https://meta.wikimedia.org/wiki/Grants:Evaluation/News
[3] Learning module: Designing effective questions
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Learning_modules…
[4] Blogpost: Asking the right questions.
http://blog.wikimedia.org/2014/06/10/asking-the-right-questions-resources-f…
[5] Live meet-up: Survey strategies (video)
http://www.youtube.com/watch?v=DxcBosHc4jE
[6] Surveys overview presentation
https://docs.google.com/presentation/d/1fe6J0IF3WZadmBtWZnPmoXG1wLwxzadAZvp…
[7] Daria Cybulska’s presentation on survey strategies, with useful links
to surveys and resources:
https://docs.google.com/a/wikimedia.org.uk/file/d/0B7uZ08mzX5bvQl90TUIyNktU…
[8] Annual Plan Grants: Results of Year 1 (presentation)
https://commons.wikimedia.org/wiki/File:Learning_and_Evaluation._FDC_Impact…
[9] Annual Plan Grants: Results of Year 1 (video)
http://youtu.be/3rGCnfDBrpY
Greetings Program Leaders and Evaluators!
Important updates from the PE&D team:
== New blogpost on Community Dialogue ==
Read about the metrics discussion
We want to reach out to program leaders and evaluators in the movement and
engage them in dialogue about metrics. In our new entry in Wikimedia blog,
we expand on the reasons that inspired the discussion around metrics and
evaluation. Read and share the blog post: Defining Impact Together [1].
Join the conversation
We want to know if our team's building capacity is working for wikimedia
program leaders all over the world. What resources are useful? What do you
think is still weak? Do you need more help with some other aspect of
program evaluation? Tell us! Join the conversation here:
https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Parlor/Dial…
== WikiConference USA ==
WikiConference USA [2] was held in New York City last week and attracted
wikimedia volunteers, program leaders and professionals from aroung the
United States who work on open education and culture inside and outside the
movement. Grantmaking team members hosted sessions on evaluation, metrics,
and IdeaLab. Check out the presentations Growing The Awesome In Your
Programs [3] and Wikimetrics Overview [4] and the Wikimetrics Training
Module [5] and visit the idea lab to see the new ideas generated [6] at the
event! Conference video documentation should be available soon, for now
you can find many presentation slides on commons [7].
== Virtual Meet-up next week ==
Let’s talk about surveys: Join the next virtual meet-up on June 12 from 4-5
p.m. UTC
Tuesday, June 12 you can find us on a virtual meetup to review survey tools
and resources. This will be an occasion for program leaders to share
experiences in piloting survey strategies. The program evaluation and
design team will be joined by Daria Cybulska (WMUK) and James Hare (WMDC),
who will share their experiences piloting online surveys for program
evaluation. Join the event [8]!
Would you like to present an evaluation strategy or results of programs you
are implementing? To offer suggestions or to present your project at a
future virtual meet-up, message us directly at eval(a)wikimedia.org.
As always, stay up-to-date by watching the news page [9] on our portal or
reach out to us in the parlor [10].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
.~
María Cruz
Community Coordinator, PE&D
Wikimedia Foundation
References:
[1] New blogpost:
http://blog.wikimedia.org/2014/05/30/building-metrics-together/
[2] WikiConference USA page on Meta:
https://meta.wikimedia.org/wiki/WikiConference_USA
[3] Growing The Awesome In Your Programs:
https://docs.google.com/presentation/d/1g8pbeyA_uQsLxysKQkc-xAqFvxpy0mMxgYp…
[4] Wikimetrics Overview:
https://docs.google.com/a/wikimedia.org/presentation/d/13G33WDKthPjEEK-RQGf…
[5] Wikimetrics Training Module:
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Learning_modules…
[6] IdeaLab projects that seek participants:
https://meta.wikimedia.org/wiki/Grants:IdeaLab/Ideas#idealab-participants
[7] WikiConference USA 2014 in Commons:
https://commons.wikimedia.org/wiki/Category:WikiConference_USA_2014
[8] June 12 virtual meet up:
https://plus.google.com/b/117126229120807344920/events/c1kgb4kkpn72dahhapka…
[9] Program Evaluation & Design News:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News
[10] Program Evaluation & Design Parlor:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Parlor
Greetings Program Leaders and Evaluators!
Important updates from the PE&D team:
== New Social Media ==
Follow our New Twitter Account!
In order to further spread all the knowledge around evaluation and add more
voices in this global dialogue, we launched a twitter account. Feel free to
follow and tag @WikiEval [1] on anything related to program evaluation and
learning.
== New Resource==
Program Evaluation Tips and Links
Alex (Program Officer, Project & Event Grants) has recently created a
handful of useful pages for helping you plan, implement, and evaluate key
programs. These initial pages will continue to grow and develop into
full-fledged program toolkits, but already Alex has gathered some really
important tips and links for Edit-a-thons [2], On-Wiki writing contests [3],
Image upload events [4], GLAM Content release partnerships [5], and the
Wikipedia Education Program [6]. If you are planning one of these events,
please visit and be sure to share your experience or additional resources
and links via the talk page.
== New Workshop Sessions ==
Grantmaking sessions at WikiConference USA
WikiConference USA will be held in New York, May 30 to June 1st [7]. The
conference will be the scene for two important workshops: a program
evaluation workshop on program tracking and reporting tools and
Wikimetrics, and a grantmaking workshop on IdeaLab. For those who will be
in attendance, please join the grantmaking teams for these special
sessions!
* Program Evaluation and Design workshop [8] - Saturday, May 31 from 3 to 5
p.m. We will look into the core points for program tracking and reporting
and explore related resources, as well as overview the functionality of,
and explore using, Wikimetrics. We encourage you to bring a your laptop and
list of usernames from a program or event you have held.
* IdeaLab workshop [9] - Sunday, June 1 from 10:30 a.m. - 1:30 p.m.
Grantmaking team members will facilitate an interactive session working
together to learn how to use the IdeaLab to write-up new ideas for projects
and turn them into project plans or grant proposals. Come ready to bring
your ideas to life!
== Next Virtual Meet-up ==
Let’s talk about surveys: Join the next virtual meet-up on June 12
Tuesday, June 12 you can find us on a virtual meetup to review survey tools
and resources. This will be an occasion for program leaders to share
experiences in piloting survey strategies. The program evaluation and
design team will be joined by Daria Cybulska (WMUK) and James Hare (WMDC),
who will share their experiences piloting online surveys for program
evaluation. Join the event [10]!
As always, stay up-to-date by watching the news page [11] on our portal or
reach out to us in the parlor [12] or privately at eval(a)wikimedia.org
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
Best,
María
References:
[1] Twitter link: http://twitter.com/WikiEval
[2] Edit-a-thons tips and links:
https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/Edit-a-thons
[3] Writing contest tips and links:
https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/Writing_Compet…
[4] Photo event tips and links:
https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/Photo_Events<https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/Photo_Events>
[5] GLAM Content release tips and links:
https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/GLAM<https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/GLAM>
[6] WEP tips and links:
https://meta.wikimedia.org/wiki/Grants:PEG/Program_Resources/Education
[7] WikiConferenceUSA portal:
https://meta.wikimedia.org/wiki/WikiConference_USA
[8] PE&D workshop:
http://wikiconferenceusa.org/wiki/Submissions:Growing_the_Awesome_in_your_P…
[9] IdeaLab workshop: http://wikiconferenceusa.org/wiki/IdeaLab
[10] Virtual meet-up page:
https://plus.google.com/events/c1kgb4kkpn72dahhapkavsbopu4
[11] https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/News
[12] https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Parlor
--
María Cruz
Community Coordinator, PE&D
Wikimedia Foundation
Greetings Program Leaders and Evaluators!
Important updates on our activities from the PE&D team:
===New Community Discussion!===
Let's Talk! Program Evaluation and Metrics [1]
The focus of the Program Evaluation and Design team is peer learning,
practice sharing, and the adoption of shared language and approach to
program evaluation across the movement, to support the discoverability and
innovation of programs that will achieve high impact. Importantly, the team
is charged with developing learning resources and tools to support program
leaders to self-evaluate their program efforts and impacts. As we come upon
one year’s time since our team began started on this initiative we’d like
to hear from the community of Wikimedia, program leaders, evaluators,
volunteers, and other stakeholders in program evaluation and design, about
your perspectives on the evaluation initiative efforts. Please visit the
dialogue pages to share your perspective on: How we should evaluate and
report on the program evaluation and design capacity-building initiative,
the evaluation learning opportunities and resources made available so far,
program metrics piloted so far, and how we should assess grantmaking to
groups and individuals.
===New Virtual Meet-up!===
Survey tools and program leader experiences piloting survey strategies [2]
The program evaluation team will facilitate a brief survey tools overview
and resources and sharing of program leader experiences piloting survey
strategies. The program evaluation and design team will be joined by Daria
Cybulska (WMUK) and James Hare (WMDC) who will share their recent
experiences piloting survey tools for their program evaluation. (June 12,
2014; 4-5 p.m. UTC).
===New Team Member!===
Maria Cruz, Program Evaluation Community Coordinator [3]
We have hired Maria Cruz as our new Program Evaluation Community
Coordinator. Maria is extremely personable and has a good understanding of
the Wikimedia Landscape. She is familiar with both the nonprofit and
Wikimedia world and has a passion for free knowledge, and a background and
experience in communications and journalism. She has two bachelor’s
degrees, one in Communication, Art & Design and another in Communication
with and emphasis in Journalism. In addition, she has a full year’s
experience as communications coordinator of Wikimedia Argentina (WMAR).
Maria expresses a natural curiosity and propensity toward capturing people
and stories and has a strong history of productivity with blogs and
reporting communications in her role at the chapter as well as in previous
activities and positions. She is a patient and passionate communicator who
will add depth and perspective to how we communicate about program
evaluation and design.
On a more personal note, María enjoys writing short narratives, taking
pictures of people when they don't look in the camera, and swimming. She
likes to cook for friends and go further east (if possible) each time she
travels. She can watch almost any movie, but prefers independent
filmmaking. Oftentimes, she thinks a bike ride will make anything better.
Join us in welcoming Maria by visiting her user page [3] on Meta!
As always, stay up-to-date by watching the news page [4] on our portal or
reach out to us in the parlor [5] or privately at eval(a)wikimedia.org
Best regards,
Jaime
References:
[1]
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Parlor/Dialogue
[2]
https://plus.google.com/b/117126229120807344920/events/c1kgb4kkpn72dahhapka…
[3] https://meta.wikimedia.org/wiki/User:MCruz_(WMF)
[4] https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/News
[5] https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Parlor
--
Jaime Anstee, Ph.D
Program Evaluation Specialist
Wikimedia Foundation
+1.415.839.6885 ext 6869
www.wikimediafoundation.org
Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us make it a reality!
*https://donate.wikimedia.org <https://donate.wikimedia.org/>*
Greetings,
(Please pardon any cross-posting)
The final in our series of the Evaluation Reports (beta), the report on the
Wikipedia Education Program, is now available on meta:
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WEP<https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM>
Highlights of the report include:
==Inputs==
The average Wikipedia Education Program reported cost a total of almost
$8,000 USD in total, and $275 each week to implement. The average Wikipedia
Education Program invests a total of $67 US and 3 hours into recruiting
each new editor participant.
==Participation==
Program leaders reported participation rates ranging from 25 to 2,372, and
programs lasted from two weeks to 21 months with an average of 37.5 weeks.
==Outputs==
For the seven reported Wikipedia Education Program implementations, almost
3,000 different Wikimedia pages were created or improved. The average
Wikipedia Education Program produces about 120 pages of content each week.
The average program participant adds just under half a page of content to
Wikipedia and creates or improves six wiki pages each week.
==Outcomes==
Out of the 3,334 new editor participants in Wikipedia Education Program, 36
(1.2%) participants were "active" three months after the program ended; 33
(1.1%) were "active" six months after the programs ended.
Questions are welcome and encouraged on the talk page.
On behalf of the Program Evaluation team,
Jaime
--
Jaime Anstee, Ph.D
Program Evaluation Specialist
Wikimedia Foundation
+1.415.839.6885 ext 6869
www.wikimediafoundation.org
Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us make it a reality!
*https://donate.wikimedia.org <https://donate.wikimedia.org/>*
(please excuse cross-posting)
Join us Thursday, March 20th at 4pm UTC for Program Evaluation and Design's
second virtual meet-up discussing the final three evaluation reports on
Wiki Loves Monuments, Other photo initiatives, and the Wikipedia Education
Program.
There are two ways to participate:
[1] Google Hangout (by invite only)
https://plus.google.com/b/117126229120807344920/events/cv4itmumcf5elcecdg24…
If you would like to participate directly in the Google hangout, be sure to
leave a comment on the Google+ event page so that we can send you an
invitation.
[2] YouTube Live broadcast (a few seconds delayed)
http://www.youtube.com/watch?v=2U2WgpaHot4
If you will be viewing via YouTube Live link, you can send us comments
during the broadcast in any of the following ways:
- Google + event page
- YouTube live page
- IRC at #wikimedia-ped
Hope to see you there!
Edward
--
Edward Galvez
Intern, Program Evaluation and Design
Wikimedia Foundation