Dates:
- Release: Nov 21
- Analysis: 20 days after production release - Dec 11
Background
Please read Epic for context about project.
How will we know we were successful
Measurement plan
Validation
Current and Prospective Donors
KR 1: 30% Badge and Donor Additions interaction rate
1.1 30% CTR to contributions Dashboard page
1.2 2% Save changes
KR 2: 55% of survey respondents reflect desire for permanence (Qualitative)
KR 3: 50 donations as a result of feature
Current Donors
KR 4: 30% of users that click Contributions Dashboard make an update
Prospective Donors
KR 5: 40 donations from non donors or unknown donors to donors as a result of feature
Guardrails:
GR 1: 65% of negative sentiments by in-app users of feature
GR 2: 10 negative comments on talk page by community members from target audience
Curiosities:
CR 1: Does showing the edit tab to logged out users result in more account activation?
CR 2: How many times did we guess someone was a donor correctly vs users had to update their status?
CR 3: Do users convey frustration with sharing their information as opposed to us already having access? (Qualitative)
CR 4: Is there alternative placement we should consider than the contributions dashboard? (Qualitative)
CR5: What proportion of users that made updates were Non Donors vs Donors?
CR6: How many users updated their icon via settings?
Experiment Countries & Languages
- France and The Netherlands
- English, French, Dutch
Qualitative Feedback Groups
- Get user feedback from Donors that are also editors AND Donors that are exclusively readers
Tasks
- Evaluate if metrics are effective for determining if the hypothesis has been met @SNowick_WMF
- Add quantitative measures to metrics @JTannerWMF and @SNowick_WMF
- Convert this task to serve as analysis task @SNowick_WMF
- Create instrumentation task based on designs @SNowick_WMF