Update click tracking to take into account screen resolution
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	Jdlrobson
	Feb 9 2022, 6:50 PM

Description

A common theme during Desktop Improvements (Vector 2022) we're often interested in user when behaviour inside resized windows/smaller windows.

One example is the table of contents where the behaviour for desktop users will not be the same as for < 1000px.
Another example is where we collapse certain items into the user menu .g. watchlist icon

TODO

Check that legal team would be okay with us recording window width as categories e.g. 1000-1200px, 800-1000, <800
Update DesktopWebUIClickTracking schema to have windowBucket field.
Record this data in DesktopWebUIClickTracking

QA steps

Trigger a click event in the beta cluster. Inspect the network tab to see the request. Inside the request JSON there should be a field relating to a window width bucket.

Screen Shot 2022-03-29 at 10.10.06 AM.png (640×2 px, 245 KB)

Resize the window and check clicks have different buckets.

https://phabricator.wikimedia.org/T301391#7823760
https://phabricator.wikimedia.org/T301391#7823765

QA Results - Beta

AC	Status	Details
1	✅	T301391#7823760

QA Results - Prod

AC	Status	Details
1	✅	T301391#7823765

QA Results - Beta

AC	Status	Details
1	✅	T301391#7850276

Additional production QA steps

Verify that events are being sent to production. To do this use hue.wikimedia.org/ and run query select * from event.desktopwebuiactionstracking where year = 2022 and month = 4 and day = 5 and event.name = 'ui.toc' and webhost = 'www.mediawiki.org' and event.viewportsizeBucket is not null

Details

Subject	Repo	Branch	Lines +/-
Add "viewportSize" metric to desktopWebUIActions tracking	mediawiki/extensions/WikimediaEvents	master	+43 -0
Fixing typo in desktopwebuiactionstracking schema	schemas/event/secondary	master	+447 -5
Fixes typo in schema	schemas/event/secondary	master	+3 -3
Fix string values in desktopWebUIActions schema	mediawiki/extensions/WikimediaEvents	master	+6 -6
Update to 78eef14, rename viewportSize to viewportSizeBucket	mediawiki/extensions/WikimediaEvents	wmf/1.39.0-wmf.6	+1 -1
Update to 78eef14, rename viewportSize to viewportSizeBucket	mediawiki/extensions/WikimediaEvents	master	+1 -1
Updating desktopwebuiactionstracking with viewport buckets	schemas/event/secondary	master	+456 -4

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	ovasileva	T273473 [Epic] Improve the table of contents
Resolved	ovasileva	T304169 [Goal] Begin table of contents A/B test
Resolved	Jdlrobson	T301391 Update click tracking to take into account screen resolution

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 9 2022, 6:50 PM

Jdlrobson moved this task from Incoming to Not ready to estimate on the Web-Team-Backlog board.Feb 9 2022, 11:41 PM

ovasileva triaged this task as High priority.Feb 10 2022, 2:43 PM

ovasileva edited projects, added Web-Team-Backlog (Kanbanana-FY-2021-22); removed Web-Team-Backlog.

ovasileva added a project: Desktop Improvements (Vector 2022).

Jdlrobson renamed this task from Update click tracking to take into accoutn screen resolution to Update click tracking to take into account screen resolution.Feb 14 2022, 6:22 PM

Jdlrobson updated the task description. (Show Details)Feb 16 2022, 7:28 PM

Jdlrobson moved this task from Needs Analysis to Upcoming on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

LGoto set the point value for this task to 3.Feb 22 2022, 6:36 PM

LGoto moved this task from Upcoming to Ready for Development on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

I was curious what this specific bucketing would look like.

In Vector, we currently use the following breakpoints:

@width-breakpoint-tablet: 720px;
@width-breakpoint-desktop: 1000px;
@width-breakpoint-desktop-wide: 1200px;
@max-width-workspace-container + ( 2 * @padding-horizontal-page-container ) : 1500

In core, these are the breakpoints defined in mediawiki.ui :

@width-breakpoint-mobile: 320px;
@width-breakpoint-tablet: 720px;
@width-breakpoint-desktop: 1000px;
@width-breakpoint-desktop-wide: 1200px;
@width-breakpoint-desktop-extrawide: 2000px;

For monitoring differences in behaviour based on screen resolution (due to differences in layout), it seems like we can probably stick to the sizes in mediawiki.ui as the bucket values.

Tracking the extrawide resolution could also give us an idea of how much we should accommodate extrawide monitors, and tracking the tablet and mobile resolutions would give us an idea of how many users are using Vector on their mobile devices.

@Jdrewniak I think those buckets would be a great starting point, however having them more granular (e.g. 200px intervals) would help us prioritize bugs which say stuff like "This is broken at 823px resolution! The eventual goal here would be to add this field to all schema events.

Jdrewniak claimed this task.Feb 24 2022, 6:15 PM

Jdrewniak moved this task from Ready for Development to Doing on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

Change 767437 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add \"viewportSize\" metric to desktopWebUIActions tracking

https://gerrit.wikimedia.org/r/767437

gerritbot added a project: Patch-For-Review.Mar 2 2022, 6:06 AM

Change 767439 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[schemas/event/secondary@master] [WIP] Updating desktopwebuiactionstracking with viewport buckets

https://gerrit.wikimedia.org/r/767439

Jdrewniak removed Jdrewniak as the assignee of this task.Mar 22 2022, 5:51 PM

Jdrewniak moved this task from Doing to Code Review on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

The privacy team has conducted a review of the proposed data collection scheme — without mitigations, it would be deemed medium risk. However, after privacy-protecting mitigations like automated data deletion after 90 days, bucketing, and restricting access to WMF/NDA'd people, collecting this data was deemed low risk.

Feel free to approve these gerrit patches and get on your merry way!

LGoto assigned this task to Jdlrobson.Mar 23 2022, 4:42 PM

Jdlrobson moved this task from Code Review to Needs More Work on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.Mar 23 2022, 5:40 PM

Change 767439 merged by jenkins-bot:

[schemas/event/secondary@master] Updating desktopwebuiactionstracking with viewport buckets

https://gerrit.wikimedia.org/r/767439

Jdlrobson reassigned this task from Jdlrobson to Jdrewniak.Mar 25 2022, 4:56 PM

Jdrewniak removed Jdrewniak as the assignee of this task.Mar 28 2022, 3:06 PM

Jdrewniak moved this task from Needs More Work to Code Review on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

Jdrewniak changed the subtype of this task from "Bug Report" to "Task".Mar 28 2022, 3:27 PM

Change 767437 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add "viewportSize" metric to desktopWebUIActions tracking

https://gerrit.wikimedia.org/r/767437

Jdlrobson assigned this task to Edtadros.Mar 28 2022, 3:52 PM

Jdlrobson moved this task from Code Review to QA on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

ReleaseTaggerBot added a project: MW-1.39-notes (1.39.0-wmf.5; 2022-03-28).Mar 28 2022, 4:00 PM

Maintenance_bot removed a project: Patch-For-Review.Mar 28 2022, 4:11 PM

Jdlrobson updated the task description. (Show Details)Mar 29 2022, 5:10 PM

Test Result - Beta

Status: ✅ PASS
Environment: beta
OS: macOS Monterey
Browser: Chrome
Device: MBP
Emulated Device:NA

Test Artifact(s):

QA Steps

✅ AC1: Trigger a click event in the beta cluster. Inspect the network tab to see the request. Inside the request JSON there should be a field relating to a window width bucket.
Resize the window and check clicks have different buckets.

Screen Shot 2022-03-31 at 9.27.25 AM.png (1×1 px, 420 KB)

Screen Shot 2022-03-31 at 9.30.05 AM.png (1×707 px, 283 KB)

Screen Shot 2022-03-31 at 9.28.35 AM.png (1×1 px, 525 KB)

Test Result - Prod

Status: ✅ PASS
Environment: enwiki
OS: macOS Monterey
Browser: Chrome
Device: MBP
Emulated Device:NA

Test Artifact(s):

QA Steps

✅ AC1: Trigger a click event. Inspect the network tab to see the request. Inside the request JSON there should be a field relating to a window width bucket.
Resize the window and check clicks have different buckets.

Screen Shot 2022-03-31 at 6.16.15 PM.png (1×718 px, 310 KB)

Screen Shot 2022-03-31 at 6.14.57 PM.png (1×1 px, 426 KB)

Screen Shot 2022-03-31 at 6.04.39 PM.png (1×1 px, 446 KB)

Edtadros updated the task description. (Show Details)Apr 1 2022, 1:21 AM

Resolving. Further QA will be done in T305442: QA ToC Instrumentation

ovasileva closed this task as Resolved.Apr 5 2022, 11:29 AM

This doesn't seem to be working. Not sure why we're not seeing validation errors though.

Change 777443 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[mediawiki/extensions/WikimediaEvents@master] Update to 78eef14, rename viewportSize to viewportSizeBucket

https://gerrit.wikimedia.org/r/777443

gerritbot added a project: Patch-For-Review.Apr 5 2022, 8:34 PM

Change 777389 had a related patch set uploaded (by Jdlrobson; author: Jdrewniak):

[mediawiki/extensions/WikimediaEvents@wmf/1.39.0-wmf.6] Update to 78eef14, rename viewportSize to viewportSizeBucket

https://gerrit.wikimedia.org/r/777389

Change 777443 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Update to 78eef14, rename viewportSize to viewportSizeBucket

https://gerrit.wikimedia.org/r/777443

Jdlrobson removed ovasileva as the assignee of this task.Apr 5 2022, 8:54 PM

Jdlrobson moved this task from Needs More Work to QA in Prod on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

Jdlrobson updated the task description. (Show Details)

Jdlrobson added a subscriber: ovasileva.

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.7; 2022-04-11); removed MW-1.39-notes (1.39.0-wmf.5; 2022-03-28).Apr 5 2022, 9:00 PM

ovasileva mentioned this in T305524: QA ToC Instrumentation on Beta Cluster.Apr 6 2022, 8:45 AM

Change 777389 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.39.0-wmf.6] Update to 78eef14, rename viewportSize to viewportSizeBucket

https://gerrit.wikimedia.org/r/777389

Mentioned in SAL (#wikimedia-operations) [2022-04-06T20:10:06Z] <cjming@deploy1002> Synchronized php-1.39.0-wmf.6/extensions/WikimediaEvents/modules/ext.wikimediaEvents/desktopWebUIActions.js: Backport: [[gerrit:777389|Update to 78eef14, rename viewportSize to viewportSizeBucket (T301391)]] (duration: 00m 55s)

Change 777869 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[mediawiki/extensions/WikimediaEvents@master] Fix string values in desktopWebUIActions schema

https://gerrit.wikimedia.org/r/777869

Change 777876 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[schemas/event/secondary@master] Fixing typo in desktopwebuiactionstracking schema

https://gerrit.wikimedia.org/r/777876

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.6; 2022-04-04); removed MW-1.39-notes (1.39.0-wmf.7; 2022-04-11).Apr 6 2022, 9:00 PM

Change 777869 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Fix string values in desktopWebUIActions schema

https://gerrit.wikimedia.org/r/777869

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.7; 2022-04-11); removed MW-1.39-notes (1.39.0-wmf.6; 2022-04-04).Apr 6 2022, 10:00 PM

https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/777876 has a -1.

LGoto assigned this task to Jdrewniak.Apr 7 2022, 5:10 PM

Jdlrobson moved this task from Needs More Work to Blocked on Others on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.Apr 7 2022, 5:45 PM

ovasileva added a parent task: T304169: [Goal] Begin table of contents A/B test.Apr 11 2022, 11:49 AM

Jdlrobson moved this task from Blocked on Others to Doing on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.Apr 11 2022, 5:29 PM

Change 779084 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[schemas/event/secondary@master] Fixes typo in schema

https://gerrit.wikimedia.org/r/779084

Change 779084 merged by Ottomata:

[schemas/event/secondary@master] Fixes typo in schema

https://gerrit.wikimedia.org/r/779084

Jdlrobson reassigned this task from Jdrewniak to Edtadros.Apr 11 2022, 6:13 PM

Jdlrobson moved this task from Doing to QA on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.

Test Result - Beta

Status: ✅ PASS
Environment: beta
OS: macOS Monterey
Browser: Chrome
Device: MBP
Emulated Device:NA

Test Artifact(s):

QA Steps

Screen Shot 2022-04-12 at 6.23.43 PM.png (1×1 px, 444 KB)

Screen Shot 2022-04-12 at 6.26.36 PM.png (1×1 px, 433 KB)

Screen Shot 2022-04-12 at 6.27.42 PM.png (1×1 px, 370 KB)

Screen Shot 2022-04-12 at 6.29.15 PM.png (1×895 px, 353 KB)

Screen Shot 2022-04-12 at 6.30.30 PM.png (1×711 px, 307 KB)

Edtadros updated the task description. (Show Details)Apr 13 2022, 1:33 AM

I'll QA/sign this off today by confirming data is coming in.

Jdlrobson moved this task from QA in Prod to Ready for Signoff on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.Apr 13 2022, 4:45 PM

I have confirmed that data is coming in.
For mediawiki.org:

Screen Shot 2022-04-13 at 9.45.32 AM.png (522×1 px, 59 KB)

Change 777876 abandoned by Jdrewniak:

[schemas/event/secondary@master] Fixing typo in desktopwebuiactionstracking schema

Reason:

https://gerrit.wikimedia.org/r/777876

	F35050080: Screen Shot 2022-04-13 at 9.45.32 AM.png
	Apr 13 2022, 4:56 PM

	F35048792: Screen Shot 2022-04-12 at 6.30.30 PM.png
	Apr 13 2022, 1:32 AM

	F35048781: Screen Shot 2022-04-12 at 6.23.43 PM.png
	Apr 13 2022, 1:32 AM

	F35048789: Screen Shot 2022-04-12 at 6.29.15 PM.png
	Apr 13 2022, 1:32 AM

	F35048786: Screen Shot 2022-04-12 at 6.27.42 PM.png
	Apr 13 2022, 1:32 AM

	F35048784: Screen Shot 2022-04-12 at 6.26.36 PM.png
	Apr 13 2022, 1:32 AM

	F35032866: Screen Shot 2022-03-31 at 6.14.57 PM.png
	Apr 1 2022, 1:17 AM

	F35032865: Screen Shot 2022-03-31 at 6.16.15 PM.png
	Apr 1 2022, 1:17 AM

Update click tracking to take into account screen resolutionClosed, ResolvedPublic3 Estimated Story PointsActions

Description

TODO

QA steps

QA Results - Beta

QA Results - Prod

QA Results - Beta

Additional production QA steps

Details

Related ObjectsSearch...

Event Timeline

Test Result - Beta

QA Steps

Test Result - Prod

QA Steps

Test Result - Beta

QA Steps

Update click tracking to take into account screen resolution
Closed, ResolvedPublic3 Estimated Story Points
Actions

Related Objects
Search...