Queue Weekly Status 2015-11-06

Add-ons addons.mozilla.org
#1

Review Queue state (listed add-ons only)

The tables below represent the state of the review queues at different points in time, divided into 3 “buckets” depending on how long they have been waiting. Ideally we want all nominations and updates to be under 5 days, so our goal is to have 100% of reviews on the third column.

Full Review Nominations

             10 days+     5-10 days       5 days-    Total
10/01       127 (78%)      21 (23%)       15 (9%)      163
11/01       119 (84%)       13 (9%)       10 (7%)      142
Now         121 (88%)        7 (5%)       10 (7%)      138

Full Review Updates

             10 days+     5-10 days       5 days-    Total
10/01        55 (75%)       8 (11%)      10 (14%)       73
11/01        43 (67%)      11 (17%)      10 (16%)       64
Now          43 (60%)      10 (14%)      19 (26%)       72

Preliminary Reviews

             10 days+     5-10 days       5 days-    Total
10/01       119 (77%)       13 (8%)      23 (15%)      155
11/01       104 (77%)      18 (13%)      13 (10%)      135
Now         101 (77%)      16 (12%)      14 (11%)      131

Reviewer Contributions

     Nominations    Updates    Prelim.  Admin flag   Info req  Total
Sep    623 (14%)  790 (17%) 2876 (64%)     20 (0%)   210 (5%)   4519
Oct    506 (17%)  696 (24%) 1566 (53%)     20 (1%)   147 (5%)   2935
Nov    115 (16%)  148 (21%)  378 (53%)      4 (1%)   72 (10%)    717

Nominations: full review nominations.
Updates: full review updates.
Prelim.: preliminary reviews.
Admin flag: reviews escalated to admin review.
Info req: information requests to authors.

More

For more information on how the review process works, and how you can check your add-on review status, please read An Overview of the AMO Review Process.

#2

Could you please explain the data in the last table: does it means that 115 full reviews were made in November? My addon position in this queue persists on 80 place at least for last week so I’m wondering what’s going on.

#3

Yes, 115 full reviews were performed in November so far. Most reviews are performed by volunteers. They are free to pick any add-on from the queue, and many go for the easier reviews, which are likely behind you in the queue. The most complex add-ons or the ones that are flagged for admin review are only reviewed by a handful of people who have very limited time, which could be the reason you haven’t seen any progress yet.

#4

Thanks. It’s incredibly sad. Looks like someone should rename review queue to pool. That will be more honest.

1 Like
#5

We’re in the process of hiring two new people who will spend a significant portion of their time handling reviews such a yours. At the moment things are pretty bad, but they should be much better in the future.

1 Like
#6

I’m afraid seem to be impolite, but let me remind you your last posts:

2015/07/01: "We have a new reviewer on our team, who will hopefully make a difference in the state of the queues."
2015/08/12: "… a part-time contractor who should help us with the longest-waiting add-ons in the queues."
2015/09/04: "We have two contractors who will join us in the coming days and will help us address this problem."
2015/09/23: "A new admin reviewer started helping us this week and we’re looking for a second one."
2015/10/14: “We’re also adding another contractor to our team, hopefully soon.”

Don’t you forgotten about the catch in a promise chain? :sunglasses:

#7

Unfortunately we have had some trouble on that front. We had two contractors in line, and then one had to drop off pretty much the day before we were going to start the contract procedure. We now have a second contractor ready to begin and we just need to deal with the legalities. And now we have approval for at least one more full time position, which we expect to fill up in the next month or so.

Shit happens.

#8

Thank you for detailed explanations. Let’s hope the taken measures will help finally resolve review pool queue problem.