Heroes of Fedora 23 completes, with a look at the heroes of Fedora 23 Final testing.
Wrapping up the Heroes of Fedora for Fedora 23, after the Alpha and Beta posts, it’s time to celebrate all those who contributed to Fedora 23 Final testing! As usual, we’ll be looking at Bodhi feedback on updates, release validation tests, and bug reports.
Updates Testing
Test period: Fedora 23 Final (2015-09-22 – 2015-11-03)
Testers: 173
Comments1: 1399
1If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.
The numbers here are up on Beta, but behind Fedora 22 Final, for reasons discussed in the Alpha and Beta posts (though it’s encouraging that the numbers went up rather than down from Beta to Final). It’s interesting how people show up at or near the top of the Final numbers who weren’t in the Beta numbers at all, perhaps reflecting keen testers who only install new releases after the Beta comes out, like Dmitri and Carlos – thanks a lot to them!
Validation Tests
Test period: Fedora 23 Final
Testers: 22
Reports: 1363
Unique referenced bugs: 59
| Name | Reports submitted | Referenced bugs1 |
|---|---|---|
| pwhalen | 405 | 1272646 (1) |
| juliuxpigface | 210 | 1166980 1181308 1208863 1217591 1228834 1240879 1242467 1247004 1250712 1256456 1259985 1260307 1261464 1262600 1262602 1266722 1266756 1266774 1268589 1268622 1268624 1268649 1268666 1268667 1268677 1269263 1269270 1271061 1271377 1272642 1272646 1272737 1272744 1272762 1273112 1274869 1274904 1274971 1274972 1276226 (40) |
| satellit | 152 | 1262600 1263988 1266756 1272646 1288756 (5) |
| pschindl | 100 | 1274193 (1) |
| roshi | 95 | 1195761 1272614 (2) |
| adamwill | 88 | 1217591 1261569 1268009 1268176 1269010 1272706 1272737 1273112 1275441 1276140 1276158 1276165 (12) |
| robatino | 55 | |
| lbrabec | 51 | |
| lnie | 48 | 1271459 (1) |
| sgallagh | 41 | 1273102 1273145 1273167 (3) |
| kparal | 40 | |
| dustymabe | 20 | |
| wolnei | 12 | |
| kakoskin | 11 | 1276278 (1) |
| kevin | 10 | |
| jsedlak | 8 | |
| fab | 6 | |
| jdulaney | 4 | |
| mkrizek | 3 | |
| bradfirj | 2 | |
| coconut | 1 | |
| tflink | 1 |
1 This is a list of bug reports referenced in test results. The bug itself may not be created by the same person.
We’re down slightly in testers compared to Fedora 22 here (though in fact now I look at the F22 tables closely, several of the ‘testers’ for F22 Final had just one test, and some of them are actually data entry errors, like user name typos or bug numbers). The number of reports is up significantly, though this tracks strongly with the number of composes we have to make (the more composes, the more reports), and we had 7 composes for Fedora 22 Final but 12 for Fedora 23 Final. Thanks a lot to all the testers for hanging in there through all the composes! The usual suspects – Paul Whalen, juliuxpigface, and satellit – turned in their usual great performances, with those of us paid to do this for a living (pschindl, roshi and I) trailing in behind them, and juliux also went on a bug reporting tear, as you can see from the numbers.
Bug Reports
Test period: Fedora 23 [FIXME] – Fedora 23 [FIXME] (2015-09-22 – 2015-11-03)
Reporters: 428
New reports: 1008
| Name | Reports submitted1 | Excess reports2 | Accepted blockers3 |
|---|---|---|---|
| Joachim Frieben | 31 | 2 (6%) | 0 |
| Kamil Páral | 27 | 0 (0%) | 2 |
| Adam Williamson | 26 | 6 (23%) | 2 |
| Mikhail | 26 | 1 (3%) | 0 |
| Giulio ‘juliuxpigface’ | 24 | 4 (16%) | 3 |
| David Le Sage | 21 | 2 (9%) | 0 |
| lennart_reuther at web.de | 21 | 1 (4%) | 0 |
| Karel Volný | 19 | 0 (0%) | 0 |
| Christian Stadelmann | 18 | 1 (5%) | 0 |
| Martín Cigorraga | 16 | 3 (18%) | 0 |
| Berend De Schouwer | 13 | 0 (0%) | 0 |
| Václav Kadlčík | 12 | 1 (8%) | 0 |
| ONURALP SEZER | 10 | 1 (10%) | 0 |
| Stephen Gallagher | 10 | 2 (20%) | 0 |
| David Sommerseth | 9 | 0 (0%) | 0 |
| Diogo Campos | 9 | 0 (0%) | 0 |
| Yonatan | 8 | 0 (0%) | 1 |
| Kalev Lember | 8 | 0 (0%) | 0 |
| Robert Antoni Buj Gelonch | 8 | 0 (0%) | 0 |
| Dusty Mabe | 7 | 0 (0%) | 0 |
| Fabio Valentini | 7 | 0 (0%) | 0 |
| lejeczek | 7 | 3 (42%) | 0 |
| Luya Tshimbalanga | 7 | 1 (14%) | 0 |
| nmreis at mail.ru | 7 | 0 (0%) | 0 |
| Egor Zaharov | 6 | 0 (0%) | 0 |
| Erwan GEORGET | 6 | 2 (33%) | 0 |
| Pavel Raiskup | 6 | 0 (0%) | 0 |
| sandeep | 6 | 1 (16%) | 0 |
| Stef Walter | 6 | 0 (0%) | 0 |
| Zbigniew Jędrzejewski-Szmek | 6 | 1 (16%) | 0 |
| Štefan Gurský | 6 | 0 (0%) | 0 |
| 项纪汉 | 6 | 0 (0%) | 0 |
| Rob Tomsick | 5 | 0 (0%) | 1 |
| a.galley | 5 | 0 (0%) | 0 |
| Abhay Kadam | 5 | 0 (0%) | 0 |
| autarch princeps | 5 | 0 (0%) | 0 |
| Eduardo Silva | 5 | 1 (20%) | 0 |
| Francesco Frassinelli (frafra) | 5 | 0 (0%) | 0 |
| joerg.lechner at aol.de | 5 | 0 (0%) | 0 |
| Juan Orti | 5 | 0 (0%) | 0 |
| Leslie Satenstein | 5 | 1 (20%) | 0 |
| Orion Poplawski | 5 | 0 (0%) | 0 |
| Philip Southam | 5 | 0 (0%) | 0 |
| Cole Robinson | 4 | 0 (0%) | 0 |
| Jan Stodola | 4 | 0 (0%) | 0 |
| Langdon White | 4 | 1 (25%) | 0 |
| Marian Csontos | 4 | 1 (25%) | 0 |
| Marko Myllynen | 4 | 0 (0%) | 0 |
| Matthias Runge | 4 | 0 (0%) | 0 |
| Menanteau Guy | 4 | 2 (50%) | 0 |
| RudraB | 4 | 0 (0%) | 0 |
| Vinicius Reis | 4 | 1 (25%) | 0 |
| Zdenek Chmelar | 4 | 0 (0%) | 0 |
| …and also 375 other reporters who created less than 4 reports each, but 514 reports combined! | |||
1 The total number of new reports (including “excess reports”). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn’t take the numbers too seriously, but just as interesting and fun data.
2 Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
3 This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people’s reports as blockers, but this is not reflected in this number.
Numbers here are way up on Beta – as you’d probably expect, with more people likely to test after the Beta release, and likely to have higher standards for expected behaviour. They’re very similar to the Fedora 22 Final numbers. As I mentioned at Beta, you can of course handily spin this positively either way (more reports mean better QA involvement, fewer reports mean the product quality is better), which is always great for PR purposes 😉 Joachim Frieben jumps up a few spots from Beta to the #1 position – awesome work Joachim! – while giuliuxpigface takes the ‘top blocker reporter’ crown with three blockers found, great job Giulio!
Conclusion
That wraps up the Fedora 23 Heroes reports! As always, many many thanks to all those who helped test, and equally great thanks to those who help in ways that aren’t caught by these incomplete and imperfect reports, including all the folks who work hard on tools behind the scenes and people working on testing stable updates and all the other tasks we have. I’m a bit late getting this post up – apologies – so expect another one of these soon as I try to catch up and get the Fedora 24 Heroes properly acknowledged!
Start the discussion by commenting on the auto-created topic at discussion.fedoraproject.org