Hello, and welcome to the Heroes of Fedora: F25 Alpha edition! Heroes of Fedora is written so that the quality of any release can be quickly surveyed by viewing the stats regarding tests performed on
that release, such as Bodhi updates, Bugzilla reports, and release validation testing. In this case, we’ll be looking at F25 Alpha, so let’s get right to it!
Updates Testing
Compared to the F24 Alpha release, there were 996 more testers who worked on F24 Alpha, however the F25 Alpha release had 4 more comments! This could be viewed as an improvement in testing-efficiency, as it took 996 less testers to produce 4 more results!
Test period: Fedora 25 Alpha (2016-07-26 – 2016-08-30)
Testers: 328
Comments1: 2053
1 If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.
Validation Testing
Test period: Fedora 25 Alpha (2016-07-26 – 2016-08-30)
Testers: 27
Reports: 390
Unique referenced bugs: 21
Name | Reports submitted | Referenced bugs1 |
---|---|---|
juliuxpigface | 70 | 1261464 1268622 1312548 1319459 1352680 1361614 1361808 1362736 1367280 1367910 (10) |
pwhalen | 58 | |
kparal | 48 | |
pschindl | 35 | 1369786 1370136 1370222 (3) |
satellit | 29 | 1363915 1364817 (2) |
lnie | 22 | |
sumantrom | 22 | |
lbrabec | 22 | 1369934 (1) |
coremodule | 22 | 1358416 1361614 1364120 1369607 (4) |
frantisekz | 12 | |
me2 | 6 | 1373156 (1) |
adamwill | 5 | |
sujanbu | 5 | |
cmurf | 5 | 1368887 (1) |
kevin | 4 | |
jsedlak | 4 | |
siddharthvipul1 | 4 | |
prakashmishra1598 | 4 | |
satellt | 3 | |
puffi | 2 | |
mattdm | 2 | |
raj550 | 1 | |
sgallagh | 1 | |
mwd5650 | 1 | |
a2batic | 1 | |
bt2112 | 1 | |
tenk | 1 |
1 This is a list of bug reports referenced in test results. The bug itself may not be created by the same person.
Bug Reports
Here are the stats regarding Bugzilla bug reports. Compared to F24 Alpha, there were 72 less reporters and 212 less reports in F25 Alpha. This could be viewed as a sign that Fedora is getting less buggy over time!
Test period: Fedora 25 Alpha (2016-07-26 – 2016-08-30)
Reporters: 76
New reports: 215
Name | Reports submitted1 | Excess reports2 | Accepted blockers3 |
---|---|---|---|
Joachim Frieben | 26 | 1 (3%) | 0 |
lnie | 16 | 2 (12%) | 0 |
Chris Murphy | 15 | 2 (13%) | 0 |
Kamil Páral | 10 | 3 (30%) | 0 |
Yonatan | 10 | 0 (0%) | 0 |
Igor Gnatenko | 9 | 0 (0%) | 0 |
Heiko Adams | 8 | 1 (12%) | 0 |
Emerson Santos | 7 | 1 (14%) | 0 |
Adam Williamson | 6 | 0 (0%) | 3 |
gil cattaneo | 6 | 0 (0%) | 0 |
Mike FABIAN | 6 | 0 (0%) | 0 |
Mikhail | 4 | 0 (0%) | 0 |
Petr Schindler | 4 | 0 (0%) | 0 |
Alex | 3 | 1 (33%) | 0 |
Dan Horák | 3 | 0 (0%) | 0 |
Geoffrey Marr | 3 | 0 (0%) | 0 |
Nivag | 3 | 0 (0%) | 0 |
Zbigniew Jędrzejewski-Szmek | 3 | 0 (0%) | 0 |
Dominika Krejčí | 2 | 0 (0%) | 0 |
Hans de Goede | 2 | 1 (50%) | 0 |
Joel Salas | 2 | 0 (0%) | 0 |
Leslie Satenstein | 2 | 0 (0%) | 0 |
Lukas Brabec | 2 | 0 (0%) | 0 |
Michal Schmidt | 2 | 0 (0%) | 0 |
Mustafa Muhammad | 2 | 0 (0%) | 0 |
Paul Whalen | 2 | 0 (0%) | 0 |
Peter H. Jones | 2 | 1 (50%) | 0 |
Rafael Fonseca | 2 | 0 (0%) | 0 |
Ricardo Ramos | 2 | 0 (0%) | 0 |
satellitgo at gmail.com | 2 | 0 (0%) | 0 |
srakitnican | 2 | 1 (50%) | 0 |
Tomasz Kłoczko | 2 | 0 (0%) | 0 |
Vedran Miletić | 2 | 0 (0%) | 0 |
…and also 43 other reporters who created less than 2 reports each, but 43 reports combined! |
1 The total number of new reports (including “excess reports”). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn’t take the numbers too seriously, but just as interesting and fun data.
2 Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
3 This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people’s reports as blockers, but this is not reflected in this number.
Conclusion
The general trend that has been seen since Fedora 24 Alpha release has been that Fedora is growing as a community, yet getting less buggy as a whole. The above, depending on how it is interpreted, could back this notion up. Thanks to all who participated in testing F25 Alpha, Fedora wouldn’t be what it is without your support. See you for Heroes of Fedora 25 – Beta!
September 30, 2016 — 12:25
Stop that. You put all of testing fake users into this badge.
David Jeremias Vásquez Sicay (davidva) 3
Martin Sehnoutka (msehnout) 3
Maurizio Manfredini (mmanfred) 3
September 30, 2016 — 19:42
I got excited when I saw my name in this list!. Thanks.
October 1, 2016 — 23:56
Congrats, and thanks for helping test Fedora! 🙂
October 4, 2016 — 03:11
You’re welcome!.
October 7, 2016 — 21:55
Well, it’s true that I had fewer time to contribute for F25 (compared to F24 and especially F23), but, to be honest, I’m quite surprised I don’t see myself on the table.
I might be wrong (or misunderstanding the testing phase), but I suspect that some results coming from “Release Validation” fell out from the stats. For example, I remember I tested some composes on that time frame:
– https://fedoraproject.org/wiki/Test_Results:Fedora_25_Branched_20160803.n.0_Desktop
– https://fedoraproject.org/wiki/Test_Results:Fedora_25_Branched_20160807.n.0_Desktop
– https://fedoraproject.org/wiki/Test_Results:Fedora_25_Branched_20160819.n.1_Desktop
Anyway, thank you for sharing this blog post, it’s always interesting. And, as user, I want to say a big thank you to all of our testers, that do an awesome job in order to keep Fedora running smoothly!
—
Giulio (juliuxpigface)
October 9, 2016 — 19:10
Thanks for your help testing, Giulio!
October 26, 2016 — 14:14
Giulio,
See the amended data table above! Thanks for pointing this glaring error out!
Geoff
IRC: coremodule