Heroes of Fedora 23 wraps up

Heroes of Fedora 23 completes, with a look at the heroes of Fedora 23 Final testing.

Wrapping up the Heroes of Fedora for Fedora 23, after the Alpha and Beta posts, it’s time to celebrate all those who contributed to Fedora 23 Final testing! As usual, we’ll be looking at Bodhi feedback on updates, release validation tests, and bug reports.

Updates Testing

Test period: Fedora 23 Final (2015-09-22 – 2015-11-03)
Testers: 173
Comments1: 1399

Name Updates commented
Dmitri Smirnov (cserpentis) 193
Pete Walter (pwalter) 117
Hans Müller (cairo) 109
Chris Sandler (chr77) 96
Carlos Morel-Riquelme (asleqia) 75
Martti Kuosmanen (kuosmanen) 60
Alexander Kurtakov (akurtakov) 50
Piotr Drąg (raven) 46
yuwata 41
Peter Smith (smithp) 37
idviare (idviare) 33
Mukundan Ragavan (nonamedotc) 31
Kalev Lember (kalev) 24
anonymous 22
Daniel Dimitrov (dandim) 22
Filipe Rosset (filiperosset) 20
Parag Nemade (pnemade) 20
decathorpe 19
Kamil Páral (kparal) 19
Adam Williamson (adamwill) 19
Christopher Meng (cicku) 16
Jiří Popelka (jpopelka) 15
Kevin Fenzi (kevin) 14
William Moreno (williamjmorenor) 13
Nie Lili (lnie) 11
Peter Robinson (pbrobinson) 10
Rory Gallagher (earthwalker) 10
johnp117 9
Ken Giusti (kgiusti) 9
Giulio Erler (juliuxpigface) 8
Charles-Antoine Couret (renault) 8
Matthias Runge (mrunge) 7
Lukas Brabec (lbrabec) 6
devo8604 6
Christian Dersch (lupinix) 6
Stef Walter (stefw) 5
Raphael Groner (raphgro) 5
Wolfgang Ulbrich (raveit65) 4
Reindl Harald (hreindl) 4
Orion Poplawski (orion) 4
Luca Ciavatta (cialu) 4
Andreas Nilsson (andreasn) 3
Ankur Sinha (ankursinha) 3
dremor 3
Mat Booth (mbooth) 3
Vojtěch Trefný (vtrefny) 3
robatino 3
Jan Sedlák (jsedlak) 3
nucleo 3
jerboaa 2
Oved Ourfali (ovedo) 2
Marianne Lombard (jehane) 2
Ville Skyttä (scop) 2
Göran Uddeborg (goeran) 2
Denis Fateyev (dfateyev) 2
Martin Babinsky (mbabinsk) 2
Sandro Bonazzola (sbonazzo) 2
Pavel Raiskup (praiskup) 2
Paul Whalen (pwhalen) 2
Lukas Slebodnik (lslebodn) 2
Dennis Gilmore (ausil) 2
Miroslav Grepl (mgrepl) 2
Joachim Backes (backes) 2
Justin W. Flory (jflory7) 2
Haïkel Guémar (hguemar) 2
Piotr Popieluch (piotrp) 2
ngompa 2
Alexander Larsson (alexl) 2
Petr Schindler (pschindl) 2
mbasti 2
Marcela Mašláňová (mmaslano) 2
Thomas Gilliard (satellit) 2
Endi Sukma Dewata (edewata) 2
…and also 100 other reporters who created less than 2 reports each, but 100 reports combined!

1If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.

The numbers here are up on Beta, but behind Fedora 22 Final, for reasons discussed in the Alpha and Beta posts (though it’s encouraging that the numbers went up rather than down from Beta to Final). It’s interesting how people show up at or near the top of the Final numbers who weren’t in the Beta numbers at all, perhaps reflecting keen testers who only install new releases after the Beta comes out, like Dmitri and Carlos – thanks a lot to them!

Validation Tests

Test period: Fedora 23 Final
Testers: 22
Reports: 1363
Unique referenced bugs: 59

Name Reports submitted Referenced bugs1
pwhalen 405 1272646 (1)
juliuxpigface 210 1166980 1181308 1208863 1217591 1228834 1240879 1242467 1247004 1250712 1256456 1259985 1260307 1261464 1262600 1262602 1266722 1266756 1266774 1268589 1268622 1268624 1268649 1268666 1268667 1268677 1269263 1269270 1271061 1271377 1272642 1272646 1272737 1272744 1272762 1273112 1274869 1274904 1274971 1274972 1276226 (40)
satellit 152 1262600 1263988 1266756 1272646 1288756 (5)
pschindl 100 1274193 (1)
roshi 95 1195761 1272614 (2)
adamwill 88 1217591 1261569 1268009 1268176 1269010 1272706 1272737 1273112 1275441 1276140 1276158 1276165 (12)
robatino 55
lbrabec 51
lnie 48 1271459 (1)
sgallagh 41 1273102 1273145 1273167 (3)
kparal 40
dustymabe 20
wolnei 12
kakoskin 11 1276278 (1)
kevin 10
jsedlak 8
fab 6
jdulaney 4
mkrizek 3
bradfirj 2
coconut 1
tflink 1

1 This is a list of bug reports referenced in test results. The bug itself may not be created by the same person.

We’re down slightly in testers compared to Fedora 22 here (though in fact now I look at the F22 tables closely, several of the ‘testers’ for F22 Final had just one test, and some of them are actually data entry errors, like user name typos or bug numbers). The number of reports is up significantly, though this tracks strongly with the number of composes we have to make (the more composes, the more reports), and we had 7 composes for Fedora 22 Final but 12 for Fedora 23 Final. Thanks a lot to all the testers for hanging in there through all the composes! The usual suspects – Paul Whalen, juliuxpigface, and satellit – turned in their usual great performances, with those of us paid to do this for a living (pschindl, roshi and I) trailing in behind them, and juliux also went on a bug reporting tear, as you can see from the numbers.

Bug Reports

Test period: Fedora 23 [FIXME] – Fedora 23 [FIXME] (2015-09-22 – 2015-11-03)
Reporters: 428
New reports: 1008

Name Reports submitted1 Excess reports2 Accepted blockers3
Joachim Frieben 31 2 (6%) 0
Kamil Páral 27 0 (0%) 2
Adam Williamson 26 6 (23%) 2
Mikhail 26 1 (3%) 0
Giulio ‘juliuxpigface’ 24 4 (16%) 3
David Le Sage 21 2 (9%) 0
lennart_reuther at web.de 21 1 (4%) 0
Karel Volný 19 0 (0%) 0
Christian Stadelmann 18 1 (5%) 0
Martín Cigorraga 16 3 (18%) 0
Berend De Schouwer 13 0 (0%) 0
Václav Kadlčík 12 1 (8%) 0
ONURALP SEZER 10 1 (10%) 0
Stephen Gallagher 10 2 (20%) 0
David Sommerseth 9 0 (0%) 0
Diogo Campos 9 0 (0%) 0
Yonatan 8 0 (0%) 1
Kalev Lember 8 0 (0%) 0
Robert Antoni Buj Gelonch 8 0 (0%) 0
Dusty Mabe 7 0 (0%) 0
Fabio Valentini 7 0 (0%) 0
lejeczek 7 3 (42%) 0
Luya Tshimbalanga 7 1 (14%) 0
nmreis at mail.ru 7 0 (0%) 0
Egor Zaharov 6 0 (0%) 0
Erwan GEORGET 6 2 (33%) 0
Pavel Raiskup 6 0 (0%) 0
sandeep 6 1 (16%) 0
Stef Walter 6 0 (0%) 0
Zbigniew Jędrzejewski-Szmek 6 1 (16%) 0
Štefan Gurský 6 0 (0%) 0
项纪汉 6 0 (0%) 0
Rob Tomsick 5 0 (0%) 1
a.galley 5 0 (0%) 0
Abhay Kadam 5 0 (0%) 0
autarch princeps 5 0 (0%) 0
Eduardo Silva 5 1 (20%) 0
Francesco Frassinelli (frafra) 5 0 (0%) 0
joerg.lechner at aol.de 5 0 (0%) 0
Juan Orti 5 0 (0%) 0
Leslie Satenstein 5 1 (20%) 0
Orion Poplawski 5 0 (0%) 0
Philip Southam 5 0 (0%) 0
Cole Robinson 4 0 (0%) 0
Jan Stodola 4 0 (0%) 0
Langdon White 4 1 (25%) 0
Marian Csontos 4 1 (25%) 0
Marko Myllynen 4 0 (0%) 0
Matthias Runge 4 0 (0%) 0
Menanteau Guy 4 2 (50%) 0
RudraB 4 0 (0%) 0
Vinicius Reis 4 1 (25%) 0
Zdenek Chmelar 4 0 (0%) 0
…and also 375 other reporters who created less than 4 reports each, but 514 reports combined!

1 The total number of new reports (including “excess reports”). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn’t take the numbers too seriously, but just as interesting and fun data.
2 Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
3 This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people’s reports as blockers, but this is not reflected in this number.

Numbers here are way up on Beta – as you’d probably expect, with more people likely to test after the Beta release, and likely to have higher standards for expected behaviour. They’re very similar to the Fedora 22 Final numbers. As I mentioned at Beta, you can of course handily spin this positively either way (more reports mean better QA involvement, fewer reports mean the product quality is better), which is always great for PR purposes 😉 Joachim Frieben jumps up a few spots from Beta to the #1 position – awesome work Joachim! – while giuliuxpigface takes the ‘top blocker reporter’ crown with three blockers found, great job Giulio!

Conclusion

That wraps up the Fedora 23 Heroes reports! As always, many many thanks to all those who helped test, and equally great thanks to those who help in ways that aren’t caught by these incomplete and imperfect reports, including all the folks who work hard on tools behind the scenes and people working on testing stable updates and all the other tasks we have. I’m a bit late getting this post up – apologies – so expect another one of these soon as I try to catch up and get the Fedora 24 Heroes properly acknowledged!