This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on (

Highlights of the week

Infrastructure & Release Engineering

Goal of this Initiative

Purpose of this team is to take care of day to day business regarding
CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS
infrastructure and preparing things for the new Fedora release
(mirrors, mass branching, new namespaces etc.). The ARC (which is a
subset of the team) investigates possible initiatives that CPE might
take on.


Fedora Infra

  • Found we had users with _ . – in usernames and were allowing one character. Fixed noggin and notified all users affected to make new accounts. Will close invalid ones at end of month.
  • Got 3 new x86 machines added to openqa for additional capacity.
  • Got 5 new/old x86 machines ready to add to ocp4 clusters.
  • Tracked down a bodhi bug with adamw and it got fixed and fix deployed!
  • Merged a bunch of infra/ansible PR’s that had been waiting.
  • Found that notifs-backend01 is the last thing keeping fas2 around. 🙁

CentOS Infra including CentOS CI

  • SIGs can now push their centos-release* pkgs to for public consumption.
  • Big storage reorganization (multiple HDD issues, or pending – pfa mode-) , going from out of warranty to still out of warranty node (risk mitigation).
  • Setting up two new IBM Power 9 (ppc64le) boxes for Stream 9 , SIGs and CI testing.
  • WIP: new infra for debuginfod service for Stream 8 and 9.
  • Business as usual:
    — New cbs/koji tags and modifying some (welcome Tomas Hrcka to the CentOS infra team and first ticket assigned to him: adding EPEL{-next} for buildroots).
    — Some new mirrors for Stream 9.

Release Engineering

  • Mass rebuild finished, then we did another pass, and there’s going to be yet one more when latest gcc finishes building.

CentOS Stream

Goal of this Initiative

This initiative is working on CentOS Stream/Emerging RHEL to make this
new distribution a reality. The goal of this initiative is to prepare
the ecosystem for the new CentOS Stream.


  • MR is mostly ready to light up the Stream 8 koji tag structure in the consolidated buildsystem.
  • Preparing for module branching .
  • Stream 9 Buildsystem slated for a cage move on 11-Mar-2022.

CentOS Duffy CI

Goal of this Initiative

Duffy is a system within CentOS CI Infra which allows tenants to provision and
access bare metal resources of multiple architectures for the purposes of
CI testing.
We need to add the ability to checkout VMs in CentOS CI in Duffy. We have
OpenNebula hypervisor available, and have started developing playbooks which
can be used to create VMs using the OpenNebula API, but due to the current state
of how Duffy is deployed, we are blocked with new dev work to add the
VM checkout functionality.


  • Ongoing:
    — Legacy API.
    — Node pool maintenance.

Image builder for Fedora IoT

Goal of this Initiative

Integration of Image builder as a service with Fedora infra to allow Fedora IoT migrate their pipeline to Fedora infra.


  • The team is focusing on getting all components installed locally:
    — Osbuild-composer
    — Koji + plugins
  • Hopefully will be in a good place to talk to image builder from koji stg once we know what setting up the plugins looks like.


Goal of this Initiative

This initiative is to separate Bodhi into multiple sub packages, fix integration and unit tests in CI, fix dependency management and automate part of the release process.
Read ARC team findings in detail at:


  • Version 5.7.4 released.


Goal of this initiative

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL).

EPEL packages are usually based on their Fedora counterparts and will never conflict with or replace packages in the base Enterprise Linux distributions. EPEL uses much of the same infrastructure as Fedora, including buildsystem, bugzilla instance, updates manager, mirror manager and more.


  • EPEL9 up to 1539 source packages (increase of 193 from last week).
  • Several new packagers have expressed specific interest in EPEL.
  • Three talks related to EPEL happening next week at the February CentOS Dojo.

Kindest regards,
CPE Team