This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on (

Highlights of the week

Infrastructure & Release Engineering

Goal of this Initiative

Purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work. It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.). The ARC (which is a subset of the team) investigates possible initiatives that CPE might take on.


Fedora Infra

  • Fixed fasjson in stg (was stuck on a image pull)
  • Added 200GB to ostree netapp volume
  • Retired iddev and simple-koji-ci cloud instances
  • Declared the sssd bug fixed (hadn’t happened in 2 weeks)

CentOS Infra including CentOS CI

  • Stream 9 available in CI (x86_64 only though)
    • Newer python-cicolient
    • Duffy2 hotfix for paramiko issue with el9
  • Exploring options for secureboot for SIGs
  • Deploying Duffy Dev Lab for initiative
  • Business as usual (new tags created for SIGs, ….)

Release Engineering

  • Updated critpath packages for all releases
  • F35 final RC request landed
    • Compose is finished with incomplete state armhfp container aarch64 KDE and failed

CentOS Stream

Goal of this Initiative

This initiative is working on CentOS Stream/Emerging RHEL to make this new distribution a reality. The goal of this initiative is to prepare the ecosystem for the new CentOS Stream.


  • Work continues on Content Resolver buildroot support
  • We’re now running repoclosure before we sync to the mirrors

Datanommer/Datagrepper V.2

Goal of this Initiative

The datanommer and datagrepper stacks are currently relying on fedmsg which we want to deprecate.
These two applications need to be ported off fedmsg to fedora-messaging. As these applications are ‘old-timers’ in the fedora infrastructure, we would also like to look at optimizing the database or potentially redesigning it to better suit the current infrastructure needs.
For a phase two, we would like to focus on a DB overhaul.


  • Import crashed because of a database schema design decision that didn’t account for the size of our messages, it’s fixed and the import started again because the schema update on existing data would take a lot of time too. ETA is back to 70 days.

CentOS Duffy CI

Goal of this Initiative

Duffy is a system within CentOS CI Infra which allows tenants to provision and access bare metal resources of multiple architectures for the purposes of CI testing.
We need to add the ability to checkout VMs in CentOS CI in Duffy. We have OpenNebula hypervisor available, and have started developing playbooks which can be used to create VMs using the OpenNebula API, but due to the current state of how Duffy is deployed, we are blocked with new dev work to add the VM checkout functionality.


  • Took stock and decided to rewrite
  • Cleaned up branches
  • Boilerplate work

Kindest regards,
CPE Team