This is a weekly report from the I&R (Infrastructure & Release Engineering) Team. We provide you both infographic and text version of the weekly report. If you just want to quickly look at what we did, just look at the infographic. If you are interested in more in depth details look below the infographic.
Week: 24th Feb – 28th Feb 2025

Infrastructure & Release Engineering
The purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
List of planned/in-progress issues
Fedora Infra
- In progress:
- Redeploy WCIDFF to production after the changes in source
- Please provide commit acces for nikromen to fedora-infra/ansible
- re-add datagrepper nagios checks (and add to zabbix?)
- Fix logrotate on kojipkgs01/02
- RISC-V Koji Administration
- 2025 datacenter move (IAD2->RDU3)
- [CommOps] Open Data Hub on Communishift
- retire easyfix
- Add StartInstanceRefresh permission for fedora-ci-testing-farm user in AWS
- Deploy Element Server Suite operator in staging
- Create CentOS calendar
- Pagure returns error 500 trying to open a PR on https://src.fedoraproject.org/rpms/python-setuptools-gettext
- a real domain name for konflux
- Create a POC integration in Konflux for fedora-infra/webhook-to-fedora-messaging
- maubot-meetings bot multi line paste is cut
- setup ipa02.stg and ipa03.stg again as replicas
- Manage our new testing.farm domain via AWS Route53
- Add support for creating RDS instances under `testing-farm-` prefix
- Move OpenShift apps from deploymentconfig to deployment
- The process to update the OpenH264 repos is broken
- httpd 2.4.61 causing issue in fedora infrastructure
- Support allocation dedicated hosts for Testing Farm
- EPEL minor version archive repos in MirrorManager
- vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN
- Add yselkowitz to list to notify when ELN builds fail
- Cleaning script for communishift
- Setup RISC-V builder(s) VM in Fedora Infrastructure
- Move from iptables to firewalld
- Help me move my discourse bots to production?
- rhel9 adoption
- Replace Nagios with Zabbix in Fedora Infrastructure
- Migration of registry.fedoraproject.org to quay.io
- Done:
- Spam accounts in pagure
- Latest update of gnutls causing NetworkManager to fail to start on ppc64le machines
- id.stg.fedoraproject.org/ipa/ui redirects to https://ipa01.stg.iad2.fedoraproject.org/ipa/ui/
- Please add a few new sponsors to the fedora-join FAS group
- [RISC-V] Add a Koji profile to ‘fedora-packager’ RPM (once things stabilize)
- SAP Certified Associate: SAP S/4HANA Asset Management Certification
- Sync Staging Bohdi and Koji with Production
- “Connection closed” when SSH’ing to fedorapeople.org
- Missing stylesheet on the wiki page – partially
- Unable to merge pull request for sssd pacakge
- Need CI container image with sudo enabled user
- Centos messages to Fedora Messaging don’t specify content encoding and severity
- Cannot login to copr for the past few weeks
- Retirement of `monitor-gating` tracker
- Need to delete user account in FAS that has been already deleted in Discourse (discussion.fedoraproject.org) due to violations (spam, AI, etc.)
- Login issues on site, missing download links, others…
CentOS Infra including CentOS CI
- In progress:
- Increase Storage capacity for koji built artifacts
- Testing Jenkins – c10s x86_64 metal doesn’t provision
- Release Improvements
- [spike] : investigating needed deps (poetry) for duffy on el9
- Move cloud.centos.org to its new CDN setup
- Onboarding new infra SIG member
- Redesign mirror network due to Equinix stopping OSS sponsorship
- Migrate main backup storage pool to different hardware
- Making CentOS Stream CoreOS available
- [spike] : investigating options/alternatives for the upcoming DC move
- Done:
- CentOS Stream package signing not working
- Testing Jenkins won’t let us log in
- Access to jenkins-nfs-ganesha – member add request to ocp-cico-nfs-ganesha.
- CentOS CI – OCP4 migration: NFS-Ganesha cluster access
- CentOS Stream new mirror
- Migrate NS glue records to new infra
- [spike] : investigating ipsilon 2.1.0 => 3.0.x upgrade
Release Engineering
- In progress:
- Branch cleanup: please remove the ‘rawhi’ branch of rust-tree-sitter-bash
- Unretire datanommer-commands and python-datanommer-models packages
- Create `image-builder-build` koji build group
- Retirements broken in Rawhide
- Please untag tinysparql-3.8~rc-3.fc42
- Fedora 42 Mass Branching Tracker
- 300+ F42FTBFS bugzillas block the F41FTBFS tracker
- Packages that have not been rebuilt in a while or ever
- Fedora 42 Mass Rebuild Tracker
- Send compose reports to a to-be-created separate ML
- .sqlite metadata missing in f41-updates and f41-updates-testing repositories
- please create epel10 based el10-openjdk tag
- Please send openh264-2.4.1-1.el10_0 to Cisco
- Could we have fedoraproject-updates-archive.fedoraproject.org for Rawhide?
- Investigate and untag packages that failed gating but were merged in via mass rebuild
- a few mass rebuild bumps failed to git push – script should retry or error
- Package retirements are broken in rawhide
- Implement checks on package retirements
- Untag containers-common-0.57.1-6.fc40
- orphan-all-packages.py should remove bugzilla_contact entries from fedora-scm-requests as well
- Packages that fail to build SRPM are not reported during the mass rebuild bugzillas
- When orphaning packages, keep the original owner as co-maintainer
- Create an ansible playbook to do the mass-branching
- RFE: Integration of Anitya to Packager Workflow
- Fix tokens for ftbfs_weekly_reminder. script
- Update bootloader components assignee to “Bootloader Engineering Team”for Improved collaboration
- Done:
- BuildError: package python-robotframework not in list for tag epel10.1-testing-candidate
- Stalled EPEL package: sshpass
- need help with epel for rpms/vile
- Unretirement request: rust-mp4parse
- package php-phpunit-php-code-coverage12 not in list for tag f42-updates-candidate
- Unretire plexus-interactivity
- The openh264 package fails to install on rawhide because of GPG key
- Unretire woodstox-core
- Please remove the obs-studio flatpak from the registry
- Request for permissions to access stg servers, dherrera
- ELN re-signing is incomplete
- rpms/sssd – The permissions on this repository are being updated.
- please remove unwanted rpmdevtools commit accidentally pushed to rawhide branch
- Missing rawhide branch for recently created package ‘pybind11-json’
- package retirements are not getting processed
- Retired epel packages not being removed from epelX-build
If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on matrix.
Start the discussion by commenting on the auto-created topic at discussion.fedoraproject.org