This is a weekly report from the I&R (Infrastructure & Release Engineering) Team. We provide you both infographic and text version of the weekly report. If you just want to quickly look at what we did, just look at the infographic. If you are interested in more in depth details look below the infographic.

Week: 26 May – 30 May 2025

Infrastructure & Release Engineering

The purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
List of planned/in-progress issues

Fedora Infra

• In progress:
  • Please register my testing instance of Fedora Infrastructure apps to OIDC
  • Planned Outage – update/reboots – 2025-05-22 21:00 UTC
  • Forgejo: Owner access to @jflory7 for @CommOps
  • Move copr_hypervisor group from iptables to nftables
  • tmpwatch removed from ansible
  • please don’t remove enrolled centos machines from IPA in staging
  • wiki upgrade before f40 eol
  • redeploy aws proxies
  • Disable self-serve project creation on pagure.io
  • Link in staging distgit instance leads to prod auth
  • re-add datagrepper nagios checks (and add to zabbix?)
  • Fix logrotate on kojipkgs01/02
  • 2025 datacenter move (IAD2->RDU3)
  • Broken link for STG IPA CA certificate, needed for staging CentOS Koji cert
  • [CommOps] Open Data Hub on Communishift
  • retire easyfix
  • Deploy Element Server Suite operator in staging
  • Pagure returns error 500 trying to open a PR on https://src.fedoraproject.org/rpms/python-setuptools-gettext
  • maubot-meetings bot multi line paste is cut
  • setup ipa02.stg and ipa03.stg again as replicas
  • Move OpenShift apps from deploymentconfig to deployment
  • The process to update the OpenH264 repos is broken
  • httpd 2.4.61 causing issue in fedora infrastructure
  • Support allocation dedicated hosts for Testing Farm
  • EPEL minor version archive repos in MirrorManager
  • Add fedora-l10n pagure group as an admin to the fedora-l10n-docs namespace projects
  • vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN
  • Add yselkowitz to list to notify when ELN builds fail
  • Cleaning script for communishift
  • Move from iptables to firewalld
  • Port apps to OIDC
  • Help me move my discourse bots to production?
  • Replace Nagios with Zabbix in Fedora Infrastructure
  • Migration of registry.fedoraproject.org to quay.io
• Closed:
  • Forbidden error when trying to open your fork of repository
  • koji s390 builder unhealthy with network issue
  • Spam on -devel and Fedora join lists
  • Need to delete user account in FAS that has been already deleted in Discourse (discussion.fedoraproject.org) due to violations (spam, AI, etc.)

CentOS Infra including CentOS CI

• In progress:
  • Release Improvements
  • bump buildsys-macros pkgs for cbs.centos.org
  • Please retarget hs+gnome to c10s
  • Pleasechange dist -> distprefix for Proposed Updates SIG
  • Please add a new asahi tag for the Hyperscale SIG
  • New Build Targets and Tags for the Kmods SIG
  • Wrapper to check / create projects on GitLab using the REST API
  • Write a script to cleanup Duffy DB after retiring a pool
  • create Oauth2 tokens for testing instance for OpenQA CentOS stream testing purposes
  • [spike] : investigating needed deps (poetry) for duffy on el9
  • [spike] : investigating options/alternatives for the upcoming DC move
• Closed:
  • resilient-storage repo for CentOS Stream 9 gives a metadata checksum error
  • add centos10s-buildroot to storage10s-ceph-tentacle-el10s
  • git.centos.org under AI scrapers load
  • Possibility of a Lower Kernel version support

Release Engineering

• In progress:
  • please create epel10.1 based el10.1-openjdk tag
  • Fedora-KDE-42-1.1-x86_64-CHECKSUM has wrong ISO filename
  • F40 end of life
  • Fix OpenH264 tagging issues
  • Turn EPEL minor branching scripts into playbooks
  • Mass retirement of packages with uninitialized rawhide branch
  • Please send openh264-2.6.0 to Cisco
  • 300+ F42FTBFS bugzillas block the F41FTBFS tracker
  • Packages that have not been rebuilt in a while or ever
  • Send compose reports to a to-be-created separate ML
  • Could we have fedoraproject-updates-archive.fedoraproject.org for Rawhide?
  • Investigate and untag packages that failed gating but were merged in via mass rebuild
  • a few mass rebuild bumps failed to git push – script should retry or error
  • Package retirements are broken in rawhide
  • Update pungi filters
  • Implement checks on package retirements
  • Untag containers-common-0.57.1-6.fc40
  • Provide stable names for images
  • Packages that fail to build SRPM are not reported during the mass rebuild bugzillas
  • When orphaning packages, keep the original owner as co-maintainer
  • Create an ansible playbook to do the mass-branching
  • RFE: Integration of Anitya to Packager Workflow
  • Fix tokens for ftbfs_weekly_reminder. script
  • Update bootloader components assignee to “Bootloader Engineering Team”for Improved collaboration
• Closed:
  • Error 500 when creating branch
  • repo creation process for python-xnat4tests failed
  • untag rust-1.87.0-1.fc43 from rawhide
  • Unretire rust-migrations_macros
  • untag meson-1.8.0-1.fc43 please
  • Conflicting OpenH264 package issues
  • Please rescue partially-initialized repo rpms/rust-postcard from releng-bot
  • Remove branch epel10 in testcloud repository
  • Side tag for Python 3.14
  • Please add lua-cqueues and lua-basexx to epel10 tag
  • Stalled EPEL package: python-google-cloud-storage
  • Epel branch for credcheck is not working with koji
  • Hyprlock package is blocked in koji
  • Stalled EPEL package: python-hatch-requirements-txt
  • Unretire datanommer-commands and python-datanommer-models packages
  • Fedora Kinoite Rawhide aarch64 builds failing since 2025-01-31

If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on matrix.