This is a weekly report from the I&R (Infrastructure & Release Engineering) Team. It also contains updates for CPE (Community Platform Engineering) Team as the CPE initiatives are in most cases tied to I&R work.

We provide you both infographic and text version of the weekly report. If you just want to quickly look at what we did, just look at the infographic. If you are interested in more in depth details look below the infographic.

Week: 16 September – 20 September 2024

Infrastructure & Release Engineering

The purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
List of planned/in-progress issues

Fedora Infra

• In progress:
  • Create pagure API token with group_modify ACLs
  • Need some OIDC credentials for com blog in STG
  • requesting access for GitLab test instances
  • RFE: fedoras container image register change
  • [CommOps] MediaWiki – HitCounter Extension
  • vmhost-x86-11.stg.iad2.fedoraproject.org has a failed disk
  • httpd 2.4.61 causing issue in fedora infrastructure
  • Support allocation dedicated hosts for Testing Farm
  • Feature / Change request: make the Fedora bugzilla more accessible
  • Searching mailing list archives does not work
  • Moderating mailing list viewing message shows “This held message has been lost.”
  • EPEL minor version archive repos in MirrorManager
  • vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN
  • Recurring issue that Bugzilla stops sending messages to fedora-messaging
  • Cleaning script for communishift
  • rhel7 eol
  • rhel7 EOL – github2fedmsg
  • Setup RISC-V builder(s) VM in Fedora Infrastructure
  • Move from iptables to firewalld
  • notofications do not notify
  • fedmsg -> fedora-messaging migration tracker
  • rhel9 adoption
  • Create monitoring tool for rabbitmq certificates
  • Replace Nagios with Zabbix in Fedora Infrastructure
  • DMARC validation failed for mail from lists.fp-o
  • Migration of registry.fedoraproject.org to quay.io
  • Commits don’t end up on the scm-commits list
• Done:
  • Mouse randomly highlights things on its own. steel series model sensei just highlights without command or key press.
  • f41 aarch64 and x86_64 mirrorlist/metalink issues
  • Unable to upload new package sources
  • Koschei “is not available”
  • New builder (AWS) for Content Resolver
  • Communishift namespace creation
  • bugzilla2fedmsg is not receiving messages from Red Hat’s bus anymore
  • Shut Down m4.10xLarge AWS instance
  • fedoraplanet.org is dead
  • The CentOS Stream s390x “extra” vs “extras” mirroring problem
  • Spam received on fedora-devel
  • Create fedora/fedora-netboot repo on quay.io
  • Inactive provenpackagers for the F41 cycle
  • Communishift namespace creation – commops-analytics
  • Koji can get backed up with scratch builds from two different CI pipelines
  • Update compose hosts to get latest pungi release (4.6.0)
  • Tests fixed for MDAPI where frozen repos are not accepted zero
  • MDAPI v3.1.6 (GitHub/PyPI) has been deployed to production

CentOS Infra including CentOS CI

• In progress:
  • Create fullfiletimelist on CentOS Stream mirrors
  • Release Improvements
  • mirror-request
  • Auth issues on blog platforms
• Done:
  • replace TLS certificates in CentOS Stream infra
  • Import mirror/donate info/content from old wiki to website
  • c8s-build repo is 403 (breaks Fedora CI)
  • Uploading sources failing with 403 error
  • new mirror
  • Reinstall/migrate some new/older sponsored servers
  • contact all sponsors for mirror.centos.org pool

Release Engineering

• In progress:
  • Please create epel10-openh264 koji tag
  • some f39 updates stuck in testing → stable due to tagging issues
  • fedpkg request-branch –all-releases Attempts to Create F42 & Releng Bot Fails
  • The `openh264` package fails to install because of the GPG key
  • Fedora 41 Mass Branching Tracker
  • Investigate and untag packages that failed gating but were merged in via mass rebuild
  • a few mass rebuild bumps failed to git push – script should retry or error
  • Some (?) retired packages not actually getting retired since ~2 days ago
  • Drop modularity from EPEL8.
  • unmaintained bot account: dummy-test-package-gloster gating pipeline tests broken
  • Renaming distribution media for Fedora Server
  • Package retirements are broken in rawhide
  • Implement checks on package retirements
  • Untag containers-common-0.57.1-6.fc40
  • orphan-all-packages.py should remove bugzilla_contact entries from fedora-scm-requests as well
  • Packages that fail to build SRPM are not reported during the mass rebuild bugzillas
  • When orphaning packages, keep the original owner as co-maintainer
  • Create an ansible playbook to do the mass-branching
  • Cleaning old stuff from koji composes directories
  • Fix tokens for ftbfs_weekly_reminder. script
  • Update bootloader components assignee to “Bootloader Engineering Team”for Improved collaboration
• Done:
  • Please sign the Fedora-IoT-41-20240913.0 compose for F41 IoT Beta
  • Please fix or delete f40 and f41 branches for python-sphinxcontrib-globalsubs
  • Unretire rpm-local-generator-support
  • Repository for ‘pyliblo3’ was created, but now we’re going to call it python-pyliblo3
  • Create Fedora 41 Beta candidates
  • Please re tag rust-exacl-0.12.0-2.el9 to replace rust-exacl-0.12.0-1.el9
  • epel10 new branch request for rpms/perl-Devel-ArgNames failed
  • Unretire rust-debug-helper
  • release-candidate.sh adjustments needed
  • F41 stable push requests
  • Creating an “epel10” for “rpms/perl-JSON-Any” fails
  • Cannot build libxcrypt-epel for ELN
  • Delete infoblox-client src repo and RPMS
  • Unretire python-importlib-resources

CPE Initiatives

EPEL

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS, Scientific Linux (SL) and Oracle Linux (OL).

Updates

• EPEL 10 source package count: 1688
• Ongoing planning for EPEL 10 mock configs
• Enabled bootstrap container for CentOS Stream 10 in mock
• Implement bodhi pagination for fedora-distro-aliases
• libspelling soname upgrade in rawhide

Community Design

CPE has few members that are working as part of Community Design Team. This team is working on anything related to design in Fedora Community.

Updates

• CPE ticket
• Deal Making Team
• Ignite Logo
• Gnome Asia
• Podman Desktop: UX: Mockups for Docker Compatibility page

ARC Investigations

The ARC (which is a subset of the CPE team) investigates possible initiatives that CPE might take on.

Updates

• Dist Git Comparison
  • We have caught up with the 80 user stories from the community on the comparison of GitLab and Forgejo
  • Updated documentation can be found here
    • https://fedora-arc.readthedocs.io/en/latest/dist-git-comparison/index.html
  • Work in progress on representing the infrastructure user stories to compare the convenience of hosting either options
  • Work in progress on seeding the testing deployments of GitLab and Forgejo for replicating the release workflow
  • Original invitation thread for “Inviting Testers” has been updated with the updates on the A.R.C. documentation for review

List of new releases of apps maintained by CPE

• Patch update of MD API from 3.1.5 to 3.1.6 on 2024-09-18

If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on matrix.