This is a weekly report from the I&R (Infrastructure & Release Engineering) Team. It also contains updates for CPE (Community Platform Engineering) Team as the CPE initiatives are in most cases tied to I&R work.
We provide you both infographic and text version of the weekly report. If you just want to quickly look at what we did, just look at the infographic. If you are interested in more in depth details look below the infographic.
Week: 27 May – 31 May, 2024
Infrastructure & Release Engineering
The purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
List of planned/in-progress issues
Fedora Infra
- In progress:
- Replace failed drive in bvmhost-x86-01.stg.iad2.fedoraproject.org
- Getting feedback from Kevin on Zabbix configuration, hopefully, ready to close.
- rhel7 EOL
- Migration of registry.fedoraproject.org to quay.io
- add monitoring for dnf countme
- Replace Nagios with Zabbix in Fedora Infrastructure
- notifications do not notify
- PDC retirement
- Move from iptables to firewalld
- fedoraplanet.org: Upgrade Venus to Pluto
- Move mailman to newer release of Fedora or CentOS
- Setup RISC-V builder(s) VM in Fedora Infrastructure
- Update compose hosts to get latest pungi release (4.6.0)
- Deploy new sign hardware/software
- Commits don’t end up on the scm-commits list
- Create monitoring tool for rabbitmq certificates
- Request for new FAS group: miracle-sig
- Password reset issues on accounts.centos.org
- Kanban – OpenShift app bringup
- Done:
- Documentation for arranging a hard drive replacement was written.
- DNF countme minor changes post migration
- Draft SOP for Replacing Failed Harddrive
- [staging] Expired API token for toddlers bugzilla
- Userlist Spam
- coreos-koji-tagger: koji-keytab fails
- Master mirror TCP buffer size
- rhel7 – MBS
- Outage: Upgrade of Copr servers – 2024-05-22 09:00 UTC
- Koschei reports a lot of “unknown” states
- Need room added to Fedora space and Fedora bot account to send messages to room
CentOS Infra including CentOS CI
- In progress:
- Done:
- Set up compose testing for c10s
- koji set-build-volume throws errors for some builds
- Stream 10 mass signing (infra part)
- Ipsilon DB clean-up
- Team Cymru mirror IP change
- Duffy nodes stuck in provisioning/contextualizing loop #4
- Unable to get kerberos working due to KDC/infra change and firewall blocking traffic
- Invalidate CloudFront cache for c10s composes
Release Engineering
- In progress:
- Fedora 37 EOL Archiving was done last week, and the removal for that will be done next week along with Fedora 38.
- From the releng meeting yesterday, some upcoming work from epel10 will need releng assistance, this will be discussed more in the next meeting. Carl will be filing tickets for each individual item of work, later on, we plan to document this.
- Packages that fail to build SRPM are not reported during the mass rebuild bugzillas
- i686 builders need to use 32-bit inode numbers
- When orphaning packages, keep the original owner as co-maintainer
- Use an automated script to control checksums of compose images
- Create an ansible playbook to do the mass-branching
- Package retirements are broken in rawhide
- Implement checks on package retirements
- Support for self-service package un-retirement
- F38 End of Life
- Update bootloader components assignee to “Bootloader Engineering Team”for Improved collaboration
- Cleaning old stuff from koji composes directories
- Untag containers-common-0.57.1-6.fc40
- Renaming distribution media for Fedora Server
- Done:
- Documentation for Post Release Cleanup was also written.
- Silverblue aarch64 installer image compose always fails on F38 and Rawhide
- Fixes for release-candidate.sh in pungi-fedora
- Side tag for Perl 5.40
- Side tag for Python 3.13
- Unretirement request: rpms/wingpanel-indicator-keyboard
- Unretirement request: rpms/wingpanel-indicator-bluetooth
- Fedora 37 missing from archives?
- Create EPEL 8.9 archive snapshot
- Unretire python-oslo-messaging
- python39-pyasn1-epel-0.4.8-1.el8 not tagged
- Unblock redfish-finder f40 and f39 koji tags
- epel8 Koji buildroot has RHEL 8.9 packages, should be RHEL 8.10
- Unretire rpms/redfish-finder
- Can’t build packages after repos creation
- Missing F40 vagrant box
- mirror CentOS Stream 10 in Fedora infrastructure
CPE Initiatives
EPEL
Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS, Scientific Linux (SL) and Oracle Linux (OL).
Updates
- Got maintenance done on Fedpkg tests in preparation to EPEL10 Patches
- Worked with RelEng to resolve issues with centos-10-sync script on batcave
- Participated in a customer call with Disney to discuss EPEL Next and EPEL 10
- Submitted c10s change to implement distcore macro for EPEL 10
- Set up demo of EPEL 10 tagging structure in staging koji
If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on matrix.
Start the discussion by commenting on the auto-created topic at discussion.fedoraproject.org