Category: Infrastructure (page 1 of 10)

All articles in this category are related to the Infrastructure team in the Fedora Project. https://fedoraproject.org/wiki/Infrastructure

CPE Weekly Update – Week 25 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 20th – 24th June 2022

Highlights of the week

Infrastructure & Release Engineering

Goal of this Initiative

The purpose of this team is to take care of day-to-day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
The ARC (which is a subset of the team) investigates possible initiatives that CPE might take on.
Link to planning board: https://zlopez.fedorapeople.org/I&R-2022-06-22.pdf
Link to docs: https://docs.fedoraproject.org/en-US/infra/

Update

Fedora Infra

  • Most apps have moved over to the OpenShift4 cluster. Hopefully, the transition should be finishing up this week.
  • Wiki: All upgraded in production and working (thanks Ryan!)
  • Resultsdb: All moved over to OpenShift 4 in prod and working (thanks Leo!)
  • Business proceeding as usual

CentOS Infra including CentOS CI

  • Kerberos settings switch for git.centos.org (kcm on el8 vs keyring on el7) for lookaside upload cgi
  • Issue on iad2 hosted reference mirror (epel.next and mirrormanager), all fixed now
  • Duffy CI ongoing tasks and deployments (all announced)
  • Equinix nodes migration (on their request)
  • Business proceeding as usual

Release Engineering

  • Compose-tracker updated to f36 in staging, production happening tomorrow
  • Python 3.11 merged to rawhide
  • MBS randomly fails to process builds
  • Rawhide compose failures recently (syslinux retirement, then python 3.11 merge) all fixed now
  • Business proceeding as usual

CentOS Stream

Goal of this Initiative

This initiative is working on CentOS Stream/Emerging RHEL to make this new distribution a reality. The goal of this initiative is to prepare the ecosystem for the new CentOS Stream.

Updates

  • CentOS Stream 8: Manually keeping regular RPMs and module RPMs updated on the koji.stream server as current updates are composed and released.

CentOS Duffy CI

Goal of this Initiative

Duffy is a system within CentOS CI infrastructure allowing tenants to provision and access machines (physical and/or virtual, of different architectures and configurations) for the purposes of CI testing. Development of Duffy is largely finished, we’re currently planning and testing deployment scenarios.

Updates

  • Release version 3.2.1
  • Docs, docs, docs and a Dojo

Package Automation (Packit Service)

Goal of this initiative

Automate RPM packaging of infra apps/packages

Updates

  • Mostly business as usual
  • Thanks again to all who are reviewing our PRs
  • Most of our GitHub critical apps are enabled now or close to being enabled

Flask-oidc: oauth2client replacement

Goal of this initiative

Flask-oidc is a library used across the Fedora infrastructure and is the client for ipsilon for its authentication. flask-oidc uses oauth2client. This library is now deprecated and no longer maintained. This will need to be replaced with authlib.

Updates:

  • POC working using authlib, tidying up code to prepare to submit a PR back to upstream

EPEL

Goal of this initiative

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high-quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL).

EPEL packages are usually based on their Fedora counterparts and will never conflict with or replace packages in the base Enterprise Linux distributions. EPEL uses much of the same infrastructure as Fedora, including a build system, Bugzilla instance, updates manager, mirror manager and more.

Updates

  • This week we have 6442 (+127)  packages, from 2882 (+76) source packages
  • Containerd and puppet retired from EPEL7 because of upstream EOL and multiple CVEs.
  • Caddy was updated, fixing 4 CVEs in EPEL9

Kindest regards,
CPE Team

CPE Weekly Update – Week 24 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 13th – 17th June 2022

Continue reading

CPE Weekly Update – Week 23 2022

Hi everyone,

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 6th – 10th 2022

Continue reading

CPE Weekly Update – Week 22 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: May 30st to June 3rd 2022

Continue reading

CPE Weekly Update – Week 21 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 23rd May – 27th May 2022

Read more

Highlights of the week

Infrastructure & Release Engineering

Goal of this Initiative

Purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
The ARC (which is a subset of the team) investigates possible initiatives that CPE might take on.
Link to planning board: https://zlopez.fedorapeople.org/I&R-2022-05-25.pdf

Update

  • Infra and releng team was investigating Openshift in AWS for communishift and CentOS CI

Fedora Infra

  • Ocp3 certs expired, had to renew/push new ones (~20min outage)
  • Finished up a mass update/reboot. Things up on 8.6 now.
  • Hit bug in new ansible-freeipa and filed it upstream
  • Got first RHEL9 staging virthost installed
  • Bunch of email issues to/from redhat.com, hopefully almost all solved now.
  • OCP4 clusters moved to 4.10.
  • Some compose machines moved to f36 already.

CentOS Infra including CentOS CI

  • CentOS Stream storage migration spike (Netapp for nfs/iscsi) (blocked : no news)
  • Duffy/CI progress:
    • Site-to-site vpn tunnel between VPC (us-east-1) and CI infra
    • delegated/hosted (dynamic) pool.ci.centos.org zone on route53
    • Dns forwarding (both directions : vpc ⇔ ci infra)
    • Ansible playbooks ready
  • Git.centos.org pagure upgrade/migration (blocked, waiting on internal – EXD)
  • Business as usual (mirrors, tags)

Release Engineering

  • f32/33 archived. Old rc’s cleaned up

CentOS Stream

Goal of this Initiative

This initiative is working on CentOS Stream/Emerging RHEL to make this new distribution a reality. The goal of this initiative is to prepare the ecosystem for the new CentOS Stream.

Updates

  • Working on first modules and software collections for CentOS Stream 9
  • Changing the Fedora ELN Everything repository to only contain what’s not in AppStream, BaseOS, and CRB, and renaming it to Extras
  • Getting CentOS Stream 8 workflow closer to 9:
    • Currently testing “import latest modules”, expect to have modules imported early next week.
    • Updating is currently manual for both modules and normal RPMs, also working on an automated import script to run at regular intervals. Expect to be finished next week.

CentOS Duffy CI

Goal of this Initiative

Duffy is a system within CentOS CI Infra which allows tenants to provision and access bare metal resources of multiple architectures for the purposes of CI testing.
We need to add the ability to checkout VMs in CentOS CI in Duffy. We have OpenNebula hypervisor available, and have started developing playbooks which can be used to create VMs using the OpenNebula API, but due to the current state of how Duffy is deployed, we are blocked with new dev work to add the VM checkout functionality.

Updates

  • Skip beta and release 3.0.0
  • Continue work on provisioning nodes for Duffy in EC2
  • CLI for tenants (what was cicoclient, ongoing)

Package Automation (Packit Service)

Goal of this initiative

Automate RPM packaging of infra apps/packages

Updates

  • Package proposal on fasjson created on bugzilla
  • Release of fedora-messaging 3.0.2
  • Packit added to noggin-messaging (noggin dependency)
  • Packaging datanommer.models in progress (datagrepper dependency)
  • Business as usual, a lot of manual packaging

Flask-oidc: oauth2client replacement

Goal of this initiative

Flask-oidc is a library used across the Fedora infrastructure and is the client for ipsilon for its authentication. flask-oidc uses oauth2client. This library is now deprecated and no longer maintained. This will need to be replaced with authlib.

Updates:

  • Test-auth app running, allows user to successfully login using Fedora acct details
  • Implementing authlib function changes in codebase
  • Trying to pull user info from login creds

EPEL

Goal of this initiative

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL).

EPEL packages are usually based on their Fedora counterparts and will never conflict with or replace packages in the base Enterprise Linux distributions. EPEL uses much of the same infrastructure as Fedora, including buildsystem, bugzilla instance, updates manager, mirror manager and more.

Updates

  • epel9 available at the launch of rhel9 with 5764 packages, from 2678 source packages, built by 249 different packagers
  • epel9 update of python-jwt to fix CVE-2022-29217
  • epel8 and epel9 update of epel-rpm-macros to require ansible-srpm-macros (provides macros for packaging ansible collections)
  • bdii installation from epel9 problem resolved for c9s, will be resolved in RHEL 9.1
  • Documentation improvements:
    • added list of channels/repos epel9 and epel9-next are built against
    • updated quickstart guide for rhel9 GA and alma9 beta
    • removed mentions of CentOS Linux 8

Kindest regards,
CPE Team

CPE Weekly Update – Week 20 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 16th May – 20th May 2022

Continue reading

CPE Weekly Update – Week 19 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week 09th May – 13th May 2022

Continue reading

Backwards-incompatible changes in Bodhi

The 6.0 release of Bodhi — Fedora’s update gating system — will be published in a few days. We will deploy it to production a couple weeks after the Fedora release. It includes backwards-incompatible changes. Here’s what you need to know.

Continue reading

CPE Weekly Update – Week 18 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat.

Week: 2nd – 6th May 2022

Continue reading

CPE Weekly Update – Week 17 2022

This is a weekly report from the CPE (Community Platform Engineering) Team. If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on libera.chat (https://libera.chat/).

Week: 25th April – 29th April 2022

Continue reading
Olderposts

Copyright © 2022 Fedora Community Blog

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Theme by Anders NorenUp ↑