Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-builder-2c-4g-5168 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
[ssh-agent] Looking for ssh-agent implementation...
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-n0h4zrXhcLXr/agent.5211
SSH_AGENT_PID=5213
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_362193792910812899.key (jenkins-ssh)
[ssh-agent] Using credentials jenkins (jenkins)
The recommended git tool is: NONE
using credential jenkins
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
 > git init /w/workspace/ci-management-openstack-cron # timeout=10
Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials jenkins
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh14024508678069363749.key
 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision 0e34b4012a7e005ed4a20cc76a3783e0a7df6453 (refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 0e34b4012a7e005ed4a20cc76a3783e0a7df6453 # timeout=10
Commit message: "Chore: Upgrade global-jjb to v0.92.13"
 > git rev-list --no-walk 0e34b4012a7e005ed4a20cc76a3783e0a7df6453 # timeout=10
 > git remote # timeout=10
 > git submodule init # timeout=10
 > git submodule sync # timeout=10
 > git config --get remote.origin.url # timeout=10
 > git submodule init # timeout=10
 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
 > git config --get submodule.packer/common-packer.url # timeout=10
 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
 > git config --get submodule.global-jjb.url # timeout=10
 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
 > git submodule update --init --recursive packer/common-packer # timeout=10
 > git submodule update --init --recursive global-jjb # timeout=10
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [Execute shell]
Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13788076783051635926.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.6 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-3Hlp
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.10.6
pip 26.0.1 from /tmp/venv-3Hlp/lib/python3.10/site-packages/pip (python 3.10)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==25.4.0
autopage==0.6.0
backports.strenum==1.3.1
beautifulsoup4==4.14.3
boto3==1.42.42
botocore==1.42.42
bs4==0.0.2
certifi==2026.1.4
cffi==2.0.0
cfgv==3.5.0
chardet==5.2.0
charset-normalizer==3.4.4
click==8.3.1
cliff==4.13.1
cmd2==3.2.0
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.20.3
future==1.0.0
gitdb==4.0.12
GitPython==3.1.46
httplib2==0.30.2
identify==2.6.16
idna==3.11
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.1.0
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.13.0
kubernetes==35.0.0
lftools==0.37.21
lxml==6.0.2
markdown-it-py==4.0.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.9.0
os-service-types==1.8.2
osc-lib==4.3.0
oslo.config==10.2.0
oslo.context==6.2.0
oslo.i18n==6.7.1
oslo.log==8.0.0
oslo.serialization==5.9.0
oslo.utils==9.2.0
packaging==26.0
pbr==7.0.3
platformdirs==4.5.1
prettytable==3.17.0
psutil==7.2.2
pyasn1==0.6.2
pyasn1_modules==0.4.2
pycparser==3.0
pygerrit2==2.0.15
PyGithub==2.8.1
Pygments==2.19.2
PyJWT==2.11.0
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.8.0
python-dateutil==2.9.0.post0
python-heatclient==5.0.0
python-jenkins==1.8.3
python-keystoneclient==5.7.0
python-magnumclient==4.9.0
python-openstackclient==8.3.0
python-swiftclient==4.9.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.32.5
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.3.2
rich-argparse==1.7.2
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.16.0
simplejson==3.20.2
six==1.17.0
smmap==5.0.2
soupsieve==2.8.3
stevedore==5.6.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.3
typing_extensions==4.15.0
tzdata==2025.3
urllib3==1.26.20
virtualenv==20.36.1
wcwidth==0.5.3
websocket-client==1.9.0
wrapt==2.1.1
xdg==6.0.0
xmltodict==1.0.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex

[EnvInject] - Variables injected successfully.
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2748893186129272671.sh
---> Orphaned k8s clusters
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
-----> Delete orphaned cluster
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1088399758809723677.sh
---> Orphaned stacks
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
+ mapfile -t OS_COE_CLUSTERS_ID
++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
++ awk '{print $1}'
+ echo '-----> Active clusters -> stacks'
-----> Active clusters -> stacks
+ OS_COE_STACKS=()
+ [[ 0 -gt 0 ]]
+ mapfile -t OS_STACKS
++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
++ awk '{print $1}'
+ echo '-----> Active stacks'
-----> Active stacks
+ echo '-----> Delete orphaned stacks'
-----> Delete orphaned stacks
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3404716447681064824.sh
---> Orphaned servers
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
-----> Active servers
prd-ubuntu1804-docker-4c-4g-5173
prd-ubuntu1804-docker-4c-4g-5172
prd-ubuntu1804-docker-4c-4g-5170
prd-ubuntu1804-docker-4c-4g-5169
prd-centos8-builder-2c-4g-5168
prd-centos8-builder-2c-4g-5166
prd-centos8-builder-2c-4g-5165
prd-ubuntu1804-docker-4c-4g-5164
prd-ubuntu2004-builder-2c-2g-5004
-----> Delete orphaned servers
Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-5173
WARN: Server "prd-ubuntu1804-docker-4c-4g-5173" is not older than 15 minutes.
Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-5172
WARN: Server "prd-ubuntu1804-docker-4c-4g-5172" is not older than 15 minutes.
Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-5170
WARN: Server "prd-ubuntu1804-docker-4c-4g-5170" is not older than 15 minutes.
Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-5169
WARN: Server "prd-ubuntu1804-docker-4c-4g-5169" is not older than 15 minutes.
Deleting orphaned server: prd-centos8-builder-2c-4g-5166
ERROR: Server not found.
Deleting orphaned server: prd-centos8-builder-2c-4g-5165
WARN: Server "prd-centos8-builder-2c-4g-5165" is not older than 15 minutes.
Deleting orphaned server: prd-ubuntu1804-docker-4c-4g-5164
ERROR: Server not found.
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16182267849009112623.sh
---> Orphaned ports
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
No orphaned ports to process.
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins5222807041134688716.sh
---> Orphaned volumes
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-drkh
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ tail -n 1
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
++ py_version_xyz=3.10.6
++ [[ -z 3.10.6 ]]
++ echo 3.10.6
++ return 0
+ pyenv local 3.10.6
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.10.6
+ pyenv local 3.10.6
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-3Hlp
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-3Hlp/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-3Hlp/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
+ PATH=/tmp/venv-3Hlp/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ mapfile -t os_volumes
++ openstack --os-cloud vex volume list -f value -c ID --status Available
+ '[' 0 -eq 0 ']'
+ echo 'No orphaned volumes found.'
No orphaned volumes found.
[Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
Run condition [Boolean condition] enabling perform for step [Execute shell]
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6663398392830857462.sh
---> Protect in-use images
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
INFO: There are images to protect defined in jenkins-config.
INFO: Protecting the following images:
ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874
ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228
ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713
ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191
ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749
ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546
ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956
ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263
ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255
ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118
Build timed out (after 10 minutes). Marking the build as failed.
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5213 killed;
[ssh-agent] Stopped.
Build was aborted
[PostBuildScript] - [INFO] Executing post build scripts.
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7383919894880902997.sh
---> sysstat.sh
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16542699185192731381.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/ci-management-openstack-cron
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/ci-management-openstack-cron ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ sort
+ rpm -qa
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/ci-management-openstack-cron ']'
+ mkdir -p /w/workspace/ci-management-openstack-cron/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1694722786308911719.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5767942790053417692.sh
provisioning config files...
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config17103573705780369912tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13539417933619913037.sh
---> create-netrc.sh
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10469073147331871608.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7641232342954518138.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2268153095015488224.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
INFO: No Stack...
INFO: Retrieving Pricing Info for: v3-starter-2
INFO: Archiving Costs
[ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4282792880079290045.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-3Hlp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-3Hlp/bin to PATH
INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/57118
INFO: archiving workspace using pattern(s): 
Archives upload complete.
INFO: archiving logs to Nexus
---> uname -a:
Linux prd-centos8-builder-2c-4g-5168.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2800.000
BogoMIPS:            5600.00
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        1.8G     0  1.8G   0% /dev
tmpfs           1.8G     0  1.8G   0% /dev/shm
tmpfs           1.8G   17M  1.8G   1% /run
tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
/dev/vda1        20G  9.1G   11G  46% /
tmpfs           367M     0  367M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           3665         497        1126          17        2042        2893
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
    link/ether fa:16:3e:d6:50:7a brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.32.7.185/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
       valid_lft 85664sec preferred_lft 85664sec
    inet6 fe80::f816:3eff:fed6:507a/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	02/06/2026 	_x86_64_	(2 CPU)

00:07:06     LINUX RESTART	(2 CPU)

12:08:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:09:01 AM     92.67      6.38     86.29    931.71   5776.77
12:10:01 AM     66.52      0.45     66.07     52.77   8265.05
12:11:01 AM     32.12      0.08     32.03      1.87   3470.80
12:12:01 AM      9.08      0.65      8.43     55.46    472.02
12:13:01 AM      3.47      0.18      3.28      4.13    121.13
12:14:01 AM      0.27      0.02      0.25      0.53      2.87
12:15:01 AM      6.28      0.03      6.25      1.33    116.26
12:16:01 AM     18.38      0.03     18.34      1.73    461.06
12:17:01 AM      9.28      0.00      9.28      0.00    468.77
12:18:01 AM      1.08      0.00      1.08      0.00     30.66
12:19:01 AM     15.33      1.35     13.98     68.38    348.87
Average:        23.13      0.83     22.30    101.62   1776.02

12:08:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:09:01 AM   1393272   3036868   2360412     62.88      2104   1811320    610316     12.71    143004   1926436    130400
12:10:01 AM   1211804   2976036   2541880     67.72      2104   1925408    649092     13.52    147540   2076012     40404
12:11:01 AM   1190220   2992808   2563464     68.29      2104   1963292    629740     13.11    171212   2072652      8812
12:12:01 AM   1205900   3009968   2547784     67.87      2104   1964928    615004     12.81    172988   2055068         4
12:13:01 AM   1166976   2971184   2586708     68.91      2104   1965068    653696     13.61    173300   2092924        12
12:14:01 AM   1166420   2970644   2587264     68.93      2104   1965084    644960     13.43    184188   2082216        12
12:15:01 AM   1214840   3019476   2538844     67.64      2104   1965124    598880     12.47    219896   1999264      7916
12:16:01 AM   1188096   2992708   2565588     68.35      2104   1965180    627736     13.07    220144   2025004      7908
12:17:01 AM   1187696   2992240   2565988     68.36      2104   1965180    627736     13.07    220152   2024908         4
12:18:01 AM   1188032   2992556   2565652     68.35      2104   1965180    627736     13.07    220152   2025084        12
12:19:01 AM   1137112   2952680   2616572     69.71      2104   1976168    660448     13.75    406856   1890028     17576
Average:      1204579   2991561   2549105     67.91      2104   1948357    631395     13.15    207221   2024509     19369

12:08:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0     71.49     56.59    836.59      9.65      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0     28.19     25.77    261.89      6.18      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0     41.65     31.78    620.81      6.13      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0      2.00      2.00      5.28      0.26      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0      1.02      0.83      0.73      0.19      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0      4.08      3.93      2.95      0.65      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0      8.60      9.72      6.35      3.40      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0     13.00     14.21     14.49      6.21      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0      0.10      0.10      0.01      0.01      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      1.58      0.18      0.26      0.07      0.00      0.00      0.00      0.00
12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:01 AM      eth0     19.36     17.89     15.97     17.58      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0     17.37     14.82    160.49      4.58      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	02/06/2026 	_x86_64_	(2 CPU)

00:07:06     LINUX RESTART	(2 CPU)

12:08:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:09:01 AM     all     36.28      0.00      4.65      4.71      1.59     52.76
12:09:01 AM       0     48.29      0.00      5.21      3.16      1.81     41.52
12:09:01 AM       1     24.27      0.00      4.10      6.26      1.37     64.01
12:10:01 AM     all     37.55      0.00      4.43      2.13      1.47     54.43
12:10:01 AM       0     55.16      0.00      6.07      1.38      1.89     35.50
12:10:01 AM       1     19.90      0.00      2.78      2.88      1.05     73.40
12:11:01 AM     all     34.58      0.00      2.83      0.90      2.57     59.12
12:11:01 AM       0     40.13      0.00      3.05      0.96      2.70     53.16
12:11:01 AM       1     29.03      0.00      2.60      0.84      2.44     65.08
12:12:01 AM     all      1.66      0.00      0.21      0.39      0.08     97.65
12:12:01 AM       0      1.44      0.00      0.25      0.70      0.10     97.51
12:12:01 AM       1      1.89      0.00      0.17      0.08      0.07     97.80
12:13:01 AM     all      1.23      0.00      0.13      0.06      0.08     98.49
12:13:01 AM       0      2.28      0.00      0.17      0.07      0.07     97.42
12:13:01 AM       1      0.18      0.00      0.10      0.05      0.10     99.57
12:14:01 AM     all      5.63      0.00      0.61      0.00      0.30     93.46
12:14:01 AM       0      8.39      0.00      0.75      0.00      0.35     90.50
12:14:01 AM       1      2.87      0.00      0.47      0.00      0.25     96.41
12:15:01 AM     all     22.94      0.00      1.82      0.07      1.17     74.00
12:15:01 AM       0     33.39      0.00      2.15      0.12      1.18     63.16
12:15:01 AM       1     12.53      0.00      1.49      0.02      1.16     84.80
12:16:01 AM     all     37.84      0.00      2.64      0.34      1.87     57.31
12:16:01 AM       0     56.52      0.00      3.64      0.23      2.08     37.53
12:16:01 AM       1     19.26      0.00      1.64      0.45      1.67     76.99
12:17:01 AM     all      0.33      0.00      0.10      0.28      0.02     99.27
12:17:01 AM       0      0.03      0.00      0.07      0.08      0.00     99.82
12:17:01 AM       1      0.62      0.00      0.13      0.48      0.03     98.73
12:18:01 AM     all      0.32      0.00      0.12      0.01      0.95     98.60
12:18:01 AM       0      0.50      0.00      0.10      0.00      0.83     98.57
12:18:01 AM       1      0.15      0.00      0.13      0.02      1.08     98.63
12:19:01 AM     all     38.83      0.00      3.34      0.20      2.20     55.44
12:19:01 AM       0     43.88      0.00      3.21      0.26      2.36     50.29
12:19:01 AM       1     33.77      0.00      3.47      0.13      2.04     60.59

Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
Average:        all     19.79      0.00      1.90      0.83      1.12     76.36
Average:          0     26.41      0.00      2.25      0.63      1.22     69.49
Average:          1     13.17      0.00      1.56      1.02      1.03     83.23


