Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENT-12140: deps upgrades (3.21) #1491

Merged
merged 12 commits into from
Sep 6, 2024

Conversation

craigcomstock
Copy link
Contributor

@craigcomstock craigcomstock commented Aug 23, 2024

@craigcomstock
Copy link
Contributor Author

craigcomstock commented Aug 23, 2024

asked for a "big build" aka all platforms and run all tests:

Build Status

github generated hub package for ubu20 looked fine in testing.

@craigcomstock
Copy link
Contributor Author

@cf-bottom jenkins please, with fixes for centos-7 and ubuntu-20

@cf-bottom
Copy link

@craigcomstock
Copy link
Contributor Author

Try just centos-7 with fixes: Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock craigcomstock force-pushed the 3.21.x-deps-2024-08-23_09_24_48_174551 branch from 76fb2be to 773bb4d Compare August 23, 2024 20:29
@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

just centos-7 client this time, faster, Build Status

@craigcomstock
Copy link
Contributor Author

Build Status

@craigcomstock
Copy link
Contributor Author

added more things to package in the test-only package: Build Status

@craigcomstock craigcomstock force-pushed the 3.21.x-deps-2024-08-23_09_24_48_174551 branch 2 times, most recently from ab298cf to b0b9acd Compare August 26, 2024 20:50
@craigcomstock
Copy link
Contributor Author

maybe done? with lcov at least?
Build Status

@craigcomstock
Copy link
Contributor Author

retry, remove more things: Build Status

(cherry picked from commit 0f76eb9)
@craigcomstock craigcomstock force-pushed the 3.21.x-deps-2024-08-23_09_24_48_174551 branch from b0c376d to aa0f58a Compare August 27, 2024 15:37
@craigcomstock
Copy link
Contributor Author

retry with lcov removal Build Status

@craigcomstock
Copy link
Contributor Author

rebuilding for rhel8hub: Build Status

@craigcomstock
Copy link
Contributor Author

Trying a full build as maybe things are good now?
Build Status

@craigcomstock
Copy link
Contributor Author

rhel8hub only: Build Status

@craigcomstock
Copy link
Contributor Author

retry ubu16hub: Build Status

@craigcomstock
Copy link
Contributor Author

oops, forgot the mission-portal PR in the rhel8hub rebuild, should be fine, but will re-check now:
Build Status

@craigcomstock
Copy link
Contributor Author

try ubu16hub Build Status

if that is green I will do a full run and make sure commits look good.

@craigcomstock craigcomstock force-pushed the 3.21.x-deps-2024-08-23_09_24_48_174551 branch from 9fc707b to add425e Compare September 5, 2024 18:01
@craigcomstock
Copy link
Contributor Author

yeah, looooooooks good. @cf-bottom jenkins please, throw everything at this PR. Thanks.

@cf-bottom
Copy link

Copy link
Contributor

@vpodzime vpodzime left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@@ -34,7 +34,7 @@ fi
--with-iconv \
--with-zlib=%{prefix} \
--with-libmbfl=%{prefix} \
--enable-mbstring \
--enable-mbstring=shared \
Copy link
Contributor

@vpodzime vpodzime Sep 5, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we also doing:

you also need to add extension=mbstring.so to your php.ini

?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no. curious about where/how it is used! 👍 I will check. I didn't see any issues/errors...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have three shared extensions:

cfbuild-php.spec:  --with-openssl=shared,%{prefix} \
cfbuild-php.spec:  --with-curl=shared,%{prefix} \
cfbuild-php.spec:  --enable-mbstring=shared \

Interesting that the others had a trailing ,%{prefix} and neither curl nor openssl .so files are explicitly added to php.ini.

I will check that the mb_* functions operate properly on an instance and see if we need to fix things. 👍 The mb_* functions are only used in a handful of places but a few may be used by many other places.

application/libraries/Cfe_table.php:                                        $data = urlencode((mb_convert_encoding($data, 'UTF-8')));
application/controllers/Hubstatus.php:        $arrayData = json_decode(mb_convert_encoding($statusData, 'UTF-8'), true);
tests/mocks/ci_basetestcase.php:        $array = json_decode(mb_convert_encoding($data, 'UTF-8'), true);
tests/mocks/core/utf8.php:                      mb_internal_encoding('UTF-8');
tests/phpunit/models/VitalsModelTest.php:        $array = json_decode(mb_convert_encoding($json, 'UTF-8'), true);

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, good catch, this sample doesn't work unless I add extension=mbstring.so to a local php.ini file.

I wonder about the other two: curl and openssl, will check!

Ah, we handle this in a different way: individual files:

root@localhost:~# php --ini
Configuration File (php.ini) Path: /var/cfengine/httpd/php/lib
Loaded Configuration File:         /var/cfengine/httpd/php/lib/php.ini
Scan for additional .ini files in: /var/cfengine/httpd/php/lib
Additional .ini files parsed:      /var/cfengine/httpd/php/lib/cfengine-enterprise-api.ini,
/var/cfengine/httpd/php/lib/cfmod.ini,
/var/cfengine/httpd/php/lib/curl.ini,
/var/cfengine/httpd/php/lib/openssl.ini,
/var/cfengine/httpd/php/lib/php.ini

Will fix.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

from configure script output


Extensions:

  --with-EXTENSION=shared[,PATH]

    NOTE: Not all extensions can be built as 'shared'.

    Example: --with-foobar=shared,/usr/local/foobar/

      o Builds the foobar extension as shared extension.
      o foobar package install prefix is /usr/local/foobar/

So given the result of the latest build the PREFIX added on doesn't do much as all three shared extensions are in the same place. I'll add it as I fix the inclusion now and see how it goes.

Copy link
Contributor Author

@craigcomstock craigcomstock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will check shared extensions functioning

@@ -34,7 +34,7 @@ fi
--with-iconv \
--with-zlib=%{prefix} \
--with-libmbfl=%{prefix} \
--enable-mbstring \
--enable-mbstring=shared \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have three shared extensions:

cfbuild-php.spec:  --with-openssl=shared,%{prefix} \
cfbuild-php.spec:  --with-curl=shared,%{prefix} \
cfbuild-php.spec:  --enable-mbstring=shared \

Interesting that the others had a trailing ,%{prefix} and neither curl nor openssl .so files are explicitly added to php.ini.

I will check that the mb_* functions operate properly on an instance and see if we need to fix things. 👍 The mb_* functions are only used in a handful of places but a few may be used by many other places.

application/libraries/Cfe_table.php:                                        $data = urlencode((mb_convert_encoding($data, 'UTF-8')));
application/controllers/Hubstatus.php:        $arrayData = json_decode(mb_convert_encoding($statusData, 'UTF-8'), true);
tests/mocks/ci_basetestcase.php:        $array = json_decode(mb_convert_encoding($data, 'UTF-8'), true);
tests/mocks/core/utf8.php:                      mb_internal_encoding('UTF-8');
tests/phpunit/models/VitalsModelTest.php:        $array = json_decode(mb_convert_encoding($json, 'UTF-8'), true);

- Modified php building for buggy old toolchains
php/php-src#12774
https://sourceware.org/bugzilla/show_bug.cgi?id=23169

- Patched php configure script for ubuntu-16 old gcc version 5
The check in php/build/php.m4 is not sufficient to guard for gcc 5 on ubuntu 16

Ticket: ENT-12140
Changelog: none.
@craigcomstock craigcomstock force-pushed the 3.21.x-deps-2024-08-23_09_24_48_174551 branch from add425e to 0205cc5 Compare September 5, 2024 19:15
@craigcomstock
Copy link
Contributor Author

cancelled the big CI run and retrying ubu16hub only: Build Status

@craigcomstock
Copy link
Contributor Author

@cf-bottom jenkins again please, full deal, I think we are good. 🤞

@cf-bottom
Copy link

@craigcomstock
Copy link
Contributor Author

retry build tests, seem flaky: Build Status

@craigcomstock craigcomstock merged commit ed7a674 into 3.21.x Sep 6, 2024
42 checks passed
@craigcomstock craigcomstock deleted the 3.21.x-deps-2024-08-23_09_24_48_174551 branch September 6, 2024 16:35
@craigcomstock
Copy link
Contributor Author

We didn't run on exotics explicitly before merging. The weekly CI was aborted, https://ci.cfengine.com/view/weekly/job/3.21.x-weekly-pipeline/126/, so didn't check things for us.

Here is a retry just to check again: Build Status

@craigcomstock
Copy link
Contributor Author

craigcomstock commented Sep 13, 2024

check aix71 since it was offline
Build Status

nevermind, it did succeed eventually. cancelled that build ^^^

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants