Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrading from 3.0.1 to 3.0.2 breaks amd64 builds #40

Open
tenpaiyomi opened this issue May 10, 2022 · 29 comments
Open

Upgrading from 3.0.1 to 3.0.2 breaks amd64 builds #40

tenpaiyomi opened this issue May 10, 2022 · 29 comments

Comments

@tenpaiyomi
Copy link

tenpaiyomi commented May 10, 2022

Had an unexpected downtime today when updating Rails from 7.0.2.4 to 7.0.3. Went digging and noticed that as part of the update, 2 other gems were updated. Finally nailed down the break to the update of strscan from 3.0.1 to 3.0.2, and was able to get this error when attempting to start the application on a local amd64 machine.

This is on Ruby 3.1.1, Rails 7.0.3

<internal:/usr/local/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:85:in `require': /home/app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so: cannot open shared object file: No such file or directory - /home/app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so (LoadError)

At this point I have every other gem that was being updated fully updated and my application is back up and running with strscan pinned in my Gemfile to 3.0.1, but as soon as I update strscan to 3.0.2 the application will break again.

Something interesting I noticed as well is that, despite this one single gem being updated and being the only change in the Gemfile.lock, a large number of related gems are affected on the filesystem when my CD process updates everything changed. Also interesting to note is that the change directly involves deleting of anything aarch64/amd64 related.

>fcst...... app-data/vendor/bundle/ruby/3.1.0/bin/byebug
>fcst...... app-data/vendor/bundle/ruby/3.1.0/bin/nokogiri
>fcst...... app-data/vendor/bundle/ruby/3.1.0/bin/puma
>fcst...... app-data/vendor/bundle/ruby/3.1.0/bin/pumactl
>fcst...... app-data/vendor/bundle/ruby/3.1.0/bin/redcarpet
*deleting   app-data/vendor/bundle/ruby/3.1.0/cache/strscan-3.0.1.gem
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/websocket-driver-0.7.5/websocket_mask.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/websocket-driver-0.7.5/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/websocket-driver-0.7.5/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/unf_ext-0.0.8/unf_ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/unf_ext-0.0.8/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/unf_ext-0.0.8/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/sassc-2.4.0/sassc/libsass.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/sassc-2.4.0/sassc/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/sassc-2.4.0/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/sassc-2.4.0/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/redcarpet-3.5.1/redcarpet.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/redcarpet-3.5.1/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/redcarpet-3.5.1/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/puma-5.6.4/puma/puma_http11.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/puma-5.6.4/puma/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/puma-5.6.4/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/puma-5.6.4/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/psych-3.3.2/psych.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/psych-3.3.2/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/psych-3.3.2/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/pg-1.3.5/pg/postgresql_lib_path.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/pg-1.3.5/pg/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/pg-1.3.5/pg_ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/pg-1.3.5/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/pg-1.3.5/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/nio4r-2.5.8/nio4r_ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/nio4r-2.5.8/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/nio4r-2.5.8/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/llhttp-ffi-0.4.0/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/llhttp-ffi-0.4.0/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/hiredis-0.6.3/hiredis/ext/hiredis_ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/hiredis-0.6.3/hiredis/ext/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/hiredis-0.6.3/hiredis/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/hiredis-0.6.3/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/hiredis-0.6.3/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/ffi-1.15.5/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/ffi-1.15.5/ffi_c.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/ffi-1.15.5/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/debug_inspector-1.1.0/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/debug_inspector-1.1.0/debug_inspector.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/debug_inspector-1.1.0/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/byebug-11.1.3/byebug/byebug.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/byebug-11.1.3/byebug/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/byebug-11.1.3/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/byebug-11.1.3/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/bcrypt-3.1.16/gem.build_complete
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/bcrypt-3.1.16/bcrypt_ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/bcrypt-3.1.16/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/
*deleting   app-data/vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/xsd/xmlparser/nokogiri.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/xsd/xmlparser/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/xsd/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xslt/stylesheet.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xslt/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/xpath/syntax_error.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/xpath/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax/push_parser.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax/parser_context.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax/parser.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax/document.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/pp/node.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/pp/character_data.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/pp/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/node/save_options.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/node/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/xpath_context.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/xpath.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/text.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/syntax_error.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/searchable.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/schema.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/sax.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/relax_ng.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/reader.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/processing_instruction.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/pp.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/parse_options.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/notation.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/node_set.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/node.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/namespace.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/entity_reference.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/entity_decl.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/element_decl.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/element_content.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/dtd.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/document_fragment.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/document.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/character_data.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/cdata.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/builder.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/attribute_decl.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/attr.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/version/info.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/version/constant.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/version/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/jruby/dependencies.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/jruby/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html5/node.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html5/document_fragment.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html5/document.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html5/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/sax/push_parser.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/sax/parser_context.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/sax/parser.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/sax/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/entity_lookup.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/element_description_defaults.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/element_description.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/document_fragment.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/document.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/builder.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/decorators/slop.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/decorators/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/xpath_visitor.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/tokenizer.rex
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/tokenizer.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/syntax_error.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/parser_extras.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/parser.y
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/parser.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/node.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/3.1/nokogiri.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/3.1/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/3.0/nokogiri.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/3.0/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/2.7/nokogiri.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/2.7/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/2.6/nokogiri.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/2.6/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xslt.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/xml.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/version.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/syntax_error.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html5.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html4.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/html.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/gumbo.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/extension.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/css.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/class_resolver.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/nokogiri.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/lib/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/gumbo-parser/THANKS
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/gumbo-parser/CHANGES.md
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/gumbo-parser/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xsltutils.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xsltlocale.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xsltexports.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xsltconfig.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xsltInternals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/xslt.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/variables.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/transform.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/templates.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/security.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/preproc.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/pattern.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/numbersInternals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/namespaces.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/keys.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/imports.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/functions.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/extra.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/extensions.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/documents.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/attributes.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxslt/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xpointer.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xpathInternals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xpath.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlwriter.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlversion.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlunicode.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlstring.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlschemastypes.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlschemas.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlsave.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlregexp.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlreader.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlmodule.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlmemory.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlexports.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlerror.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlautomata.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xmlIO.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xlink.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/xinclude.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/valid.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/uri.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/tree.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/threads.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/schematron.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/schemasInternals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/relaxng.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/pattern.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/parserInternals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/parser.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/nanohttp.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/nanoftp.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/list.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/hash.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/globals.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/entities.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/encoding.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/dict.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/debugXML.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/chvalid.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/catalog.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/c14n.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/SAX2.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/SAX.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/HTMLtree.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/HTMLparser.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/DOCBparser.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/libxml/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libxml2/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libexslt/exsltexports.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libexslt/exsltconfig.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libexslt/exslt.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/libexslt/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/include/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xslt_stylesheet.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_xpath_context.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_text.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_syntax_error.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_schema.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_sax_push_parser.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_sax_parser_context.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_sax_parser.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_relax_ng.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_reader.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_processing_instruction.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_node_set.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_node.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_namespace.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_entity_reference.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_entity_decl.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_encoding_handler.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_element_decl.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_element_content.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_dtd.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_document_fragment.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_document.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_comment.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_cdata.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_attribute_decl.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/xml_attr.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/test_global_handlers.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/nokogiri.h
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/nokogiri.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/libxml2_backwards_compat.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/html4_sax_push_parser.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/html4_sax_parser_context.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/html4_entity_lookup.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/html4_element_description.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/html4_document.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/gumbo.c
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/extconf.rb
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/depend
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/nokogiri/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/ext/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/bin/nokogiri
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/bin/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/dependencies.yml
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/README.md
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/LICENSE.md
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/LICENSE-DEPENDENCIES.md
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/Gemfile
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/nokogiri-1.13.6-aarch64-linux/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/cache/strscan-3.0.2.gem
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/extensions/x86_64-linux/3.1.0/strscan-3.0.2/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/extensions/x86_64-linux/3.1.0/strscan-3.0.2/gem.build_complete
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/extensions/x86_64-linux/3.1.0/strscan-3.0.2/strscan.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/bcrypt_ext.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/bcrypt_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/crypt_blowfish.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/crypt_gensalt.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/wrapper.o
>fc.t...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/ext/mri/x86.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/bcrypt-3.1.16/lib/bcrypt_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/breakpoint.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/byebug.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/byebug.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/context.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/locker.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/ext/byebug/threads.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/byebug-11.1.3/lib/byebug/byebug.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/debug_inspector-1.1.0/ext/debug_inspector/debug_inspector.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/debug_inspector-1.1.0/ext/debug_inspector/debug_inspector.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/debug_inspector-1.1.0/lib/debug_inspector.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/AbstractMemory.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/ArrayType.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Buffer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Call.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/ClosurePool.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/DynamicLibrary.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Function.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/FunctionInfo.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/LastError.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/LongDouble.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/MappedType.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/MemoryPointer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/MethodHandle.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Platform.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Pointer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Struct.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/StructByValue.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/StructLayout.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Thread.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Type.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Types.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/Variadic.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/ffi.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/ext/ffi_c/ffi_c.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/ffi-1.15.5/lib/ffi_c.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/ext/hiredis_ext/connection.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/ext/hiredis_ext/hiredis_ext.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/ext/hiredis_ext/hiredis_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/ext/hiredis_ext/reader.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/lib/hiredis/ext/hiredis_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/async.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/hiredis.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/libhiredis.a
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/net.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/read.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/hiredis-0.6.3/vendor/hiredis/sds.o
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/llhttp/llhttp_ext.o
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/llhttp/llhttp.o
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/llhttp/http.o
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/llhttp/api.o
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/llhttp/
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/libllhttp-ext.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/aarch64-linux/
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/libllhttp-ext.so
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/llhttp/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/llhttp/api.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/llhttp/http.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/llhttp/llhttp.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/llhttp-ffi-0.4.0/ext/x86_64-linux/llhttp/llhttp_ext.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/ext/nio4r/bytebuffer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/ext/nio4r/monitor.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/ext/nio4r/nio4r_ext.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/ext/nio4r/nio4r_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/ext/nio4r/selector.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/nio4r-2.5.8/lib/nio4r_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/extconf.h
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/gvl_wrappers.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_binary_decoder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_binary_encoder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_coder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_connection.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_copy_coder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_errors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_record_coder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_result.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_text_decoder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_text_encoder.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_tuple.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_all_strings.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_by_class.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_by_column.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_by_mri_type.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_by_oid.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_type_map_in_ruby.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/pg_util.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/ext/postgresql_lib_path.rb
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/lib/pg_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/pg-1.3.5/lib/pg/postgresql_lib_path.rb
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/api.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/dumper.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/emitter.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/loader.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/parser.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych_emitter.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych_parser.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych_to_ruby.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/psych_yaml_tree.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/reader.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/scanner.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/ext/psych/writer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/psych-3.3.2/lib/psych.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/puma-5.6.4/ext/puma_http11/http11_parser.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/puma-5.6.4/ext/puma_http11/mini_ssl.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/puma-5.6.4/ext/puma_http11/puma_http11.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/puma-5.6.4/ext/puma_http11/puma_http11.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/puma-5.6.4/lib/puma/puma_http11.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/autolink.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/buffer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/houdini_href_e.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/houdini_html_e.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/html.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/html_smartypants.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/markdown.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/rc_markdown.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/rc_render.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/redcarpet.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/ext/redcarpet/stack.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/redcarpet-3.5.1/lib/redcarpet.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/allocator.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast2c.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_fwd_decl.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_sel_cmp.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_sel_super.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_sel_unify.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_sel_weave.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_selectors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_supports.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/ast_values.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/backtrace.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/base64vlq.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/bind.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/c2ast.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/c99func.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/cencode.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/check_nesting.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/color_maps.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/constants.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/context.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/cssize.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/emitter.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/environment.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/error_handling.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/eval.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/eval_selectors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/expand.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/extender.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/extension.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/file.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_colors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_lists.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_maps.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_miscs.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_numbers.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_selectors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_strings.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/fn_utils.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/inspect.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/json.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/lexer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/libsass.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/listize.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/operators.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/output.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/parser.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/parser_selectors.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/plugins.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/position.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/prelexer.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/remove_placeholders.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/sass.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/sass2scss.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/sass_context.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/sass_functions.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/sass_values.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/shared_ptr.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/source.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/source_map.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/stylesheet.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/to_value.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/units.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/utf8_string.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/util.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/util_string.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/ext/values.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/sassc-2.4.0/lib/sassc/libsass.so
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/.sitearchdir.time
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/extconf.rb
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/strscan.c
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/strscan.o
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ext/strscan/strscan.so
cd+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/unf_ext-0.0.8/ext/unf_ext/unf.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/unf_ext-0.0.8/ext/unf_ext/unf_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/unf_ext-0.0.8/lib/unf_ext.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/websocket-driver-0.7.5/ext/websocket-driver/websocket_mask.o
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/websocket-driver-0.7.5/ext/websocket-driver/websocket_mask.so
>fcst...... app-data/vendor/bundle/ruby/3.1.0/gems/websocket-driver-0.7.5/lib/websocket_mask.so
*deleting   app-data/vendor/bundle/ruby/3.1.0/specifications/nokogiri-1.13.6-aarch64-linux.gemspec
>f+++++++++ app-data/vendor/bundle/ruby/3.1.0/specifications/strscan-3.0.2.gemspec
*deleting   app-data/vendor/cache/extensions/aarch64-linux/3.1.0/bert-a9a0d38756f9/gem.build_complete
*deleting   app-data/vendor/cache/extensions/aarch64-linux/3.1.0/bert-a9a0d38756f9/decode.so
*deleting   app-data/vendor/cache/extensions/aarch64-linux/3.1.0/bert-a9a0d38756f9/
*deleting   app-data/vendor/cache/extensions/aarch64-linux/3.1.0/
*deleting   app-data/vendor/cache/extensions/aarch64-linux/
*deleting   app-data/vendor/cache/extensions/
*deleting   app-data/vendor/cache/strscan-3.0.1.gem
*deleting   app-data/vendor/cache/bert-a9a0d38756f9/ext/bert/c/decode.so
*deleting   app-data/vendor/cache/bert-a9a0d38756f9/ext/bert/c/decode.o
*deleting   app-data/vendor/cache/bert-a9a0d38756f9/ext/bert/c/.sitearchdir.time
*deleting   app-data/vendor/cache/bert-a9a0d38756f9/lib/decode.so
>f+++++++++ app-data/vendor/cache/strscan-3.0.2.gem

These files which are updated also correspond to the files which are stated to be missing when my application in production attempts to start:

/usr/local/lib/ruby/3.1.0/bundler/definition.rb:481:in `materialize': Could not find psych-3.3.2, strscan-3.0.2, pg-1.3.5, hiredis-0.6.3, nokogiri-1.13.6-aarch64-linux, redcarpet-3.5.1, puma-5.6.4, byebug-11.1.3, sassc-2.4.0, bcrypt-3.1.16, nio4r-2.5.8, debug_inspector-1.1.0, websocket-driver-0.7.5, ffi-1.15.5, llhttp-ffi-0.4.0, unf_ext-0.0.8 in any of the sources (Bundler::GemNotFound)
@kou
Copy link
Member

kou commented May 11, 2022

It's strange.

The error message says "No such file or directory" but it seems that /home/app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so exists. Could you show the output of ldd /home/app-data/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so?

@tenpaiyomi
Copy link
Author

root@3bd77d7633ff:/home/app-data# ldd vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so
	not a dynamic executable

@kou
Copy link
Member

kou commented May 11, 2022

file vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

root@7d0c1b8b4afb:/home/app-data# file vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so
vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=3154d32f12a8c05d5c8b91e2205789506d702118, with debug_info, not stripped

I was able to make some general progress based on the above, but it is not ideal given how our CI/CD pipeline is setup. I had to delete the vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/ folder and then, on my aarch64 machine, run the bundle command again and then the ldd correctly output the linked library location and there existed a copy of strscan.so in vendor/bundle/ruby/3.1.0/extensions/aarch64-linux/3.1.0/strscan-3.0.2/.

Prior to the 3.0.2 version change, what would happen is our CI/CD pipeline would add both the x86_64 and aarch64 platforms to the Gemfile and then do a bundle install. On deployment to our aarch64 machines, all the gems with native extensions (specifically the ones above) would then compile their native extensions and everything would be good to go. Something to do with version 3.0.2 is causing this to not be possible, it seems. Likewise, from what I've seen poking around, strscan is the only one which is placing a shared object file within the gems/ folder instead of within the respective arch extensions/ folder.

I currently have an environment locally where this is reproducible, so let me know what all information I can potentially provide to help debug/diagnose.

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

I take that back, there are some others that place the shared objects within the gems/ folder, but those folders are suffixed with the architecture. An example of this is nokogiri, which creates both a nokogiri-1.13.5-x86_64-linux and nokogiri-1.13.5-aarch64-linux folder within the gems folder. It seems like maybe this particular file handles that logic

@kou
Copy link
Member

kou commented May 11, 2022

Could you show your Gemfile.lock with strscan 3.0.1 and 3.0.2?

@kou
Copy link
Member

kou commented May 11, 2022

Prior to the 3.0.2 version change, what would happen is our CI/CD pipeline would add both the x86_64 and aarch64 platforms to the Gemfile and then do a bundle install.

How did you do this? bundle lock --add-platform?

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

How did you do this? bundle lock --add-platform?

Correct

      - name: Add Gem platforms
        run: |
          bundle config unset deployment 
          bundle lock --add-platform x86_64-linux
          bundle lock --add-platform aarch64-linux
          bundle config set deployment true

Could you show your Gemfile.lock with strscan 3.0.1 and 3.0.2?

I included both versions pre and post CI. The only differences between them in each case are 1) the addition of the x86_64-linux and aarch64-linux platforms post CI, 2) the version of strscan (and that strscan is pinned to 3.0.1, of course), and 3) that nokogiri adds 2 additional entries post CI, one for each platform.

Pre CI the only difference is the strscan version being locked.

https://gist.github.com/tenpaiyomi/4ebc96e851700a9c7a741fb8fcce7000

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

I'm also currently pinning the gem to different commit versions since 3.0.1 and deploying it out through our CI to a staging environment to find the commit in question where things started breaking to help narrow down the changes.

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

So, interestingly, building directly from the git ref seems to work perfectly fine. I'm currently on SHA 5da2432 which is tagged as the last commit for 3.0.2. I'm going to try unpinning and going to the latest version (3.0.3 as of this moment) and see if it breaks again or not. If so, that would I believe point to some sort of issue with the actual built gem itself?

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 11, 2022

Going to the latest 3.0.3 built gem resulted in the same broken behavior. Going to the latest 3.0.3 SHA, bbfd6d1, works without issue.

@kou
Copy link
Member

kou commented May 12, 2022

Thanks. Could you show the command lines to install gems with the Gemfile.lock on your CI?

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 12, 2022

For the CI

- name: Add Gem platforms
  run: |
    bundle config unset deployment 
    bundle lock --add-platform x86_64-linux
    bundle lock --add-platform aarch64-linux
    bundle config set deployment true

- name: Package the gems
  run: bundle package --all-platforms --no-install

For Production

bundle config without tests
bundle config deployment true
bundle install

@kou
Copy link
Member

kou commented May 12, 2022

Umm... I couldn't get nokogiri (1.13.6-x86_64-linux) and nokogiri (1.13.6-aarch64-linux) on my local x86_64 Debian GNU/Linux with the following Gemfile?

source "https://rubygems.org/"
gem "strscan"
gem "nokogiri"

Command lines:

bundle lock --add-platform ruby
bundle lock --add-platform x86_64-linux
bundle lock --add-platform aarch64-linux

Gemfile.lock:

GEM
  remote: https://rubygems.org/
  specs:
    mini_portile2 (2.8.0)
    nokogiri (1.13.6)
      mini_portile2 (~> 2.8.0)
      racc (~> 1.4)
    racc (1.6.0)
    strscan (3.0.3)

PLATFORMS
  aarch64-linux
  ruby
  x86_64-linux

DEPENDENCIES
  nokogiri
  strscan

BUNDLED WITH
   2.3.7

Can you get nokogiri (1.13.6-x86_64-linux) and nokogiri (1.13.6-aarch64-linux) on your local amd64 machine?

@tenpaiyomi
Copy link
Author

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 12, 2022

To note, that was after I had to forcible remove the folder at /home/app-data/hexawise/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2, otherwise it just gives me the

<internal:/usr/local/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:85:in `require': /home/app-data/hexawise/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so: cannot open shared object file: No such file or directory - /home/app-data/hexawise/vendor/bundle/ruby/3.1.0/gems/strscan-3.0.2/lib/strscan.so (LoadError)

error and won't let me install any gems.

@kou
Copy link
Member

kou commented May 12, 2022

Can you reproduce this with

source "https://rubygems.org/"
gem "strscan"
gem "nokogiri"

or similar?

@tenpaiyomi
Copy link
Author

Referring to just a minimally viable Gemfile? If so I can attempt such in the morning, I'll have to get a new blank app setup and go through the various steps to try and recreate the setup between an x86 machine and arm64 machine without going through the CI.

@kou
Copy link
Member

kou commented May 12, 2022

Referring to just a minimally viable Gemfile?

Yes. It seems that we don't need Rails to reproduce this.

@tenpaiyomi
Copy link
Author

Fair enough, that will simplify it a bit but I'll still have to coordinate back and forth between my x86 and arm64 machine to ensure it goes through the same process.

@eregon
Copy link
Member

eregon commented May 12, 2022

I'm not sure if this bundle lock --add-platform twice + bundle package --all-platforms --no-install is supported in Bundler, it might be worth asking there.
AFAIK extensions still get copied to under the gem's lib.
For instance using Ruby master of today and RubyGems 3.4.0.dev which comes with it:

$ gem i strscan
$ gem i json:2.6.0

$ ll ~/prefix/ruby-master/lib/ruby/gems/3.2.0+1/gems/strscan-3.0.3/lib      
-rwxr-xr-x. 1 eregon eregon 158K May 12 11:00 strscan.so

$ ll ~/prefix/ruby-master/lib/ruby/gems/3.2.0+1/gems/json-2.6.0/lib/json/ext
-rwxr-xr-x. 1 eregon eregon 199K May 12 11:01 generator.so
-rwxr-xr-x. 1 eregon eregon 145K May 12 11:01 parser.so

So AFAIK a gem home only supports a single architecture currently, not multiple.

@eregon
Copy link
Member

eregon commented May 12, 2022

Mmh, it does seems supported at least in theory: https://bundler.io/v1.12/bundle_package.html

@tenpaiyomi
Copy link
Author

For what it is worth @eregon, this is a setup that, up until this most recent gem update, has been working for months without an issue. The reason for the need to do the --add-platform and package --all-platforms --no-install is because our CI runs here on Github Actions which does not offer an arm64 platform, but our production instances are all arm64. The process has always been to add both platforms, go through the CI, and then when the production image is pulled up it will do a bundle install as noted above and it installs the necessary native extension platform specific gems.

@tenpaiyomi
Copy link
Author

tenpaiyomi commented May 12, 2022

So I went through with the strscan and nokogiri options in a gem without issue, so I'm going to try adding all the other gems which are native and see if it fails in that manner, maybe to help isolate down some sort of a general incompatibility or reliance or so.

This might not be relevant, as I just realized that my x86 machine and amd64 machines were on different ruby versions. Installing same versions and retrying.

@tenpaiyomi
Copy link
Author

So, a few things of note that I've found interesting (and a little confusing). When going through a fresh install, nothing gets installed in vendor/bundle/ruby/3.1.0/gems, which is explicitly where the code in question lives that causes a problem, and it seems like with that not being the case, I can install on the amd64 machine without problem.

I'm not sure of the logic for when code is placed in vendor/bundle/ruby/3.1.0/gems vs gems in vendor/bundle/ruby/3.1.0/cache. Are either of you able to shed some light on that?

@kou
Copy link
Member

kou commented May 13, 2022

@deivid-rodriguez Could you take a look at this? It seems that this is a Bundler's resolver related problem.

Here is a summary of this problem:

  • This Gemfile.lock uses two platforms (x86_64-linux and aarch64-linux) (ruby is also included)
  • Archive target gems by bundle package --all-platforms --no-install on x86_64 Linux
  • Install the archived target gems by bundle install on aarch64 Linux
  • This works with strscan installed as default gem (3.0.1 on Ruby 3.1)
  • This doesn't work with strscan installed as gem (3.0.2 and 3.0.3 with Ruby 3.1)
    • x86_64 Linux related gems not aarch64 Linux related gems are installed on aarch64 Linux
    • e.g.: strscan is built for x86_64 Linux not aarch64 Linux
    • e.g.: nokogiti-aarch64-linux pre-built gem isn't used
  • We couldn't establish how to reproduce this problem yet

@deivid-rodriguez
Copy link

Thanks for the ping @kou, I will try to have a look. Obviously a way to reproduce would go a long way towards fixing this.

@deivid-rodriguez
Copy link

@tenpaiyomi You have shared the Gemfile.lock file, can you also share the Gemfile? Also, are you still working on a minimal repro, that would be ideal. You start removing gems and see if it still reproduces until you have something minimal.

@tenpaiyomi
Copy link
Author

@deivid-rodriguez https://gist.github.com/tenpaiyomi/d7a916180b85c2498fa67bf52f18454b

Unfortunately things have been so busy with work recently that I have not had much extraneous time continue trying to debug this right now. Once I do have the time, I'll see what else I can find.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

4 participants