Skip to content

Conversation

@pleoxconfusa
Copy link
Contributor

Integrate pkgs processing logic into linux and ubuntu model components.


Description

This pull request transitions the linux and ubuntu model components to use the pkgs integration for handling external packages. The INSTALL/pkgs directory is introduced to define package metadata files, and the package processing logic is centralized in pkgs_tasks.yml. This update simplifies the installation process and ensures compatibility with both traditional tasks.yml logic and the new pkgs integration.

Key Changes

  • Simplified tasks.yml to delegate package processing to pkgs_tasks.yml.
  • Moved package metadata from vars.yml to individual .yml files in the INSTALL/pkgs directory.
  • Updated vars.yml to focus only on required files.
  • Verified compatibility with the new pkgs integration while maintaining functionality for offline installations.

Benefits

  • Modularity: Simplifies package handling by centralizing logic in pkgs_tasks.yml.
  • Idempotence: Ensures installation tasks can be run multiple times without changing the final state.
  • Reproducibility: Packages are defined with exact versions and checksums, ensuring consistent experimental outcomes.
  • Offline Accessibility: Supports caching and retrieval of packages for offline installations.
  • Cleanup: Automatically removes intermediate files and directories created during package processing.

Related Issue

This pull request addresses the need for modular and idempotent handling of external packages in the linux and ubuntu model components. It is part of the broader effort to improve reproducibility and offline accessibility for model components.


Type of Change

Please select the type of change your pull request introduces:

  • Bugfix
  • New feature
  • Documentation update
  • Other (please describe):

Checklist

  • This PR conforms to the process detailed in the Contributing Guide.
  • I have included no proprietary/sensitive information in my code.
  • I have performed a self-review of my code.
  • I have commented my code, particularly in hard-to-understand areas.
  • I have made corresponding changes to the documentation.
  • My changes generate no new warnings.
  • I have tested my code.

Additional Notes

This update transitions linux and ubuntu to fully leverage the pkgs integration, simplifying package handling and improving reproducibility. The integration has been tested to ensure compatibility with both traditional tasks.yml logic and the new pkgs-based approach. Offline accessibility and modularity have been prioritized to support diverse experimental environments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant