diff --git a/404.html b/404.html index cce711d22..16ddf83f3 100644 --- a/404.html +++ b/404.html @@ -194,7 +194,7 @@
  • - + HTCondor-CE 6
    • @@ -672,7 +672,7 @@
  • - + Installation
    • @@ -705,7 +705,7 @@
  • - + Authentication
    • @@ -717,7 +717,7 @@
  • - + Local Batch System
    • @@ -750,7 +750,7 @@
  • - + Overview
    • @@ -762,7 +762,7 @@
  • - + Writing Job Routes
    • @@ -774,7 +774,7 @@
  • - + For HTCondor Batch Systems
    • @@ -786,7 +786,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -804,7 +804,7 @@
  • - + Optional Configuration
    • @@ -822,7 +822,7 @@
  • - + Operation
    • @@ -855,7 +855,7 @@
  • - + Common Issues
    • @@ -867,7 +867,7 @@
  • - + Debugging Tools
    • @@ -879,7 +879,7 @@
  • - + Helpful Logs
    • @@ -918,7 +918,7 @@
  • - + Submit Jobs Remotely
    • @@ -930,7 +930,7 @@
  • - + Remote Troubleshooting
    • @@ -942,7 +942,7 @@
  • - + Install a Central Collector
    • @@ -960,7 +960,7 @@
  • - + Releases
    • @@ -972,7 +972,7 @@
  • - + Reference
    • diff --git a/architecture/index.html b/architecture/index.html index 31a2054a9..257eb9984 100644 --- a/architecture/index.html +++ b/architecture/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -758,7 +758,7 @@
  • - + Installation
    • @@ -791,7 +791,7 @@
  • - + Authentication
    • @@ -803,7 +803,7 @@
  • - + Local Batch System
    • @@ -836,7 +836,7 @@
  • - + Overview
    • @@ -848,7 +848,7 @@
  • - + Writing Job Routes
    • @@ -860,7 +860,7 @@
  • - + For HTCondor Batch Systems
    • @@ -872,7 +872,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -890,7 +890,7 @@
  • - + Optional Configuration
    • @@ -908,7 +908,7 @@
  • - + Operation
    • @@ -941,7 +941,7 @@
  • - + Common Issues
    • @@ -953,7 +953,7 @@
  • - + Debugging Tools
    • @@ -965,7 +965,7 @@
  • - + Helpful Logs
    • @@ -1004,7 +1004,7 @@
  • - + Submit Jobs Remotely
    • @@ -1016,7 +1016,7 @@
  • - + Remote Troubleshooting
    • @@ -1028,7 +1028,7 @@
  • - + Install a Central Collector
    • @@ -1046,7 +1046,7 @@
  • - + Releases
    • @@ -1058,7 +1058,7 @@
  • - + Reference
    • @@ -1132,17 +1132,17 @@

    Hosted CE over SSH

    If your site intends to run over 10,000 concurrent pilot jobs, you will need to host your own -HTCondor-CE because the Hosted CE has not yet been optimized for such loads.

    +HTCondor-CE because the Hosted CE has not yet been optimized for such loads.

    How the CE is Customized

    Aside from the [basic configuration] required in the CE installation, there are two main ways to customize your CE (if you decide any customization is required at all):

    How Security Works

    diff --git a/index.html b/index.html index a25fa020b..c02349bf6 100644 --- a/index.html +++ b/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -742,7 +742,7 @@
  • - + Installation
    • @@ -775,7 +775,7 @@
  • - + Authentication
    • @@ -787,7 +787,7 @@
  • - + Local Batch System
    • @@ -820,7 +820,7 @@
  • - + Overview
    • @@ -832,7 +832,7 @@
  • - + Writing Job Routes
    • @@ -844,7 +844,7 @@
  • - + For HTCondor Batch Systems
    • @@ -856,7 +856,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -874,7 +874,7 @@
  • - + Optional Configuration
    • @@ -892,7 +892,7 @@
  • - + Operation
    • @@ -925,7 +925,7 @@
  • - + Common Issues
    • @@ -937,7 +937,7 @@
  • - + Debugging Tools
    • @@ -949,7 +949,7 @@
  • - + Helpful Logs
    • @@ -988,7 +988,7 @@
  • - + Submit Jobs Remotely
    • @@ -1000,7 +1000,7 @@
  • - + Remote Troubleshooting
    • @@ -1012,7 +1012,7 @@
  • - + Install a Central Collector
    • @@ -1030,7 +1030,7 @@
  • - + Releases
    • @@ -1042,7 +1042,7 @@
  • - + Reference
    • @@ -1104,13 +1104,13 @@

    What is HTCondor-CE?many tools to help troubleshoot issues with RARs + many tools to help troubleshoot issues with RARs
  • Routing as configuration: HTCondor-CE’s mechanism to transform and submit RARs is customized via configuration variables, which means that customizations will persist across upgrades and will not involve modification of software internals to route jobs

    • Getting HTCondor-CE

    -

    Learn how to get and install HTCondor-CE through our documentation.

    +

    Learn how to get and install HTCondor-CE through our documentation.

    Contact Us

    HTCondor-CE is developed and maintained by the Center for High Throughput Computing. If you have questions or issues regarding HTCondor-CE, please see the diff --git a/search/search_index.json b/search/search_index.json index a81c36b3b..8a907db78 100644 --- a/search/search_index.json +++ b/search/search_index.json @@ -1 +1 @@ -{"config":{"lang":["en"],"min_search_length":3,"prebuild_index":false,"separator":"[\\s\\-]+"},"docs":[{"location":"","text":"HTCondor-CE \u00b6 The HTCondor-CE software is a Compute Entrypoint (CE) based on HTCondor for sites that are part of a larger computing grid (e.g. European Grid Infrastructure , The OSG Consortium ). As such, HTCondor-CE serves as a \"door\" for incoming resource allocation requests (RARs) \u2014 it handles authorization and delegation of these requests to a grid site's local batch system. Supported batch systems include Grid Engine , HTCondor , LSF , PBS Pro / Torque , and Slurm . For an introduction to HTCondor-CE, watch our recorded webinar from the EGI Community Webinar Programme: What is a Compute Entrypoint? \u00b6 A Compute Entrypoint (CE) is the door for remote organizations to submit requests to temporarily allocate local compute resources. These resource allocation requests are submitted as pilot jobs that create an environment for end-user jobs to match and ultimately run within the pilot job. CEs are made up of a thin layer of software that you install on a machine that already has the ability to submit and manage jobs in your local batch system. What is HTCondor-CE? \u00b6 HTCondor-CE is a special configuration of the HTCondor software designed as a Compute Entrypoint. It is configured to use the HTCondor Job Router daemon to delegate resource allocation requests by transforming and submitting them to the site\u2019s batch system. Benefits of running the HTCondor-CE: Scalability: HTCondor-CE is capable of supporting ~16k concurrent RARs Debugging tools: HTCondor-CE offers many tools to help troubleshoot issues with RARs Routing as configuration: HTCondor-CE\u2019s mechanism to transform and submit RARs is customized via configuration variables, which means that customizations will persist across upgrades and will not involve modification of software internals to route jobs Getting HTCondor-CE \u00b6 Learn how to get and install HTCondor-CE through our documentation . Contact Us \u00b6 HTCondor-CE is developed and maintained by the Center for High Throughput Computing . If you have questions or issues regarding HTCondor-CE, please see the HTCondor support page for how to contact us.","title":"Overview"},{"location":"#htcondor-ce","text":"The HTCondor-CE software is a Compute Entrypoint (CE) based on HTCondor for sites that are part of a larger computing grid (e.g. European Grid Infrastructure , The OSG Consortium ). As such, HTCondor-CE serves as a \"door\" for incoming resource allocation requests (RARs) \u2014 it handles authorization and delegation of these requests to a grid site's local batch system. Supported batch systems include Grid Engine , HTCondor , LSF , PBS Pro / Torque , and Slurm . For an introduction to HTCondor-CE, watch our recorded webinar from the EGI Community Webinar Programme:","title":"HTCondor-CE"},{"location":"#what-is-a-compute-entrypoint","text":"A Compute Entrypoint (CE) is the door for remote organizations to submit requests to temporarily allocate local compute resources. These resource allocation requests are submitted as pilot jobs that create an environment for end-user jobs to match and ultimately run within the pilot job. CEs are made up of a thin layer of software that you install on a machine that already has the ability to submit and manage jobs in your local batch system.","title":"What is a Compute Entrypoint?"},{"location":"#what-is-htcondor-ce","text":"HTCondor-CE is a special configuration of the HTCondor software designed as a Compute Entrypoint. It is configured to use the HTCondor Job Router daemon to delegate resource allocation requests by transforming and submitting them to the site\u2019s batch system. Benefits of running the HTCondor-CE: Scalability: HTCondor-CE is capable of supporting ~16k concurrent RARs Debugging tools: HTCondor-CE offers many tools to help troubleshoot issues with RARs Routing as configuration: HTCondor-CE\u2019s mechanism to transform and submit RARs is customized via configuration variables, which means that customizations will persist across upgrades and will not involve modification of software internals to route jobs","title":"What is HTCondor-CE?"},{"location":"#getting-htcondor-ce","text":"Learn how to get and install HTCondor-CE through our documentation .","title":"Getting HTCondor-CE"},{"location":"#contact-us","text":"HTCondor-CE is developed and maintained by the Center for High Throughput Computing . If you have questions or issues regarding HTCondor-CE, please see the HTCondor support page for how to contact us.","title":"Contact Us"},{"location":"architecture/","text":"How Jobs Run \u00b6 Once an incoming pilot job is authorized, it is placed into HTCondor-CE\u2019s scheduler where the Job Router creates a transformed copy (called the routed job ) and submits the copy to the batch system (called the batch system job ). After submission, HTCondor-CE monitors the batch system job and communicates its status to the original pilot job, which in turn notifies the original submitter (e.g., job factory) of any updates. When the batch job job completes, files are transferred along the same chain: from the batch system to the CE, then from the CE to the original submitter. On HTCondor batch systems \u00b6 For a site with an HTCondor batch system , the Job Router uses HTCondor protocols to place a transformed copy of the pilot job directly into the batch system\u2019s scheduler, meaning that the routed job is also the batch system job. Thus, there are three representations of your job, each with its own ID (see diagram below): Submitter: the HTCondor job ID in the original queue HTCondor-CE: the incoming pilot job\u2019s ID HTCondor batch system: the routed job\u2019s ID In an HTCondor-CE/HTCondor setup, file transfer is handled natively between the two sets of daemons by the underlying HTCondor software. If you are running HTCondor as your batch system, you will have two HTCondor configurations side-by-side (one residing in /etc/condor/ and the other in /etc/condor-ce ) and will need to make sure to differentiate the two when modifying any configuration. On other batch systems \u00b6 For non-HTCondor batch systems, the Job Router transforms the pilot job into a routed job on the CE and the routed job submits a job into the batch system via a process called the BLAHP. Thus, there are four representations of your job, each with its own ID (see diagram below): Submitter: the HTCondor job ID in the original queue HTCondor-CE: the incoming pilot job\u2019s ID and the routed job\u2019s ID Non-HTCondor batch system: the batch system\u2019s job ID Although the following figure specifies the PBS case, it applies to all non-HTCondor batch systems: With non-HTCondor batch systems, HTCondor-CE cannot use internal HTCondor protocols to transfer files so its \"spool\" directory must be exported to a shared file system that is mounted on the batch system\u2019s worker nodes. Hosted CE over SSH \u00b6 The Hosted CE is designed to be an HTCondor-CE as a Service offered by a central grid operations team. Hosted CEs submit jobs to remote clusters over SSH, providing a simple starting point for opportunistic resource owners that want to start contributing to a computing grid with minimal effort. If your site intends to run over 10,000 concurrent pilot jobs, you will need to host your own HTCondor-CE because the Hosted CE has not yet been optimized for such loads. How the CE is Customized \u00b6 Aside from the [basic configuration] required in the CE installation, there are two main ways to customize your CE (if you decide any customization is required at all): Deciding which Virtual Organizations (VOs) are allowed to run at your site: HTCondor-CE leverages HTCondor's built-in ability to authenticate incoming jobs based on their OAuth token credentials. How to filter and transform the pilot jobs to be run on your batch system: Filtering and transforming pilot jobs (i.e., setting site-specific attributes or resource limits), requires configuration of your site\u2019s job routes. For examples of common job routes, consult the job router configuration pages. How Security Works \u00b6 In the grid, security depends on a PKI infrastructure involving Certificate Authorities (CAs) where CAs sign and issue certificates. When these clients and hosts wish to communicate with each other, the identities of each party is confirmed by cross-checking their certificates with the signing CA and establishing trust. In its default configuration, HTCondor-CE supports token-based authentication and authorization to the remote submitter's credentials.","title":"Architecture"},{"location":"architecture/#how-jobs-run","text":"Once an incoming pilot job is authorized, it is placed into HTCondor-CE\u2019s scheduler where the Job Router creates a transformed copy (called the routed job ) and submits the copy to the batch system (called the batch system job ). After submission, HTCondor-CE monitors the batch system job and communicates its status to the original pilot job, which in turn notifies the original submitter (e.g., job factory) of any updates. When the batch job job completes, files are transferred along the same chain: from the batch system to the CE, then from the CE to the original submitter.","title":"How Jobs Run"},{"location":"architecture/#on-htcondor-batch-systems","text":"For a site with an HTCondor batch system , the Job Router uses HTCondor protocols to place a transformed copy of the pilot job directly into the batch system\u2019s scheduler, meaning that the routed job is also the batch system job. Thus, there are three representations of your job, each with its own ID (see diagram below): Submitter: the HTCondor job ID in the original queue HTCondor-CE: the incoming pilot job\u2019s ID HTCondor batch system: the routed job\u2019s ID In an HTCondor-CE/HTCondor setup, file transfer is handled natively between the two sets of daemons by the underlying HTCondor software. If you are running HTCondor as your batch system, you will have two HTCondor configurations side-by-side (one residing in /etc/condor/ and the other in /etc/condor-ce ) and will need to make sure to differentiate the two when modifying any configuration.","title":"On HTCondor batch systems"},{"location":"architecture/#on-other-batch-systems","text":"For non-HTCondor batch systems, the Job Router transforms the pilot job into a routed job on the CE and the routed job submits a job into the batch system via a process called the BLAHP. Thus, there are four representations of your job, each with its own ID (see diagram below): Submitter: the HTCondor job ID in the original queue HTCondor-CE: the incoming pilot job\u2019s ID and the routed job\u2019s ID Non-HTCondor batch system: the batch system\u2019s job ID Although the following figure specifies the PBS case, it applies to all non-HTCondor batch systems: With non-HTCondor batch systems, HTCondor-CE cannot use internal HTCondor protocols to transfer files so its \"spool\" directory must be exported to a shared file system that is mounted on the batch system\u2019s worker nodes.","title":"On other batch systems"},{"location":"architecture/#hosted-ce-over-ssh","text":"The Hosted CE is designed to be an HTCondor-CE as a Service offered by a central grid operations team. Hosted CEs submit jobs to remote clusters over SSH, providing a simple starting point for opportunistic resource owners that want to start contributing to a computing grid with minimal effort. If your site intends to run over 10,000 concurrent pilot jobs, you will need to host your own HTCondor-CE because the Hosted CE has not yet been optimized for such loads.","title":"Hosted CE over SSH"},{"location":"architecture/#how-the-ce-is-customized","text":"Aside from the [basic configuration] required in the CE installation, there are two main ways to customize your CE (if you decide any customization is required at all): Deciding which Virtual Organizations (VOs) are allowed to run at your site: HTCondor-CE leverages HTCondor's built-in ability to authenticate incoming jobs based on their OAuth token credentials. How to filter and transform the pilot jobs to be run on your batch system: Filtering and transforming pilot jobs (i.e., setting site-specific attributes or resource limits), requires configuration of your site\u2019s job routes. For examples of common job routes, consult the job router configuration pages.","title":"How the CE is Customized"},{"location":"architecture/#how-security-works","text":"In the grid, security depends on a PKI infrastructure involving Certificate Authorities (CAs) where CAs sign and issue certificates. When these clients and hosts wish to communicate with each other, the identities of each party is confirmed by cross-checking their certificates with the signing CA and establishing trust. In its default configuration, HTCondor-CE supports token-based authentication and authorization to the remote submitter's credentials.","title":"How Security Works"},{"location":"v23/operation/","text":"Operating an HTCondor-CE \u00b6 To verify that you have a working installation of HTCondor-CE, ensure that all the relevant services are started and enabled then perform the validation steps below. Managing HTCondor-CE services \u00b6 In addition to the HTCondor-CE job gateway service itself, there are a number of supporting services in your installation. The specific services are: Software Service name Your batch system condor or pbs_server or \u2026 HTCondor-CE condor-ce (Optional) APEL uploader condor-ce-apel and condor-ce-apel.timer Start and enable the services in the order listed and stop them in reverse order. As a reminder, here are common service commands (all run as root ): To... On EL7, run the command... Start a service systemctl start Stop a service systemctl stop Enable a service to start on boot systemctl enable Disable a service from starting on boot systemctl disable Validating HTCondor-CE \u00b6 To validate an HTCondor-CE, perform the following steps: Verify that local job submissions complete successfully from the CE host. For example, if you have a Slurm cluster, run sbatch from the CE and verify that it runs and completes with scontrol and sacct . Verify that all the necessary daemons are running with condor_ce_status -any . Verify the CE's network configuration using condor_ce_host_network_check . Verify that jobs can complete successfully using condor_ce_trace . Draining an HTCondor-CE \u00b6 To drain an HTCondor-CE of jobs, perform the following steps: Set CONDORCE_MAX_JOBS = 0 in /etc/condor-ce/config.d Run condor_ce_reconfig to apply the configuration change Use condor_ce_rm as needed to stop and remove any jobs that should stop running Once draining is completed, don't forget to restore the value of CONDORCE_MAX_JOBS to its previous value before trying to operate the HTCondor-CE again. Checking User Authentication \u00b6 The authentication method for submitting jobs to an HTCondor-CE is SciTokens. To see which authentication method and identity were used to submit a particular job (or modify existing jobs), you can look in /var/log/condor-ce/AuditLog . If SciTokens authentication was used, you'll see a set of lines like this: 10/15/21 17:54:08 (cid:130) (D_AUDIT) Command=QMGMT_WRITE_CMD, peer=<172.17.0.2:37869> 10/15/21 17:54:08 (cid:130) (D_AUDIT) AuthMethod=SCITOKENS, AuthId=https://demo.scitokens.org,htcondor-ce-dev, CondorId=testuser@users.htcondor.org 10/15/21 17:54:08 (cid:130) (D_AUDIT) Submitting new job 2.0 Lines pertaining to the same client request will have the same cid value. Lines from different client requests may be interleaved. Getting Help \u00b6 If any of the above validation steps fail, consult the troubleshooting guide . If that still doesn't resolve your issue, please contact us for assistance.","title":"Operation"},{"location":"v23/operation/#operating-an-htcondor-ce","text":"To verify that you have a working installation of HTCondor-CE, ensure that all the relevant services are started and enabled then perform the validation steps below.","title":"Operating an HTCondor-CE"},{"location":"v23/operation/#managing-htcondor-ce-services","text":"In addition to the HTCondor-CE job gateway service itself, there are a number of supporting services in your installation. The specific services are: Software Service name Your batch system condor or pbs_server or \u2026 HTCondor-CE condor-ce (Optional) APEL uploader condor-ce-apel and condor-ce-apel.timer Start and enable the services in the order listed and stop them in reverse order. As a reminder, here are common service commands (all run as root ): To... On EL7, run the command... Start a service systemctl start Stop a service systemctl stop Enable a service to start on boot systemctl enable Disable a service from starting on boot systemctl disable ","title":"Managing HTCondor-CE services"},{"location":"v23/operation/#validating-htcondor-ce","text":"To validate an HTCondor-CE, perform the following steps: Verify that local job submissions complete successfully from the CE host. For example, if you have a Slurm cluster, run sbatch from the CE and verify that it runs and completes with scontrol and sacct . Verify that all the necessary daemons are running with condor_ce_status -any . Verify the CE's network configuration using condor_ce_host_network_check . Verify that jobs can complete successfully using condor_ce_trace .","title":"Validating HTCondor-CE"},{"location":"v23/operation/#draining-an-htcondor-ce","text":"To drain an HTCondor-CE of jobs, perform the following steps: Set CONDORCE_MAX_JOBS = 0 in /etc/condor-ce/config.d Run condor_ce_reconfig to apply the configuration change Use condor_ce_rm as needed to stop and remove any jobs that should stop running Once draining is completed, don't forget to restore the value of CONDORCE_MAX_JOBS to its previous value before trying to operate the HTCondor-CE again.","title":"Draining an HTCondor-CE"},{"location":"v23/operation/#checking-user-authentication","text":"The authentication method for submitting jobs to an HTCondor-CE is SciTokens. To see which authentication method and identity were used to submit a particular job (or modify existing jobs), you can look in /var/log/condor-ce/AuditLog . If SciTokens authentication was used, you'll see a set of lines like this: 10/15/21 17:54:08 (cid:130) (D_AUDIT) Command=QMGMT_WRITE_CMD, peer=<172.17.0.2:37869> 10/15/21 17:54:08 (cid:130) (D_AUDIT) AuthMethod=SCITOKENS, AuthId=https://demo.scitokens.org,htcondor-ce-dev, CondorId=testuser@users.htcondor.org 10/15/21 17:54:08 (cid:130) (D_AUDIT) Submitting new job 2.0 Lines pertaining to the same client request will have the same cid value. Lines from different client requests may be interleaved.","title":"Checking User Authentication"},{"location":"v23/operation/#getting-help","text":"If any of the above validation steps fail, consult the troubleshooting guide . If that still doesn't resolve your issue, please contact us for assistance.","title":"Getting Help"},{"location":"v23/reference/","text":"Reference \u00b6 Configuration \u00b6 The following directories contain the configuration for HTCondor-CE. The directories are parsed in the order presented and thus configuration within the final directory will override configuration specified in the previous directories. Location Comment /usr/share/condor-ce/config.d/ Configuration defaults (overwritten on package updates) /etc/condor-ce/config.d/ Files in this directory are parsed in alphanumeric order (i.e., 99-local.conf will override values in 01-ce-auth.conf ) For a detailed order of the way configuration files are parsed, run the following command: user@host $ condor_ce_config_val -config Users \u00b6 The following users are needed by HTCondor-CE at all sites: User Comment condor The HTCondor-CE will be run as root, but perform most of its operations as the condor user. Certificates \u00b6 File User that owns certificate Path to certificate Host certificate root /etc/grid-security/hostcert.pem Host key root /grid-security/hostkey.pem Networking \u00b6 Service Name Protocol Port Number Inbound Outbound Comment Htcondor-CE tcp 9619 X HTCondor-CE shared port Allow inbound and outbound network connection to all internal site servers, such as the batch system head-node only ephemeral outgoing ports are necessary.","title":"Reference"},{"location":"v23/reference/#reference","text":"","title":"Reference"},{"location":"v23/reference/#configuration","text":"The following directories contain the configuration for HTCondor-CE. The directories are parsed in the order presented and thus configuration within the final directory will override configuration specified in the previous directories. Location Comment /usr/share/condor-ce/config.d/ Configuration defaults (overwritten on package updates) /etc/condor-ce/config.d/ Files in this directory are parsed in alphanumeric order (i.e., 99-local.conf will override values in 01-ce-auth.conf ) For a detailed order of the way configuration files are parsed, run the following command: user@host $ condor_ce_config_val -config","title":"Configuration"},{"location":"v23/reference/#users","text":"The following users are needed by HTCondor-CE at all sites: User Comment condor The HTCondor-CE will be run as root, but perform most of its operations as the condor user.","title":"Users"},{"location":"v23/reference/#certificates","text":"File User that owns certificate Path to certificate Host certificate root /etc/grid-security/hostcert.pem Host key root /grid-security/hostkey.pem","title":"Certificates"},{"location":"v23/reference/#networking","text":"Service Name Protocol Port Number Inbound Outbound Comment Htcondor-CE tcp 9619 X HTCondor-CE shared port Allow inbound and outbound network connection to all internal site servers, such as the batch system head-node only ephemeral outgoing ports are necessary.","title":"Networking"},{"location":"v23/releases/","text":"Releases \u00b6 HTCondor-CE 23 is distributed via RPM and are available from the following Yum repositories: HTCondor LTS and Feature Releases The OSG Consortium Known Issues \u00b6 Known bugs affecting HTCondor-CEs can be found in Jira Updating to HTCondor-CE 23 \u00b6 Updating from HTCondor-CE < 6 If updating to HTCondor-CE 23 from HTCondor-CE < 6, be sure to also consult the HTCondor-CE 6 upgrade instructions . Finding relevant configuration changes When updating HTCondor-CE RPMs, .rpmnew and .rpmsave files may be created containing new defaults that you should merge or new defaults that have replaced your customzations, respectively. To find these files for HTCondor-CE, run the following command: root@host # find /etc/condor-ce/ -name '*.rpmnew' -name '*.rpmsave' HTCondor-CE 23 is very close in functionality to HTCondor-CE 6. As such, upgrading should be very easy. HTCondor-CE 23 Version History \u00b6 This section contains release notes for each version of HTCondor-CE 23. Full HTCondor-CE version history can be found on GitHub . October 30, 2024: 23.10.1 \u00b6 This release includes the following new features: Fix certificate subject parsing in condor_ce_host_network_check October 30, 2024: 23.0.17 \u00b6 This release includes the following new features: Remove obsolete GSI configuration August 8, 2024: 23.9.1 \u00b6 This release includes the following new features: Use new Job Router syntax by default Update configuration files to work with HTCondor 23.9.1 and later Use BatchQueue job attribute in CE routes July 24, 2024: 23.0.13 \u00b6 This release includes the following new features: Package condor_ce_upgrade_check July 16, 2024: 23.0.12 \u00b6 This release includes the following new features: Fix whole node GPU request expression for non-HTCondor batch systems April 11, 2024: 23.0.8 \u00b6 This release includes the following new features: Fix memory request being ignored for whole node jobs March 14, 2024: 23.0.6 \u00b6 This release includes the following new features: Fix CE job route transform for job environment Fix CERequirements when the default_CERequirements is not set Add condor_ce_test_token tool to generate short lived SciToken for tests Remove GSI from security method list to eliminate annoying warnings January 4, 2024: 23.0.3 \u00b6 This release includes the following new features: Ensure that jobs requesting GPUs land on HTCondor EPs with GPUs November 16, 2023: 23.0.1 \u00b6 This release includes the following new features: Add condor_ce_test_token command September 21, 2023: 23.0.0 \u00b6 This release includes the following new features: Add grid CA and host certificate/key locations to default SSL search paths Verifies that HTCondor-CE can access the local HTCondor's SPOOL directory Can use condor_ce_trace without SciToken to test batch system integration condor_ce_upgrade_check checks compatibility with HTCondor 23.0 Adds deprecation warnings for old job router configuration syntax Getting Help \u00b6 If you have any questions about the release process or run into issues with an upgrade, please contact us for assistance.","title":"Releases"},{"location":"v23/releases/#releases","text":"HTCondor-CE 23 is distributed via RPM and are available from the following Yum repositories: HTCondor LTS and Feature Releases The OSG Consortium","title":"Releases"},{"location":"v23/releases/#known-issues","text":"Known bugs affecting HTCondor-CEs can be found in Jira","title":"Known Issues"},{"location":"v23/releases/#updating-to-htcondor-ce-23","text":"Updating from HTCondor-CE < 6 If updating to HTCondor-CE 23 from HTCondor-CE < 6, be sure to also consult the HTCondor-CE 6 upgrade instructions . Finding relevant configuration changes When updating HTCondor-CE RPMs, .rpmnew and .rpmsave files may be created containing new defaults that you should merge or new defaults that have replaced your customzations, respectively. To find these files for HTCondor-CE, run the following command: root@host # find /etc/condor-ce/ -name '*.rpmnew' -name '*.rpmsave' HTCondor-CE 23 is very close in functionality to HTCondor-CE 6. As such, upgrading should be very easy.","title":"Updating to HTCondor-CE 23"},{"location":"v23/releases/#htcondor-ce-23-version-history","text":"This section contains release notes for each version of HTCondor-CE 23. Full HTCondor-CE version history can be found on GitHub .","title":"HTCondor-CE 23 Version History"},{"location":"v23/releases/#october-30-2024-23101","text":"This release includes the following new features: Fix certificate subject parsing in condor_ce_host_network_check","title":"October 30, 2024: 23.10.1"},{"location":"v23/releases/#october-30-2024-23017","text":"This release includes the following new features: Remove obsolete GSI configuration","title":"October 30, 2024: 23.0.17"},{"location":"v23/releases/#august-8-2024-2391","text":"This release includes the following new features: Use new Job Router syntax by default Update configuration files to work with HTCondor 23.9.1 and later Use BatchQueue job attribute in CE routes","title":"August 8, 2024: 23.9.1"},{"location":"v23/releases/#july-24-2024-23013","text":"This release includes the following new features: Package condor_ce_upgrade_check","title":"July 24, 2024: 23.0.13"},{"location":"v23/releases/#july-16-2024-23012","text":"This release includes the following new features: Fix whole node GPU request expression for non-HTCondor batch systems","title":"July 16, 2024: 23.0.12"},{"location":"v23/releases/#april-11-2024-2308","text":"This release includes the following new features: Fix memory request being ignored for whole node jobs","title":"April 11, 2024: 23.0.8"},{"location":"v23/releases/#march-14-2024-2306","text":"This release includes the following new features: Fix CE job route transform for job environment Fix CERequirements when the default_CERequirements is not set Add condor_ce_test_token tool to generate short lived SciToken for tests Remove GSI from security method list to eliminate annoying warnings","title":"March 14, 2024: 23.0.6"},{"location":"v23/releases/#january-4-2024-2303","text":"This release includes the following new features: Ensure that jobs requesting GPUs land on HTCondor EPs with GPUs","title":"January 4, 2024: 23.0.3"},{"location":"v23/releases/#november-16-2023-2301","text":"This release includes the following new features: Add condor_ce_test_token command","title":"November 16, 2023: 23.0.1"},{"location":"v23/releases/#september-21-2023-2300","text":"This release includes the following new features: Add grid CA and host certificate/key locations to default SSL search paths Verifies that HTCondor-CE can access the local HTCondor's SPOOL directory Can use condor_ce_trace without SciToken to test batch system integration condor_ce_upgrade_check checks compatibility with HTCondor 23.0 Adds deprecation warnings for old job router configuration syntax","title":"September 21, 2023: 23.0.0"},{"location":"v23/releases/#getting-help","text":"If you have any questions about the release process or run into issues with an upgrade, please contact us for assistance.","title":"Getting Help"},{"location":"v23/remote-job-submission/","text":"Submitting Jobs Remotely to an HTCondor-CE \u00b6 This document outlines how to submit jobs to an HTCondor-CE from a remote client using two different methods: With dedicated tools for quickly verifying end-to-end job submission, and From an existing HTCondor submit host, useful for developing pilot submission infrastructure If you are the administrator of an HTCondor-CE, consider verifying your HTCondor-CE using the administrator-focused documentation . Before Starting \u00b6 Before attempting to submit jobs to an HTCondor-CE as documented below, ensure the following: The HTCondor-CE administrator has independently verified their HTCondor-CE The HTCondor-CE administrator has added your credential information (e.g. SciToken or grid proxy) to the HTCondor-CE authentication configuration Your credentials are valid and unexpired Submission with Debugging Tools \u00b6 The HTCondor-CE client contains debugging tools designed to quickly test an HTCondor-CE. To use these tools, install the RPM package from the relevant Yum repository : root@host # yum install htcondor-ce-client Verify end-to-end submission \u00b6 The HTCondor-CE client package includes a debugging tool that perform tests of end-to-end job submission called condor_ce_trace . To submit a diagnostic job with condor_ce_trace , run the following command: user@host $ condor_ce_trace --debug Replacing with the hostname of the CE you wish to test. On success, you will see Job status: Completed and the job's environment on the worker node where it ran. If you do not see the expected output, refer to the troubleshooting guide . CONDOR_CE_TRACE_ATTEMPTS For a busy site cluster, it may take longer than the default 5 minutes to test end-to-end submission. To extend the length of time that condor_ce_trace waits for the job to complete, prepend the command with _condor_CONDOR_CE_TRACE_ATTEMPTS=

  • - + HTCondor-CE 6
    • @@ -750,7 +750,7 @@
  • - + Installation
    • @@ -783,7 +783,7 @@
  • - + Authentication
    • @@ -795,7 +795,7 @@
  • - + Local Batch System
    • @@ -828,7 +828,7 @@
  • - + Overview
    • @@ -840,7 +840,7 @@
  • - + Writing Job Routes
    • @@ -852,7 +852,7 @@
  • - + For HTCondor Batch Systems
    • @@ -864,7 +864,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -882,7 +882,7 @@
  • - + Optional Configuration
    • @@ -900,7 +900,7 @@
  • - + Operation
    • @@ -933,7 +933,7 @@
  • - + Common Issues
    • @@ -945,7 +945,7 @@
  • - + Debugging Tools
    • @@ -957,7 +957,7 @@
  • - + Helpful Logs
    • @@ -996,7 +996,7 @@
  • - + Submit Jobs Remotely
    • @@ -1008,7 +1008,7 @@
  • - + Remote Troubleshooting
    • @@ -1020,7 +1020,7 @@
  • - + Install a Central Collector
    • @@ -1038,7 +1038,7 @@
  • - + Releases
    • @@ -1050,7 +1050,7 @@
  • - + Reference
    • diff --git a/v23/configuration/htcondor-routes/index.html b/v23/configuration/htcondor-routes/index.html index 33f36ff2f..de364207c 100644 --- a/v23/configuration/htcondor-routes/index.html +++ b/v23/configuration/htcondor-routes/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -759,7 +759,7 @@
  • - + Installation
    • @@ -792,7 +792,7 @@
  • - + Authentication
    • @@ -804,7 +804,7 @@
  • - + Local Batch System
    • @@ -837,7 +837,7 @@
  • - + Overview
    • @@ -849,7 +849,7 @@
  • - + Writing Job Routes
    • @@ -861,7 +861,7 @@
  • - + For HTCondor Batch Systems
    • @@ -873,7 +873,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -891,7 +891,7 @@
  • - + Optional Configuration
    • @@ -909,7 +909,7 @@
  • - + Operation
    • @@ -942,7 +942,7 @@
  • - + Common Issues
    • @@ -954,7 +954,7 @@
  • - + Debugging Tools
    • @@ -966,7 +966,7 @@
  • - + Helpful Logs
    • @@ -1005,7 +1005,7 @@
  • - + Submit Jobs Remotely
    • @@ -1017,7 +1017,7 @@
  • - + Remote Troubleshooting
    • @@ -1029,7 +1029,7 @@
  • - + Install a Central Collector
    • @@ -1047,7 +1047,7 @@
  • - + Releases
    • @@ -1059,7 +1059,7 @@
  • - + Reference
    • diff --git a/v23/configuration/job-router-overview/index.html b/v23/configuration/job-router-overview/index.html index c45b02520..87d7b99d6 100644 --- a/v23/configuration/job-router-overview/index.html +++ b/v23/configuration/job-router-overview/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -773,7 +773,7 @@
  • - + Installation
    • @@ -806,7 +806,7 @@
  • - + Authentication
    • @@ -818,7 +818,7 @@
  • - + Local Batch System
    • @@ -851,7 +851,7 @@
  • - + Overview
    • @@ -863,7 +863,7 @@
  • - + Writing Job Routes
    • @@ -875,7 +875,7 @@
  • - + For HTCondor Batch Systems
    • @@ -887,7 +887,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -905,7 +905,7 @@
  • - + Optional Configuration
    • @@ -923,7 +923,7 @@
  • - + Operation
    • @@ -956,7 +956,7 @@
  • - + Common Issues
    • @@ -968,7 +968,7 @@
  • - + Debugging Tools
    • @@ -980,7 +980,7 @@
  • - + Helpful Logs
    • @@ -1019,7 +1019,7 @@
  • - + Submit Jobs Remotely
    • @@ -1031,7 +1031,7 @@
  • - + Remote Troubleshooting
    • @@ -1043,7 +1043,7 @@
  • - + Install a Central Collector
    • @@ -1061,7 +1061,7 @@
  • - + Releases
    • @@ -1073,7 +1073,7 @@
  • - + Reference
    • diff --git a/v23/configuration/local-batch-system/index.html b/v23/configuration/local-batch-system/index.html index 945469e47..430fc0fee 100644 --- a/v23/configuration/local-batch-system/index.html +++ b/v23/configuration/local-batch-system/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -750,7 +750,7 @@
  • - + Installation
    • @@ -783,7 +783,7 @@
  • - + Authentication
    • @@ -795,7 +795,7 @@
  • - + Local Batch System
    • @@ -828,7 +828,7 @@
  • - + Overview
    • @@ -840,7 +840,7 @@
  • - + Writing Job Routes
    • @@ -852,7 +852,7 @@
  • - + For HTCondor Batch Systems
    • @@ -864,7 +864,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -882,7 +882,7 @@
  • - + Optional Configuration
    • @@ -900,7 +900,7 @@
  • - + Operation
    • @@ -933,7 +933,7 @@
  • - + Common Issues
    • @@ -945,7 +945,7 @@
  • - + Debugging Tools
    • @@ -957,7 +957,7 @@
  • - + Helpful Logs
    • @@ -996,7 +996,7 @@
  • - + Submit Jobs Remotely
    • @@ -1008,7 +1008,7 @@
  • - + Remote Troubleshooting
    • @@ -1020,7 +1020,7 @@
  • - + Install a Central Collector
    • @@ -1038,7 +1038,7 @@
  • - + Releases
    • @@ -1050,7 +1050,7 @@
  • - + Reference
    • diff --git a/v23/configuration/non-htcondor-routes/index.html b/v23/configuration/non-htcondor-routes/index.html index ad0e16249..c12aab2f4 100644 --- a/v23/configuration/non-htcondor-routes/index.html +++ b/v23/configuration/non-htcondor-routes/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -739,7 +739,7 @@
  • - + Installation
    • @@ -772,7 +772,7 @@
  • - + Authentication
    • @@ -784,7 +784,7 @@
  • - + Local Batch System
    • @@ -817,7 +817,7 @@
  • - + Overview
    • @@ -829,7 +829,7 @@
  • - + Writing Job Routes
    • @@ -841,7 +841,7 @@
  • - + For HTCondor Batch Systems
    • @@ -853,7 +853,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -871,7 +871,7 @@
  • - + Optional Configuration
    • @@ -889,7 +889,7 @@
  • - + Operation
    • @@ -922,7 +922,7 @@
  • - + Common Issues
    • @@ -934,7 +934,7 @@
  • - + Debugging Tools
    • @@ -946,7 +946,7 @@
  • - + Helpful Logs
    • @@ -985,7 +985,7 @@
  • - + Submit Jobs Remotely
    • @@ -997,7 +997,7 @@
  • - + Remote Troubleshooting
    • @@ -1009,7 +1009,7 @@
  • - + Install a Central Collector
    • @@ -1027,7 +1027,7 @@
  • - + Releases
    • @@ -1039,7 +1039,7 @@
  • - + Reference
    • diff --git a/v23/configuration/optional-configuration/index.html b/v23/configuration/optional-configuration/index.html index f5713333a..8b0611e34 100644 --- a/v23/configuration/optional-configuration/index.html +++ b/v23/configuration/optional-configuration/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -758,7 +758,7 @@
  • - + Installation
    • @@ -791,7 +791,7 @@
  • - + Authentication
    • @@ -803,7 +803,7 @@
  • - + Local Batch System
    • @@ -836,7 +836,7 @@
  • - + Overview
    • @@ -848,7 +848,7 @@
  • - + Writing Job Routes
    • @@ -860,7 +860,7 @@
  • - + For HTCondor Batch Systems
    • @@ -872,7 +872,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -890,7 +890,7 @@
  • - + Optional Configuration
    • @@ -908,7 +908,7 @@
  • - + Operation
    • @@ -941,7 +941,7 @@
  • - + Common Issues
    • @@ -953,7 +953,7 @@
  • - + Debugging Tools
    • @@ -965,7 +965,7 @@
  • - + Helpful Logs
    • @@ -1004,7 +1004,7 @@
  • - + Submit Jobs Remotely
    • @@ -1016,7 +1016,7 @@
  • - + Remote Troubleshooting
    • @@ -1028,7 +1028,7 @@
  • - + Install a Central Collector
    • @@ -1046,7 +1046,7 @@
  • - + Releases
    • @@ -1058,7 +1058,7 @@
  • - + Reference
    • diff --git a/v23/configuration/writing-job-routes/index.html b/v23/configuration/writing-job-routes/index.html index 732c4560f..f6a57f137 100644 --- a/v23/configuration/writing-job-routes/index.html +++ b/v23/configuration/writing-job-routes/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -977,7 +977,7 @@
  • - + Installation
    • @@ -1010,7 +1010,7 @@
  • - + Authentication
    • @@ -1022,7 +1022,7 @@
  • - + Local Batch System
    • @@ -1055,7 +1055,7 @@
  • - + Overview
    • @@ -1067,7 +1067,7 @@
  • - + Writing Job Routes
    • @@ -1079,7 +1079,7 @@
  • - + For HTCondor Batch Systems
    • @@ -1091,7 +1091,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -1109,7 +1109,7 @@
  • - + Optional Configuration
    • @@ -1127,7 +1127,7 @@
  • - + Operation
    • @@ -1160,7 +1160,7 @@
  • - + Common Issues
    • @@ -1172,7 +1172,7 @@
  • - + Debugging Tools
    • @@ -1184,7 +1184,7 @@
  • - + Helpful Logs
    • @@ -1223,7 +1223,7 @@
  • - + Submit Jobs Remotely
    • @@ -1235,7 +1235,7 @@
  • - + Remote Troubleshooting
    • @@ -1247,7 +1247,7 @@
  • - + Install a Central Collector
    • @@ -1265,7 +1265,7 @@
  • - + Releases
    • @@ -1277,7 +1277,7 @@
  • - + Reference
    • diff --git a/v23/installation/central-collector/index.html b/v23/installation/central-collector/index.html index 03ea09c99..c7921b17b 100644 --- a/v23/installation/central-collector/index.html +++ b/v23/installation/central-collector/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -811,7 +811,7 @@
  • - + Installation
    • @@ -844,7 +844,7 @@
  • - + Authentication
    • @@ -856,7 +856,7 @@
  • - + Local Batch System
    • @@ -889,7 +889,7 @@
  • - + Overview
    • @@ -901,7 +901,7 @@
  • - + Writing Job Routes
    • @@ -913,7 +913,7 @@
  • - + For HTCondor Batch Systems
    • @@ -925,7 +925,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -943,7 +943,7 @@
  • - + Optional Configuration
    • @@ -961,7 +961,7 @@
  • - + Operation
    • @@ -994,7 +994,7 @@
  • - + Common Issues
    • @@ -1006,7 +1006,7 @@
  • - + Debugging Tools
    • @@ -1018,7 +1018,7 @@
  • - + Helpful Logs
    • @@ -1057,7 +1057,7 @@
  • - + Submit Jobs Remotely
    • @@ -1069,7 +1069,7 @@
  • - + Remote Troubleshooting
    • @@ -1081,7 +1081,7 @@
  • - + Install a Central Collector
    • @@ -1099,7 +1099,7 @@
  • - + Releases
    • @@ -1111,7 +1111,7 @@
  • - + Reference
    • diff --git a/v23/installation/htcondor-ce/index.html b/v23/installation/htcondor-ce/index.html index 0045ff24b..4d8d033da 100644 --- a/v23/installation/htcondor-ce/index.html +++ b/v23/installation/htcondor-ce/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -742,7 +742,7 @@
  • - + Installation
    • @@ -775,7 +775,7 @@
  • - + Authentication
    • @@ -787,7 +787,7 @@
  • - + Local Batch System
    • @@ -820,7 +820,7 @@
  • - + Overview
    • @@ -832,7 +832,7 @@
  • - + Writing Job Routes
    • @@ -844,7 +844,7 @@
  • - + For HTCondor Batch Systems
    • @@ -856,7 +856,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -874,7 +874,7 @@
  • - + Optional Configuration
    • @@ -892,7 +892,7 @@
  • - + Operation
    • @@ -925,7 +925,7 @@
  • - + Common Issues
    • @@ -937,7 +937,7 @@
  • - + Debugging Tools
    • @@ -949,7 +949,7 @@
  • - + Helpful Logs
    • @@ -988,7 +988,7 @@
  • - + Submit Jobs Remotely
    • @@ -1000,7 +1000,7 @@
  • - + Remote Troubleshooting
    • @@ -1012,7 +1012,7 @@
  • - + Install a Central Collector
    • @@ -1030,7 +1030,7 @@
  • - + Releases
    • @@ -1042,7 +1042,7 @@
  • - + Reference
    • diff --git a/v23/operation/index.html b/v23/operation/index.html index 1771c1ba4..82f8a3187 100644 --- a/v23/operation/index.html +++ b/v23/operation/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -749,7 +749,7 @@
  • - + Installation
    • @@ -782,7 +782,7 @@
  • - + Authentication
    • @@ -794,7 +794,7 @@
  • - + Local Batch System
    • @@ -827,7 +827,7 @@
  • - + Overview
    • @@ -839,7 +839,7 @@
  • - + Writing Job Routes
    • @@ -851,7 +851,7 @@
  • - + For HTCondor Batch Systems
    • @@ -863,7 +863,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -881,7 +881,7 @@
  • - + Optional Configuration
    • @@ -899,7 +899,7 @@
  • - + Operation
    • @@ -932,7 +932,7 @@
  • - + Common Issues
    • @@ -944,7 +944,7 @@
  • - + Debugging Tools
    • @@ -956,7 +956,7 @@
  • - + Helpful Logs
    • @@ -995,7 +995,7 @@
  • - + Submit Jobs Remotely
    • @@ -1007,7 +1007,7 @@
  • - + Remote Troubleshooting
    • @@ -1019,7 +1019,7 @@
  • - + Install a Central Collector
    • @@ -1037,7 +1037,7 @@
  • - + Releases
    • @@ -1049,7 +1049,7 @@
  • - + Reference
    • diff --git a/v23/reference/index.html b/v23/reference/index.html index b392ca5c5..a95b9ce3a 100644 --- a/v23/reference/index.html +++ b/v23/reference/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -742,7 +742,7 @@
  • - + Installation
    • @@ -775,7 +775,7 @@
  • - + Authentication
    • @@ -787,7 +787,7 @@
  • - + Local Batch System
    • @@ -820,7 +820,7 @@
  • - + Overview
    • @@ -832,7 +832,7 @@
  • - + Writing Job Routes
    • @@ -844,7 +844,7 @@
  • - + For HTCondor Batch Systems
    • @@ -856,7 +856,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -874,7 +874,7 @@
  • - + Optional Configuration
    • @@ -892,7 +892,7 @@
  • - + Operation
    • @@ -925,7 +925,7 @@
  • - + Common Issues
    • @@ -937,7 +937,7 @@
  • - + Debugging Tools
    • @@ -949,7 +949,7 @@
  • - + Helpful Logs
    • @@ -988,7 +988,7 @@
  • - + Submit Jobs Remotely
    • @@ -1000,7 +1000,7 @@
  • - + Remote Troubleshooting
    • @@ -1012,7 +1012,7 @@
  • - + Install a Central Collector
    • @@ -1030,7 +1030,7 @@
  • - + Releases
    • @@ -1042,7 +1042,7 @@
  • - + Reference
    • @@ -1198,20 +1198,6 @@

    Networking -
    diff --git a/v23/releases/index.html b/v23/releases/index.html index c61a22003..b9b2b4d69 100644 --- a/v23/releases/index.html +++ b/v23/releases/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -818,7 +818,7 @@
  • - + Installation
    • @@ -851,7 +851,7 @@
  • - + Authentication
    • @@ -863,7 +863,7 @@
  • - + Local Batch System
    • @@ -896,7 +896,7 @@
  • - + Overview
    • @@ -908,7 +908,7 @@
  • - + Writing Job Routes
    • @@ -920,7 +920,7 @@
  • - + For HTCondor Batch Systems
    • @@ -932,7 +932,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -950,7 +950,7 @@
  • - + Optional Configuration
    • @@ -968,7 +968,7 @@
  • - + Operation
    • @@ -1001,7 +1001,7 @@
  • - + Common Issues
    • @@ -1013,7 +1013,7 @@
  • - + Debugging Tools
    • @@ -1025,7 +1025,7 @@
  • - + Helpful Logs
    • @@ -1064,7 +1064,7 @@
  • - + Submit Jobs Remotely
    • @@ -1076,7 +1076,7 @@
  • - + Remote Troubleshooting
    • @@ -1088,7 +1088,7 @@
  • - + Install a Central Collector
    • @@ -1106,7 +1106,7 @@
  • - + Releases
    • @@ -1118,7 +1118,7 @@
  • - + Reference
    • @@ -1158,11 +1158,6 @@

    Known IssuesKnown bugs affecting HTCondor-CEs can be found in Jira

    Updating to HTCondor-CE 23

    -
    -

    Updating from HTCondor-CE < 6

    -

    If updating to HTCondor-CE 23 from HTCondor-CE < 6, be sure to also consult the HTCondor-CE 6 -upgrade instructions.

    -

    Finding relevant configuration changes

    When updating HTCondor-CE RPMs, .rpmnew and .rpmsave files may be created containing new defaults that you diff --git a/v23/remote-job-submission/index.html b/v23/remote-job-submission/index.html index 45dfafec6..c328307bf 100644 --- a/v23/remote-job-submission/index.html +++ b/v23/remote-job-submission/index.html @@ -203,7 +203,7 @@

  • - + HTCondor-CE 6
    • @@ -798,7 +798,7 @@
  • - + Installation
    • @@ -831,7 +831,7 @@
  • - + Authentication
    • @@ -843,7 +843,7 @@
  • - + Local Batch System
    • @@ -876,7 +876,7 @@
  • - + Overview
    • @@ -888,7 +888,7 @@
  • - + Writing Job Routes
    • @@ -900,7 +900,7 @@
  • - + For HTCondor Batch Systems
    • @@ -912,7 +912,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -930,7 +930,7 @@
  • - + Optional Configuration
    • @@ -948,7 +948,7 @@
  • - + Operation
    • @@ -981,7 +981,7 @@
  • - + Common Issues
    • @@ -993,7 +993,7 @@
  • - + Debugging Tools
    • @@ -1005,7 +1005,7 @@
  • - + Helpful Logs
    • @@ -1044,7 +1044,7 @@
  • - + Submit Jobs Remotely
    • @@ -1056,7 +1056,7 @@
  • - + Remote Troubleshooting
    • @@ -1068,7 +1068,7 @@
  • - + Install a Central Collector
    • @@ -1086,7 +1086,7 @@
  • - + Releases
    • @@ -1098,7 +1098,7 @@
  • - + Reference
    • diff --git a/v23/troubleshooting/common-issues/index.html b/v23/troubleshooting/common-issues/index.html index abd57f866..d41d3828b 100644 --- a/v23/troubleshooting/common-issues/index.html +++ b/v23/troubleshooting/common-issues/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -1008,7 +1008,7 @@
  • - + Installation
    • @@ -1041,7 +1041,7 @@
  • - + Authentication
    • @@ -1053,7 +1053,7 @@
  • - + Local Batch System
    • @@ -1086,7 +1086,7 @@
  • - + Overview
    • @@ -1098,7 +1098,7 @@
  • - + Writing Job Routes
    • @@ -1110,7 +1110,7 @@
  • - + For HTCondor Batch Systems
    • @@ -1122,7 +1122,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -1140,7 +1140,7 @@
  • - + Optional Configuration
    • @@ -1158,7 +1158,7 @@
  • - + Operation
    • @@ -1191,7 +1191,7 @@
  • - + Common Issues
    • @@ -1203,7 +1203,7 @@
  • - + Debugging Tools
    • @@ -1215,7 +1215,7 @@
  • - + Helpful Logs
    • @@ -1254,7 +1254,7 @@
  • - + Submit Jobs Remotely
    • @@ -1266,7 +1266,7 @@
  • - + Remote Troubleshooting
    • @@ -1278,7 +1278,7 @@
  • - + Install a Central Collector
    • @@ -1296,7 +1296,7 @@
  • - + Releases
    • @@ -1308,7 +1308,7 @@
  • - + Reference
    • diff --git a/v23/troubleshooting/debugging-tools/index.html b/v23/troubleshooting/debugging-tools/index.html index 8840653c0..a0e2e5087 100644 --- a/v23/troubleshooting/debugging-tools/index.html +++ b/v23/troubleshooting/debugging-tools/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -1033,7 +1033,7 @@
  • - + Installation
    • @@ -1066,7 +1066,7 @@
  • - + Authentication
    • @@ -1078,7 +1078,7 @@
  • - + Local Batch System
    • @@ -1111,7 +1111,7 @@
  • - + Overview
    • @@ -1123,7 +1123,7 @@
  • - + Writing Job Routes
    • @@ -1135,7 +1135,7 @@
  • - + For HTCondor Batch Systems
    • @@ -1147,7 +1147,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -1165,7 +1165,7 @@
  • - + Optional Configuration
    • @@ -1183,7 +1183,7 @@
  • - + Operation
    • @@ -1216,7 +1216,7 @@
  • - + Common Issues
    • @@ -1228,7 +1228,7 @@
  • - + Debugging Tools
    • @@ -1240,7 +1240,7 @@
  • - + Helpful Logs
    • @@ -1279,7 +1279,7 @@
  • - + Submit Jobs Remotely
    • @@ -1291,7 +1291,7 @@
  • - + Remote Troubleshooting
    • @@ -1303,7 +1303,7 @@
  • - + Install a Central Collector
    • @@ -1321,7 +1321,7 @@
  • - + Releases
    • @@ -1333,7 +1333,7 @@
  • - + Reference
    • diff --git a/v23/troubleshooting/logs/index.html b/v23/troubleshooting/logs/index.html index 9165edf54..e128f6bd1 100644 --- a/v23/troubleshooting/logs/index.html +++ b/v23/troubleshooting/logs/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -824,7 +824,7 @@
  • - + Installation
    • @@ -857,7 +857,7 @@
  • - + Authentication
    • @@ -869,7 +869,7 @@
  • - + Local Batch System
    • @@ -902,7 +902,7 @@
  • - + Overview
    • @@ -914,7 +914,7 @@
  • - + Writing Job Routes
    • @@ -926,7 +926,7 @@
  • - + For HTCondor Batch Systems
    • @@ -938,7 +938,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -956,7 +956,7 @@
  • - + Optional Configuration
    • @@ -974,7 +974,7 @@
  • - + Operation
    • @@ -1007,7 +1007,7 @@
  • - + Common Issues
    • @@ -1019,7 +1019,7 @@
  • - + Debugging Tools
    • @@ -1031,7 +1031,7 @@
  • - + Helpful Logs
    • @@ -1070,7 +1070,7 @@
  • - + Submit Jobs Remotely
    • @@ -1082,7 +1082,7 @@
  • - + Remote Troubleshooting
    • @@ -1094,7 +1094,7 @@
  • - + Install a Central Collector
    • @@ -1112,7 +1112,7 @@
  • - + Releases
    • @@ -1124,7 +1124,7 @@
  • - + Reference
    • diff --git a/v23/troubleshooting/remote-troubleshooting/index.html b/v23/troubleshooting/remote-troubleshooting/index.html index 7ebec97cb..dbfd6a559 100644 --- a/v23/troubleshooting/remote-troubleshooting/index.html +++ b/v23/troubleshooting/remote-troubleshooting/index.html @@ -203,7 +203,7 @@
  • - + HTCondor-CE 6
    • @@ -818,7 +818,7 @@
  • - + Installation
    • @@ -851,7 +851,7 @@
  • - + Authentication
    • @@ -863,7 +863,7 @@
  • - + Local Batch System
    • @@ -896,7 +896,7 @@
  • - + Overview
    • @@ -908,7 +908,7 @@
  • - + Writing Job Routes
    • @@ -920,7 +920,7 @@
  • - + For HTCondor Batch Systems
    • @@ -932,7 +932,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -950,7 +950,7 @@
  • - + Optional Configuration
    • @@ -968,7 +968,7 @@
  • - + Operation
    • @@ -1001,7 +1001,7 @@
  • - + Common Issues
    • @@ -1013,7 +1013,7 @@
  • - + Debugging Tools
    • @@ -1025,7 +1025,7 @@
  • - + Helpful Logs
    • @@ -1064,7 +1064,7 @@
  • - + Submit Jobs Remotely
    • @@ -1076,7 +1076,7 @@
  • - + Remote Troubleshooting
    • @@ -1088,7 +1088,7 @@
  • - + Install a Central Collector
    • @@ -1106,7 +1106,7 @@
  • - + Releases
    • @@ -1118,7 +1118,7 @@
  • - + Reference
    • diff --git a/v6/configuration/authentication/index.html b/v24/configuration/authentication/index.html similarity index 87% rename from v6/configuration/authentication/index.html rename to v24/configuration/authentication/index.html index 0dabcb040..d5899792a 100644 --- a/v6/configuration/authentication/index.html +++ b/v24/configuration/authentication/index.html @@ -9,7 +9,7 @@ - + @@ -195,15 +195,13 @@ - -
  • - + HTCondor-CE 6
    • @@ -658,14 +656,12 @@ - - -
  • +
  • - +
  • - + Installation
    • @@ -693,14 +689,12 @@ - - -
  • +
  • - +
  • - - - - - - - - - +
  • + Authentication - - - -
    • @@ -795,7 +724,7 @@
  • - + Local Batch System
    • @@ -828,7 +757,7 @@
  • - + Overview
    • @@ -840,7 +769,7 @@
  • - + Writing Job Routes
    • @@ -852,7 +781,7 @@
  • - + For HTCondor Batch Systems
    • @@ -864,7 +793,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -882,7 +811,7 @@
  • - + Optional Configuration
    • @@ -900,7 +829,7 @@
  • - + Operation
    • @@ -933,7 +862,7 @@
  • - + Common Issues
    • @@ -945,7 +874,7 @@
  • - + Debugging Tools
    • @@ -957,7 +886,7 @@
  • - + Helpful Logs
    • @@ -996,7 +925,7 @@
  • - + Submit Jobs Remotely
    • @@ -1008,7 +937,7 @@
  • - + Remote Troubleshooting
    • @@ -1020,7 +949,7 @@
  • - + Install a Central Collector
    • @@ -1038,7 +967,7 @@
  • - + Releases
    • @@ -1050,7 +979,7 @@
  • - + Reference
    • @@ -1075,7 +1004,7 @@
    - + @@ -1194,39 +1123,6 @@

    Next Steps - -
    diff --git a/v6/configuration/htcondor-routes/index.html b/v24/configuration/htcondor-routes/index.html similarity index 78% rename from v6/configuration/htcondor-routes/index.html rename to v24/configuration/htcondor-routes/index.html index 8f6c814ca..91a1a905b 100644 --- a/v6/configuration/htcondor-routes/index.html +++ b/v24/configuration/htcondor-routes/index.html @@ -9,14 +9,14 @@ - + - For HTCondor Batch Systems - HTCondor-CE Documentation + Htcondor routes - HTCondor-CE Documentation @@ -95,7 +95,7 @@
    - For HTCondor Batch Systems + Htcondor routes
    @@ -195,15 +195,13 @@ - -
  • - + HTCondor-CE 6
    • @@ -658,14 +656,12 @@ - - -
  • +
  • - +
  • - + Installation
    • @@ -693,14 +689,12 @@ - - -
  • +
  • - +
  • - + Authentication
    • @@ -730,7 +724,7 @@
  • - + Local Batch System
    • @@ -740,14 +734,12 @@ - - -
  • +
  • - +
  • - + Overview
    • @@ -777,7 +769,7 @@
  • - + Writing Job Routes
    • @@ -787,83 +779,11 @@ - - -
  • - - - - - - - - - +
  • + For HTCondor Batch Systems - - - -
    • @@ -873,7 +793,7 @@
  • - + For Non-HTCondor Batch Systems
    • @@ -891,7 +811,7 @@
  • - + Optional Configuration
    • @@ -909,7 +829,7 @@
  • - + Operation
    • @@ -942,7 +862,7 @@
  • - + Common Issues
    • @@ -954,7 +874,7 @@
  • - + Debugging Tools
    • @@ -966,7 +886,7 @@
  • - + Helpful Logs
    • @@ -1005,7 +925,7 @@
  • - + Submit Jobs Remotely
    • @@ -1017,7 +937,7 @@
  • - + Remote Troubleshooting
    • @@ -1029,7 +949,7 @@
  • - + Install a Central Collector
    • @@ -1047,7 +967,7 @@
  • - + Releases
    • @@ -1059,7 +979,7 @@
  • - + Reference
    • @@ -1084,7 +1004,7 @@
    - + @@ -1108,83 +1028,49 @@

    Setting periodic hold or releaseIn this example, we set the routed job on hold if the job is idle and has been started at least once or if the job has tried to start more than once. This will catch jobs which are starting and stopping multiple times.

    -
    -
    JOB_ROUTER_ROUTE_Condor_Pool @=jrt
+
    ```hl_lines="5 8"
+JOB_ROUTER_ROUTE_Condor_Pool @=jrt
   UNIVERSE VANILLA
   # Puts the routed job on hold if the job's been idle and has been started at least
   # once or if the job has tried to start more than once
-  SET PeriodicHold ((NumJobStarts >= 1 && JobStatus == 1) || NumJobStarts > 1)
-  # Release routed jobs if the condor_starter couldn't start the executable and 
+  SET PeriodicHold ((NumJobStarts >= 1 && JobStatus == 1) || NumJobStarts > 1)
+  # Release routed jobs if the condor_starter couldn't start the executable and 
   # 'VMGAHP_ERR_INTERNAL' is in the HoldReason
-  SET PeriodicRelease = (HoldReasonCode == 6 && regexp("VMGAHP_ERR_INTERNAL", HoldReason))
-@jrt
+  SET PeriodicRelease = (HoldReasonCode == 6 && regexp("VMGAHP_ERR_INTERNAL", HoldReason))
+@jrt
 
 JOB_ROUTER_ROUTE_NAMES = Condor_Pool
+```
 
    
-
    -
    -
    JOB_ROUTER_ENTRIES @=jre
-[
-  TargetUniverse = 5;
-  name = "Condor_Pool";
-  # Puts the routed job on hold if the job's been idle and has been started at least
-  # once or if the job has tried to start more than once
-  set_PeriodicHold = (NumJobStarts >= 1 && JobStatus == 1) || NumJobStarts > 1;
-  # Release routed jobs if the condor_starter couldn't start the executable and
-  # 'VMGAHP_ERR_INTERNAL' is in the HoldReason
-  set_PeriodicRelease = HoldReasonCode == 6 && regexp("VMGAHP_ERR_INTERNAL", HoldReason);
-]
-@jre
 
-JOB_ROUTER_ROUTE_NAMES = Condor_Pool
-
    -
    -

    Setting routed job requirements

    -

    If you need to set requirements on your routed job, you will need to use SET REQUIREMENTS or set_Requirements -instead of Requirements for ClassAd transform and deprecated syntaxes, respectively. +

    If you need to set requirements on your routed job, you will need to use SET REQUIREMENTS +instead of Requirements. The Requirements attribute filters jobs coming into your CE into different job routes whereas the set function will set conditions on the routed job that must be met by the worker node it lands on. For more information on requirements, consult the HTCondor manual.

    To ensure that your job lands on a Linux machine in your pool:

    -
    -
    JOB_ROUTER_ROUTE_Condor_Pool @jrt
+
    ```hl_lines="3"
+JOB_ROUTER_ROUTE_Condor_Pool @jrt
   UNIVERSE VANILLA
-  SET Requirements = (TARGET.OpSys == "LINUX")
-@jrt
+  SET Requirements = (TARGET.OpSys == "LINUX")
+@jrt
 
 JOB_ROUTER_ROUTE_NAMES = Condor_Pool
+```
 
    
-
    -
    -
    JOB_ROUTER_ENTRIES @=jre
-[
-  TargetUniverse = 5;
-  name = "Condor_Pool";
-  set_Requirements =  (TARGET.OpSys == "LINUX");
-]
-@jre
 
-JOB_ROUTER_ROUTE_NAMES = Condor_Pool
-
    -
    -

    Preserving original job requirements

    To preserve and include the original job requirements, rather than just setting new requirements, you can use COPY Requirements or copy_Requirements to store the current value of Requirements to another variable, which we'll call original_requirements. To do this, replace the above SET Requirements or set_Requirements lines with:

    -
    -
    SET Requirements = ($(MY.Requirements)) && (<YOUR REQUIREMENTS EXPRESSION>)
+
    ```
+SET Requirements = ($(MY.Requirements)) && (<YOUR REQUIREMENTS EXPRESSION>)
+```
 
    
-
    -
    -
    copy_Requirements = "original_requirements";
-set_Requirements = original_requirements && ...;
-
    -
    -
    +

    Setting the accounting group based on the credential of the submitted job

    A common need in the CE is to want to set the accounting identity of the routed job using information from the credential of the submitter of the job. This originally was done using information from the x509 certificate, in particular X509UserProxyVOName @@ -1195,8 +1081,8 @@

    -
    JOB_ROUTER_CLASSAD_USER_MAP_NAMES = $(JOB_ROUTER_CLASSAD_USER_MAP_NAMES) AcctGroupMap
+
    ```
+JOB_ROUTER_CLASSAD_USER_MAP_NAMES = $(JOB_ROUTER_CLASSAD_USER_MAP_NAMES) AcctGroupMap
 CLASSAD_USER_MAPFILE_AcctGroupMap = <path-to-mapfile>
 
 JOB_ROUTER_TRANSFORM_SetAcctGroup @=end
@@ -1206,9 +1092,9 @@ 
    information on mapfiles.
    
 
    Getting Help
    
 
    If you have any questions or issues with configuring job routes, please contact us for
@@ -1233,39 +1119,6 @@ 
    Getting Help
   
-    
-  
   
    
     
    
       
    
diff --git a/v6/configuration/job-router-overview/index.html b/v24/configuration/job-router-overview/index.html
similarity index 76%
rename from v6/configuration/job-router-overview/index.html
rename to v24/configuration/job-router-overview/index.html
index c77c2d025..f4458e2dd 100644
--- a/v6/configuration/job-router-overview/index.html
+++ b/v24/configuration/job-router-overview/index.html
@@ -9,14 +9,14 @@
       
       
       
-        
+        
       
       
       
     
     
       
-        Overview - HTCondor-CE Documentation
+        Job router overview - HTCondor-CE Documentation
       
     
     
@@ -95,7 +95,7 @@
         
    
           
             
-              Overview
+              Job router overview
             
           
         
    
@@ -195,15 +195,13 @@
         
   
   
-    
-  
 
 
   
   
   
     
  • 
-      
+      
         HTCondor-CE 6
       
     
    • 
@@ -658,14 +656,12 @@
 
   
   
-    
-  
   
     
-    
  • 
+    
  • 
       
       
-        
+        
       
       
  • 
-      
+      
         Installation
       
     
    • 
@@ -693,14 +689,12 @@
             
   
   
-    
-  
   
     
-    
  • 
+    
  • 
       
       
-        
+        
       
       
  • 
-      
+      
         Authentication
       
     
    • 
@@ -730,7 +724,7 @@
   
   
     
  • 
-      
+      
         Local Batch System
       
     
    • 
@@ -740,14 +734,12 @@
             
   
   
-    
-  
   
     
-    
  • 
+    
  • 
       
       
-        
+        
       
       
  • 
-      
-      
-      
-        
-      
-      
-        
-      
-      
+    
  • 
+      
         Overview
       
-      
-        
-
-      
     
    • 
   
 
@@ -856,7 +769,7 @@
   
   
     
  • 
-      
+      
         Writing Job Routes
       
     
    • 
@@ -868,7 +781,7 @@
   
   
     
  • 
-      
+      
         For HTCondor Batch Systems
       
     
    • 
@@ -880,7 +793,7 @@
   
   
     
  • 
-      
+      
         For Non-HTCondor Batch Systems
       
     
    • 
@@ -898,7 +811,7 @@
   
   
     
  • 
-      
+      
         Optional Configuration
       
     
    • 
@@ -916,7 +829,7 @@
   
   
     
  • 
-      
+      
         Operation
       
     
    • 
@@ -949,7 +862,7 @@
   
   
     
  • 
-      
+      
         Common Issues
       
     
    • 
@@ -961,7 +874,7 @@
   
   
     
  • 
-      
+      
         Debugging Tools
       
     
    • 
@@ -973,7 +886,7 @@
   
   
     
  • 
-      
+      
         Helpful Logs
       
     
    • 
@@ -1012,7 +925,7 @@
   
   
     
  • 
-      
+      
         Submit Jobs Remotely
       
     
    • 
@@ -1024,7 +937,7 @@
   
   
     
  • 
-      
+      
         Remote Troubleshooting
       
     
    • 
@@ -1036,7 +949,7 @@
   
   
     
  • 
-      
+      
         Install a Central Collector
       
     
    • 
@@ -1054,7 +967,7 @@
   
   
     
  • 
-      
+      
         Releases
       
     
    • 
@@ -1066,7 +979,7 @@
   
   
     
  • 
-      
+      
         Reference
       
     
    • 
@@ -1091,7 +1004,7 @@
             
    
               
                 
-                  
+                  
                     
                   
                 
@@ -1114,16 +1027,13 @@ 
    Job Router Configuration Overview
 
    
 
    Route Syntaxes
    
-
    HTCondor-CE 5 introduces the ability to write job routes using ClassAd transform syntax in
-addition to the existing configuration syntax.
-The old route configuration syntax continues to be the default in HTCondor-CE 5 but there are benefits to transitioning
-to the new syntax as outlined below.
    
+
    HTCondor-CE 5 introduced the ability to write job routes using ClassAd transform syntax.
    
 
    ClassAd transforms
    
 
    The HTCondor ClassAd transforms were
 originally introduced to HTCondor to perform in-place transformations of user jobs submitted to an HTCondor pool.
 In the HTCondor 8.9 series, the Job Router was updated to support transforms and HTCondor-CE 5 adds the configuration
 necessary to support routes written as ClassAd transforms.
-If configured to use trasnform-based routes, HTCondor-CE routes and transforms jobs that by chaining ClassAd transforms
+If configured to use transform-based routes, HTCondor-CE routes and transforms jobs that by chaining ClassAd transforms
 in the following order:
    
 
      
 
    1. Each transform in JOB_ROUTER_PRE_ROUTE_TRANSFORM_NAMES whose requirements are met by the job
      2. 
@@ -1131,49 +1041,10 @@ 
      ClassAd transformsthe section on route matching below.
 
    2. Each transform in JOB_ROUTER_POST_ROUTE_TRANSFORM_NAMES whose requirements are met by the job
      3. 
 
    
-
    Deprecated syntax
    
-
    
-
    Planned Removal of Deprecated Syntax
    
-
      
-
    • JOB_ROUTER_DEFAULTS, JOB_ROUTER_ENTRIES, JOB_ROUTER_ENTRIES_CMD, and JOB_ROUTER_ENTRIES_FILE are
-deprecated and will be removed for V24 of the HTCondor Software Suite. New configuration syntax for the job router
-is defined using JOB_ROUTER_ROUTE_NAMES and JOB_ROUTER_ROUTE_[name].
      • 
-
    • For new syntax example vist:
-HTCondor Documentation - Job Router
      • 
-
    • Note: The removal will occur during the lifetime of the HTCondor V23 feature series.
      • 
-
    
-
    
-
    Since the inception of HTCondor-CE, job routes have been written as a
-list of ClassAds.
-Each job route’s ClassAd is constructed
-by combining each entry from the JOB_ROUTER_ENTRIES with the JOB_ROUTER_DEFAULTS:
    
-
      
-
    • JOB_ROUTER_ENTRIES is a configuration variable whose default is set in /etc/condor-ce/config.d/02-ce-*.conf but
-    may be overriden by the administrator in subsequent files in /etc/condor-ce/config.d/.
      • 
-
    • JOB_ROUTER_DEFAULTS is a generated configuration variable that sets default job route values that are required for
-    HTCondor-CE's functionality.
-    To view its contents in a readable format, run the following command:
      user@host $ condor_ce_config_val JOB_ROUTER_DEFAULTS | sed 's/;/;\n/g'
-
      
-
-
      • 
-
    
-
    Take care when modifying attributes in JOB_ROUTER_DEFAULTS: you may
-add new attributes and override attributes that are
-set_* in JOB_ROUTER_DEFAULTS.
    
-
    
-
    The following may break your HTCondor-CE
    
-
      
-
    • Do not set the JOB_ROUTER_DEFAULTS configuration variable yourself. This will cause the CE to stop
-    functioning.
      • 
-
    • If a value is set in JOB_ROUTER_DEFAULTS with eval_set_<variable>, override it by using
-    eval_set_<variable> in the JOB_ROUTER_ENTRIES.
-    Do this at your own risk as it may cause the CE to break.
      • 
-
    
-
    
-
    Choosing a syntax
    
-
    For existing HTCondor-CEs, it's recommended that administrators continue to use the deprecated syntax (the default) and
-transition to ClassAd transforms at their own pace.
    
-
    For new HTCondor-CEs, it's recommended that administrators start with ClassAd transforms.
+
    Required syntax
    
+
    For existing HTCondor-CEs, it's required that administrators stop using the deprecated syntax and
+transition to ClassAd transforms now.
    
+
    For new HTCondor-CEs, it's required that administrators start with ClassAd transforms.
 The ClassAd transform syntax provides many benefits including: