Merge Split Branch

preview-update-submodules/downloads/htcondor.html

@@ -837,16 +837,13 @@ <h1>Download <span class="text-secondary">HTCondor</span></h1>
 
 <div id="feature-channel" class="mb-4 card">
     <div class="card-body">
-        <h3><span class="text-secondary">10.7.0</span> Feature Release</h3>
-        <p>July 31, 2023</p>
+        <h3><span class="text-secondary">10.9.0</span> Feature Release</h3>
+        <p>September 28, 2023</p>
         <div>
             <ul>
-  <li>Support for Debian 12 (Bookworm)</li>
-  <li>Can run defrag daemons with different policies on distinct sets of nodes</li>
-  <li>Added want_io_proxy submit command</li>
-  <li>Apptainer is now included in the HTCondor tarballs</li>
-  <li>Fix 10.5.0 bug where reported CPU time is very low when using cgroups v1</li>
-  <li>Fix 10.5.0 bug where .job.ad and .machine.ad were missing for local jobs</li>
+  <li>The condor_upgrade_check script now provides guidance on updating to 23.0</li>
+  <li>The htchirp Python binding now properly locates the chirp configuration</li>
+  <li>Fix bug that prevented deletion of HTCondor passwords on Windows</li>
 </ul>
 
         </div>
@@ -867,16 +864,24 @@ <h3><span class="text-secondary">10.7.0</span> Feature Release</h3>
 </div>
 <div id="long-term-support-channel" class="mb-4 card">
     <div class="card-body">
-        <h3><span class="text-secondary">10.0.7</span> Long Term Support Release</h3>
-        <p>July 25, 2023</p>
+        <h3><span class="text-secondary">23.0.0</span> Long Term Support Release</h3>
+        <p>September 30, 2023</p>
         <div>
             <ul>
-  <li>Fixed bug where held condor cron jobs would never run when released</li>
-  <li>Improved daemon IDTOKENS logging to make useful messages more prominent</li>
-  <li>Remove limit on certificate chain length in SSL authentication</li>
-  <li>condor_config_val -summary now works with a remote configuration query</li>
-  <li>Prints detailed message when condor_remote_cluster fails to fetch a URL</li>
-  <li>Improvements to condor_preen</li>
+  <li>Absent slot configuration, execution points will use a partitionable slot</li>
+  <li>Linux cgroups enforce maximum memory utilization by default</li>
+  <li>Can now define DAGMan save points to be able to rerun DAGs from there</li>
+  <li>Much better control over environment variables when using DAGMan</li>
+  <li>Administrators can enable and disable job submission for a specific user</li>
+  <li>Can set a minimum number of CPUs allocated to a user</li>
+  <li>condor_status -gpus shows nodes with GPUs and the GPU properties</li>
+  <li>condor_status -compact shows a row for each slot type</li>
+  <li>Container images may now be transferred via a file transfer plugin</li>
+  <li>Support for Enterprise Linux 9, Amazon Linux 2023, and Debian 12</li>
+  <li>Can write job information in AP history file for every execution attempt</li>
+  <li>Can run defrag daemons with different policies on distinct sets of nodes</li>
+  <li>Add condor_test_token tool to generate a short lived SciToken for testing</li>
+  <li>The job’s executable is no longer renamed to ‘condor_exec.exe’</li>
 </ul>
 
         </div>

preview-update-submodules/featured-users/2022-05-02-CLAS12.html

@@ -822,7 +822,7 @@ <h2 id="the-foundations-of-a-partnership">The foundations of a partnership</h2>
 <p>This resurgence on the organizational level all stems from the actions of individual people. Before Jefferson Lab rejoined the OSG Consortium, 
 <a href="https://physics.uconn.edu/person/richard-jones/#">Richard Jones</a>, a principal investigator (PI) at the University of Connecticut who is involved in the GlueX experiment, began exploring OSG’s services. 
 Jones not only introduced the benefits of OSG to GlueX, but also to Jefferson Lab more broadly. After OSG’s workflow and infrastructure proved to be 
-scalable for GlueX, members of the CLAS Collaboration became interested in OSG’s fabric of services too. <a href="https://www-physics.ucsd.edu/fac_staff/fac_profile/faculty_description.php?person_id=494">Frank Würthwein</a>, OSG Executive Director, 
+scalable for GlueX, members of the CLAS Collaboration became interested in OSG’s fabric of services too. Frank Würthwein, OSG Executive Director, 
 interprets this process as a “flow of engagement that followed the social structures that the relevant parties were embedded in. Basically, it’s a campus 
 word-of-mouth.”</p>
 
@@ -844,7 +844,7 @@ <h2 id="expanding-computing-resources">Expanding computing resources</h2>
 blasting into the target material in the new experiment carry twice the energy –– 12 billion electron volts to be exact. This new experiment, coined 
 ‘CLAS12’ to signify this energy increase, also engendered a tenfold increase in computing demand. While Jefferson Lab’s in-house computing resources are 
 extensive, the sheer amount of data produced in the CLAS12 experiment is substantial. Today, the experiment generates about 1 petabyte of data each year. 
-To put this number into perspective, 1 petabyte <a href="http://www.infographicsshowcase.com/wp-content/uploads/2010/11/whatsapetabyte.gif">is equivalent to</a> 
+To put this number into perspective, 1 petabyte is equivalent to 
 twenty million four-drawer filing cabinets completely filled with text, or 13.3 years of HD-TV video. That’s <em>a lot</em> of data to manage.</p>
 
 <figure class="figure float-end" style="margin-left: 1em; width: 350px;">

preview-update-submodules/featured-users/2022-07-06-Gillett.html

@@ -799,7 +799,7 @@ <h1>UW Statistics Course using HTC</h1>
 
 <p>This class was created as an undergraduate counterpart to the graduate-level course, Statistics 605, which Gillett has taught since the Spring of 2017. The course includes learning basic distributed computing to analyze data sets too large for a laptop.</p>
 
-<p>Gillett reached out to research computing facilitator <a href="https://wid.wisc.edu/people/lauren-michael/">Lauren Michael</a> in 2016. He hoped to learn how he could teach his students easy parallel computing. He settled on HTC, as it was easiest for helping students do large computations. “This was an easy path for me,” the teacher remarked, “and everyone at the CHTC made it easy.”</p>
+<p>Gillett reached out to research computing facilitator Lauren Michael in 2016. He hoped to learn how he could teach his students easy parallel computing. He settled on HTC, as it was easiest for helping students do large computations. “This was an easy path for me,” the teacher remarked, “and everyone at the CHTC made it easy.”</p>
 
 <figure class="figure float-end" style="margin-left: 1em; width: 230px;">
   <img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/christina-koch-square.jpg" class="figure-img img-fluid rounded" alt="Christina Koch" width="250px" />
@@ -808,7 +808,7 @@ <h1>UW Statistics Course using HTC</h1>
 
 <p>Research Facilitator <a href="https://wid.wisc.edu/people/christina-koch/">Christina Koch</a> guest lectured in 2017 when the graduate class was first offered, and every semester since. She talks to the students about the CHTC and high throughput computing and has them run a few jobs. Koch notes that this partnership between the CHTC and Gillett’s class has been “a win-win; we get to share about our system and how people run things, and he gets to have this interesting, hands-on assignment for his class.”</p>
 
-<p>Gillett created an assignment that involves using HTC on a real data set with the help of <a href="http://www.astro.wisc.edu/our-people/faculty/tremonti">Christy Tremonti</a>, a UW-Madison Astronomy professor. Tremonti had a research problem that required searching through many astronomical spectra (of photos of galaxies) for a particular type corresponding to a gravitationally lensed Lyman-break galaxy. “In the beginning, she gave a lot of good, critical feedback for the research element of this,” Gillett explained. She guided the students through large-scale computations during the first few semesters. As he reflects on this partnership, Gillett beams, “this was exciting too – we were doing unknown statistics on a real research problem. We didn’t know what the right answer was!”</p>
+<p>Gillett created an assignment that involves using HTC on a real data set with the help of Christy Tremonti, a UW-Madison Astronomy professor. Tremonti had a research problem that required searching through many astronomical spectra (of photos of galaxies) for a particular type corresponding to a gravitationally lensed Lyman-break galaxy. “In the beginning, she gave a lot of good, critical feedback for the research element of this,” Gillett explained. She guided the students through large-scale computations during the first few semesters. As he reflects on this partnership, Gillett beams, “this was exciting too – we were doing unknown statistics on a real research problem. We didn’t know what the right answer was!”</p>
 
 <p>Gillett remarked that his students enjoy working with the CHTC; “[the students] now understand how to work a parallel computing environment,” he noted. “They get excited about the power they now have to extract solutions from big piles of data.” This course offers students simple, powerful tools to do just that.</p>
 

preview-update-submodules/featured-users/2022-07-21-Messick.html

@@ -790,7 +790,7 @@ <h1>LIGO's Search for Gravitational Waves Signals Using HTCondor</h1>
   <figcaption class="figure-caption">Image of two black holes. Photo credit: Cody Messick’s presentation slides.<br /></figcaption>
 </figure>
 
-<p>High-throughput computing (HTC) is critical to astronomy, from black hole research to radial astronomy and beyond. At the <a href="https://agenda.hep.wisc.edu/event/1733/timetable/?view=standard">2022 HTCondor Week</a>, another area of astronomy was put in the spotlight by <a href="https://space.mit.edu/people/messick-cody/">Cody Messick</a>, a researcher working for the <a href="https://space.mit.edu/instrumentation/ligo/">LIGO</a> lab and a Postdoc at the Massachusetts Institute of Technology (MIT). His work focuses on a gravitational-wave analysis that he’s been running with the help of HTCondor to search for new gravitational wave signals.</p>
+<p>High-throughput computing (HTC) is critical to astronomy, from black hole research to radial astronomy and beyond. At the <a href="https://agenda.hep.wisc.edu/event/1733/timetable/?view=standard">2022 HTCondor Week</a>, another area of astronomy was put in the spotlight by Cody Messick, a researcher working for the <a href="https://space.mit.edu/instrumentation/ligo/">LIGO</a> lab and a Postdoc at the Massachusetts Institute of Technology (MIT). His work focuses on a gravitational-wave analysis that he’s been running with the help of HTCondor to search for new gravitational wave signals.</p>
 
 <p>Starting with general relativity and why it’s crucial to his work, Messick explains that “it tells us two things; first, space and time are not separate entities but are instead part of a four-dimensional object called space-time. Second, space-time is warped by mass and energy, and it’s these changes to the geometry of space-time that we experience as gravity.”</p>
 

preview-update-submodules/featured-users/2022-12-19-Lightning-Talks.html

@@ -912,7 +912,7 @@ <h1>OSG User School 2022 Researchers Present Inspirational Lightning Talks</h1>
 
 <p>Luo built a single forest productivity model using three sets of remote sensing data to predict this productivity, coupling it with a global change analysis model to project possible futures.</p>
 
-<p>Using her computer would take her two years to finish this work. During the User School, Luo learned she could use <a href="https://portal.osg-htc.org/documentation/htc_workloads/using_software/containers-singularity/">Apptainer</a> to run her model and multiple events simultaneously. She also learned to use the <a href="https://htcondor.readthedocs.io/en/latest/users-manual/dagman-workflows.html">DAGMan workflow</a> to organize the process better. With all this knowledge, she ran a scenario, which used to take a week to complete but only took a couple of hours with the help of <a href="https://osg-htc.org/services/open_science_pool.html">OSPool</a> capacity.</p>
+<p>Using her computer would take her two years to finish this work. During the User School, Luo learned she could use <a href="https://portal.osg-htc.org/documentation/htc_workloads/using_software/containers-singularity/">Apptainer</a> to run her model and multiple events simultaneously. She also learned to use the DAGMan workflow to organize the process better. With all this knowledge, she ran a scenario, which used to take a week to complete but only took a couple of hours with the help of <a href="https://osg-htc.org/services/open_science_pool.html">OSPool</a> capacity.</p>
 
 <p>Tinghua Chen from Wichita State University presented a talk on “<em>Applying HTC to Higgs Boson Production Simulations.</em>” Ten years ago, the <a href="https://atlas.cern/">ATLAS</a> and <a href="https://cms.cern/">CMS</a> experiments at <a href="https://home.web.cern.ch/">CERN</a> announced the discovery of the Higgs boson. CERN is a research center that operates the world’s largest particle physics laboratory. The ATLAS and CMS experiments are general-purpose detectors at the Large Hadron Collider (LHC) that both study the Higgs boson.</p>
 

preview-update-submodules/featured-users/2023-04-24-ASP.html

@@ -797,7 +797,7 @@ <h1>Distributed Computing at the African School of Physics 2022 Workshop</h1>
 
 <p>Almost 200 students from 41 countries were selected to participate in the <a href="https://www.africanschoolofphysics.org/asp2022/">7th ASP 2022</a> at <a href="https://science.mandela.ac.za/ASP-2022">Nelson Mandela University in Gqeberha, South Africa</a>. With the school being shortened to two weeks, a parallel learning system was implemented, where participants could choose lectures to attend to improve their educational growth. <a href="https://www.nhn.ou.edu/~hs/">Dr. Horst Severini</a> is a Research Scientist and Adjunct Professor in <a href="http://www-hep.nhn.ou.edu/">High Energy Physics</a> and <a href="http://it.ou.edu/">Information Technology</a> from the University of Oklahoma (OU) and a co-leader of the high-performance computing workshop. He anticipated maybe 25 students attending on his track, “…we had about that many laptops,” he remarked, “and then we ended up with over 50 students!”</p>
 
-<p>Severini was first introduced to distributed computing during his postdoc at OU. Then in the spring of 2012, Severini was introduced to <a href="https://www.aasciences.africa/fellow/ketevi-assamagan">Kétévi Assamagan</a>, one of the founders of the ASP. Assamagan met with Severini and invited him and his colleagues to participate, leading to a  scramble to create a curriculum for this new lecture series. They were eager to show students how distributed computing could help with their work.</p>
+<p>Severini was first introduced to distributed computing during his postdoc at OU. Then in the spring of 2012, Severini was introduced to Kétévi Assamagan, one of the founders of the ASP. Assamagan met with Severini and invited him and his colleagues to participate, leading to a  scramble to create a curriculum for this new lecture series. They were eager to show students how distributed computing could help with their work.</p>
 
 <p>After a few years of fine-tuning the high throughput classes, Severini has the workshop ironed out. After receiving an introduction to basic commands in Linux, the students started with a basic overview of high-energy physics, why computing is important to high-energy physics, and then some <a href="https://htcondor.com/">HTCondor basics</a>. “The goal, really, is to teach students the basics of HTCondor, and then let them go off and see what they can do with it,” Severini explained. The workshop was so successful that students worked through coffee breaks and even stuck around at the end to obtain <a href="https://portal.osg-htc.org/application">OSG accounts</a> to continue their work.</p>