Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rachellombardi website redesign #688

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
4b12938
renamed; removed xfer sections
rachellombardi Jan 4, 2024
5e6b3de
Fixed internal page links
rachellombardi Jan 4, 2024
6de4ada
Create transfer-files-computer.md
rachellombardi Jan 4, 2024
d19b58f
Create htcondor-job-submission.md
rachellombardi Jan 4, 2024
5dd5052
Started edits - not complete
rachellombardi Jan 4, 2024
e07d097
Finished full draft of combining multiple jobs + diff directories guides
rachellombardi Jan 5, 2024
728b2ce
Fixed formatting error
rachellombardi Jan 5, 2024
ff5d711
Created htc-modules.md, needs TOC updating
rachellombardi Jan 5, 2024
8d50ae4
Merge branch 'CHTC:master' into rachellombardi-website-redesign
rachellombardi Jan 8, 2024
b95d715
added vpn info from HTC Policies Page
rachellombardi Jan 8, 2024
2f061eb
Rename to noShow-use-submit-node.md
rachellombardi Jan 8, 2024
303fd92
Rename check-quota.md to htc-check-quota.md
rachellombardi Jan 8, 2024
fdf2159
Initial creation of htc overview guide
rachellombardi Jan 8, 2024
b234efd
Add internal links
rachellombardi Jan 8, 2024
5457cc2
Correct formatting
rachellombardi Jan 8, 2024
ff11d27
Create osdf-fileXfer-draft.md
rachellombardi Jan 9, 2024
d2e6af0
Create who-we-are.md draft
rachellombardi Jan 9, 2024
d724893
Merge branch 'CHTC:master' into rachellombardi-website-redesign
rachellombardi Jan 24, 2024
3b7b788
moving quota guide back, will change later
ChristinaLK Feb 28, 2024
24b2166
Update _uw-research-computing/who-we-are.md
rachellombardi Feb 28, 2024
95705ac
Update _uw-research-computing/who-we-are.md
rachellombardi Feb 28, 2024
882e833
Update _uw-research-computing/htc-overview.md
rachellombardi Feb 28, 2024
4d605d9
Update _uw-research-computing/htc-overview.md
rachellombardi Feb 28, 2024
cb20bbf
Update _uw-research-computing/htc-overview.md
rachellombardi Feb 28, 2024
850662e
Update _uw-research-computing/htcondor-job-submission.md
rachellombardi Feb 28, 2024
4d5dd24
Update _uw-research-computing/htc-overview.md
rachellombardi Feb 28, 2024
24e0fe3
Update _uw-research-computing/htc-overview.md
rachellombardi Feb 28, 2024
c55f341
Merge branch 'master' into local-web-redesign
ChristinaLK Mar 1, 2024
ffff761
Merge branch 'rachellombardi-website-redesign' of github.com:rachello…
ChristinaLK Mar 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
139 changes: 6 additions & 133 deletions _uw-research-computing/connecting.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
highlighter: none
layout: guide
title: Connecting to CHTC Using CHTC's HTC Submit Nodes
title: Log In to CHTC Resources
alt_title: Connecting to CHTC
guide:
order: 2
Expand All @@ -22,12 +22,7 @@ throughput or high performance compute systems. If you haven\'t, see our
- [On the command line](#login-ssh)
- [Using an SSH program (Windows/Mac)](#login-putty)
- [Re-using SSH connections](#c-re-using-ssh-connections)
3. [Transferring Files](#transfer)
- [On the command line](#transfer-scp)
- [Using a file transfer program (Windows/Mac)](#transfer-winscp)
- [Transferring Multiple Files](#transfer-winscp)
4. [Creating and Editing Files](#files)
5. [Learning about the command line](#learn)
3. [Learning about the command line](#learn)
{% endcapture %}
{% include /components/directory.html title="Table of Contents" %}

Expand Down Expand Up @@ -65,14 +60,13 @@ access CHTC resources.
> log-ins from off-campus. If you are off-campus and want to log in, you
> can either:
>
> - Activate the campus VPN (more details on how to set this up
> [here](https://it.wisc.edu/services/wiscvpn/)).
> - Log into another computer that is on campus.
> - Activate the campus Virtual Private Network (VPN) (more details on how to set this up
> [DoIT's VPN webpage](https://it.wisc.edu/services/wiscvpn/)). This will allow you join the campus network when working off-campus.
> - Log into another computer that is on campus (typically by SSH-ing into that computer) and then SSH to our submit server.
>
> In either case, it will appear like you are on-campus, and you should
> then be able to log into CHTC as usual.


<span name="login"></span>

**2. Logging In**
Expand Down Expand Up @@ -143,130 +137,9 @@ a connection for logging in again or moving files. More details are shown
in this guide: [Automating CHTC Log In](/uw-research-computing/configure-ssh.html)


<span name="transfer"></span>

**3. Transferring Files**
=====================

To transfer files to and from CHTC, you will need the same username and
hostname information for [logging in](#login), as well as understanding
where your files are and where you would like them to go.


<span name="transfer-scp"></span>

A. On the command line
----------------------------------

On Mac, Linux, or modern Windows (10+) systems, you can use the \"Terminal\" application and
the `scp` command to copy files between your computer and CHTC servers.

**Your computer to CHTC**

First, open the \"Terminal\" application and navigate to the directory
with the files or directories you want to transfer. Then, use this
command to copy these files to CHTC:

```
$ scp file username@hostname:/home/username
```
{:.term}

If you would like these files to end up in a different directory inside
your home directory, just add it to the path at the end of the command.

**CHTC to your computer**

Open the \"Terminal\" application. Do NOT log into CHTC. Instead,
navigate to where you want the files to go on your computer. Then, use
this command to copy these files there:

```
$ scp username@hostname:/home/username/file ./
```
{:.term}

Again, for many files, it will be easiest to create a compressed tarball
(.tar.gz file) of your files and transfer that instead of each file
individually.


<span name="transfer-winscp"></span>

B. Using a file transfer program (Windows/Mac)
----------------------------------------------

Windows and Mac users can also use special programs to help them
transfer files between their computers and CHTC. For Windows, we
recommend [WinSCP](https://winscp.net/eng/download.php). It requires the
same information as Putty (hostname, username), and once it\'s set up,
looks like this:

![](/images/WinSCPPortable.png)

The left window is a directory on your computer, the right window is
your home directory in CHTC. To move files between the two, simply drag
and drop.

There are other programs besides WinSCP that do this. Another that works
on Mac and Windows is called [Cyberduck](https://cyberduck.io).

<span name="transfer-many"></span>

C. Transferring Multiple Files
------------------------------

If you are transferring many files, it is advantageous to compress them
into a single compressed file, in order to facilitate transferring them.
Place all the files you need in a directory, and then either zip it or
use the \"tar\" command to compress them:

```
$ tar czf data_files.tar.gz file_directory/
```
{:.term}

To untar or unzip files on the submit server or head nodes, you can use
either:

```
[alice@submit]$ tar xzf data_files.tar.gz
```
{:.term}

or

```
[alice@submit]$ unzip data_files.zip
```
{:.term}

<span name="files"></span>

**4. Creating and Editing Files in CHTC**
=====================================

Once you have logged in to a CHTC server, you can edit files from the
command line, by using a command line file editor. Some common editing
programs are:

- nano
- vi
- emacs

`nano` is the most beginner-friendly, and `emacs` is the most advanced.
[This Software Carpentry
lesson](https://swcarpentry.github.io/shell-novice/03-create.html) describes
how to use `nano`, and there are many other resources online with
instructions for these text editors.

Some of the file transfer programs mentioned [above](#transfer-winscp)
allow you to edit files on CHTC servers through the interface.


<span name="learn"></span>

**5. Learning About the Command Line**
**3. Learning About the Command Line**
==================================

**Why learn about the command line?** If you haven\'t used the command
Expand Down
Loading
Loading