-
Notifications
You must be signed in to change notification settings - Fork 12
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: Setup packaging and Github Codespaces dev environment (#26)
* Update README.md Add SSEC badge * Move project to src/ directory * Update Codespaces link * Update README.md * Update README.md Update Codespaces link * Update devcontainer * ci: Create cd.yml for building and pushing package * Update caustic name to caustics * Add PyLint and Black formatting features to devcon * Closes issue uw-ssec#16 * Updated test/ -> tests/ * Move project to src/ directory * Update README.md * Update README.md Update Codespaces link * Create noxfile.py * Add .readthedocs.yaml * Create .git_archival.txt * Create .gitattributes * Create .pre-commit-config.yaml * Add sphinx and myst-parser support * style: pre-commit fixes * Update docs * style: pre-commit fixes * Update .github Actions * Update environment.yml - Add jupyter-book * Create CONTRIBUTING.md * Update README.md * chore: resolve conflicts * chore: Remove sources * test: remove test lenses * test: fix test_simulator * chore: Set min python to 3.9 * fix: change pytest to point to tests/ * build: update dep list to use reqs.txt * ci: Don't fail fast * chore(deps): Pin astropy < 6 * fix: change instances of caustic to caustics * fix: Perform pre-commit * fix: update path to conf.py * update README * style: pre-commit fixes * docs: Add contributor graph * chore: Setup dynamic versioning * ci: Update fetch depth to 0 to get correct version * Update README.md Update Codespaces button to new repo name --------- Co-authored-by: Cordero Core <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
- Loading branch information
1 parent
d122818
commit ac023ce
Showing
94 changed files
with
2,702 additions
and
943 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
git | ||
ncdu | ||
wget | ||
curl |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,21 @@ | ||
// For format details, see https://aka.ms/devcontainer.json. For config options, see the | ||
{ | ||
"image": "quay.io/pangeo/pytorch-notebook:latest", | ||
|
||
"customizations": { | ||
"vscode": { | ||
"extensions": [ | ||
"ms-toolsai.jupyter", | ||
"ms-python.python", | ||
"ms-vsliveshare.vsliveshare", | ||
"DavidAnson.vscode-markdownlint", | ||
"GitHub.copilot" | ||
] | ||
} | ||
}, | ||
"postCreateCommand": "sh .devcontainer/postBuild.sh", | ||
"features": { | ||
"ghcr.io/devcontainers-contrib/features/black:2": {}, | ||
"ghcr.io/devcontainers-contrib/features/pylint:2": {} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
channels: | ||
- conda-forge | ||
dependencies: | ||
- python>=3.10 | ||
- astropy | ||
- jupyterlab | ||
- matplotlib | ||
- numpy | ||
- pandas | ||
- scipy | ||
- h5py | ||
- sphinx | ||
- myst-parser | ||
- jupyter-book | ||
- pip |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
# For writing commands that will be executed after the container is created | ||
|
||
# Installs `caustic` as local library without resolving dependencies (--no-deps) | ||
python3 -m pip install -e /workspaces/caustics --no-deps |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,12 @@ | ||
#!/bin/bash -l | ||
|
||
# ==== ONLY EDIT WITHIN THIS BLOCK ===== | ||
|
||
export CAUSTICS_ENV="caustics" | ||
if ! [[ -z "${CAUSTICS_SCRATCH_PREFIX}" ]] && ! [[ -z "${JUPYTERHUB_USER}" ]]; then | ||
export CAUSTICS_SCRATCH="${CAUSTICS_SCRATCH_PREFIX}/${JUPYTERHUB_USER}/" | ||
fi | ||
|
||
# ==== ONLY EDIT WITHIN THIS BLOCK ===== | ||
|
||
exec "$@" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
node: $Format:%H$ | ||
node-date: $Format:%cI$ | ||
describe-name: $Format:%(describe:tags=true,match=*[0-9]*)$ | ||
ref-names: $Format:%D$ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
.git_archival.txt export-subst |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,101 @@ | ||
See the [Scientific Python Developer Guide][spc-dev-intro] for a detailed | ||
description of best practices for developing scientific packages. | ||
|
||
[spc-dev-intro]: https://scientific-python-cookie.readthedocs.io/guide/intro | ||
|
||
# Quick development | ||
|
||
The fastest way to start with development is to use nox. If you don't have nox, | ||
you can use `pipx run nox` to run it without installing, or `pipx install nox`. | ||
If you don't have pipx (pip for applications), then you can install with with | ||
`pip install pipx` (the only case were installing an application with regular | ||
pip is reasonable). If you use macOS, then pipx and nox are both in brew, use | ||
`brew install pipx nox`. | ||
|
||
To use, run `nox`. This will lint and test using every installed version of | ||
Python on your system, skipping ones that are not installed. You can also run | ||
specific jobs: | ||
|
||
```console | ||
$ nox -s lint # Lint only | ||
$ nox -s tests # Python tests | ||
$ nox -s docs -- serve # Build and serve the docs | ||
$ nox -s build # Make an SDist and wheel | ||
``` | ||
|
||
Nox handles everything for you, including setting up an temporary virtual | ||
environment for each run. | ||
|
||
# Setting up a development environment manually | ||
|
||
You can set up a development environment by running: | ||
|
||
```bash | ||
python3 -m venv .venv | ||
source ./.venv/bin/activate | ||
pip install -v -e .[dev] | ||
``` | ||
|
||
If you have the | ||
[Python Launcher for Unix](https://github.com/brettcannon/python-launcher), you | ||
can instead do: | ||
|
||
```bash | ||
py -m venv .venv | ||
py -m install -v -e .[dev] | ||
``` | ||
|
||
# Post setup | ||
|
||
You should prepare pre-commit, which will help you by checking that commits pass | ||
required checks: | ||
|
||
```bash | ||
pip install pre-commit # or brew install pre-commit on macOS | ||
pre-commit install # Will install a pre-commit hook into the git repo | ||
``` | ||
|
||
You can also/alternatively run `pre-commit run` (changes only) or | ||
`pre-commit run --all-files` to check even without installing the hook. | ||
|
||
# Testing | ||
|
||
Use pytest to run the unit checks: | ||
|
||
```bash | ||
pytest | ||
``` | ||
|
||
# Coverage | ||
|
||
Use pytest-cov to generate coverage reports: | ||
|
||
```bash | ||
pytest --cov=caustics | ||
``` | ||
|
||
# Building docs | ||
|
||
You can build the docs using: | ||
|
||
```bash | ||
nox -s docs | ||
``` | ||
|
||
You can see a preview with: | ||
|
||
```bash | ||
nox -s docs -- serve | ||
``` | ||
|
||
# Pre-commit | ||
|
||
This project uses pre-commit for all style checking. While you can run it with | ||
nox, this is such an important tool that it deserves to be installed on its own. | ||
Install pre-commit and run: | ||
|
||
```bash | ||
pre-commit run -a | ||
``` | ||
|
||
to check all files. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
version: 2 | ||
updates: | ||
# Maintain dependencies for GitHub Actions | ||
- package-ecosystem: "github-actions" | ||
directory: "/" | ||
schedule: | ||
interval: "weekly" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,32 @@ | ||
{ | ||
"problemMatcher": [ | ||
{ | ||
"severity": "warning", | ||
"pattern": [ | ||
{ | ||
"regexp": "^([^:]+):(\\d+):(\\d+): ([A-DF-Z]\\d+): \\033\\[[\\d;]+m([^\\033]+).*$", | ||
"file": 1, | ||
"line": 2, | ||
"column": 3, | ||
"code": 4, | ||
"message": 5 | ||
} | ||
], | ||
"owner": "pylint-warning" | ||
}, | ||
{ | ||
"severity": "error", | ||
"pattern": [ | ||
{ | ||
"regexp": "^([^:]+):(\\d+):(\\d+): (E\\d+): \\033\\[[\\d;]+m([^\\033]+).*$", | ||
"file": 1, | ||
"line": 2, | ||
"column": 3, | ||
"code": 4, | ||
"message": 5 | ||
} | ||
], | ||
"owner": "pylint-error" | ||
} | ||
] | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,99 @@ | ||
name: CD | ||
|
||
on: | ||
workflow_dispatch: | ||
push: | ||
branches: | ||
- main | ||
- dev | ||
release: | ||
types: | ||
- published | ||
|
||
concurrency: | ||
group: ${{ github.workflow }}-${{ github.ref }} | ||
cancel-in-progress: true | ||
|
||
env: | ||
FORCE_COLOR: 3 | ||
|
||
jobs: | ||
dist: | ||
name: Distribution build | ||
runs-on: ubuntu-latest | ||
|
||
steps: | ||
- uses: actions/checkout@v4 | ||
with: | ||
fetch-depth: 0 | ||
|
||
- name: Build sdist and wheel | ||
run: pipx run build | ||
|
||
- uses: actions/upload-artifact@v3 | ||
with: | ||
path: dist | ||
|
||
- name: Check products | ||
run: pipx run twine check dist/* | ||
|
||
test-built-dist: | ||
needs: [dist] | ||
name: Test built distribution | ||
runs-on: ubuntu-latest | ||
permissions: | ||
id-token: write | ||
steps: | ||
- uses: actions/[email protected] | ||
name: Install Python | ||
with: | ||
python-version: "3.10" | ||
- uses: actions/download-artifact@v3 | ||
with: | ||
name: artifact | ||
path: dist | ||
- name: List contents of built dist | ||
run: | | ||
ls -ltrh | ||
ls -ltrh dist | ||
- name: Publish to Test PyPI | ||
uses: pypa/[email protected] | ||
with: | ||
repository-url: https://test.pypi.org/legacy/ | ||
verbose: true | ||
skip-existing: true | ||
- name: Check pypi packages | ||
run: | | ||
sleep 3 | ||
python -m pip install --upgrade pip | ||
echo "=== Testing wheel file ===" | ||
# Install wheel to get dependencies and check import | ||
python -m pip install --extra-index-url https://test.pypi.org/simple --upgrade --pre caustic | ||
python -c "import caustic; print(caustics.__version__)" | ||
echo "=== Done testing wheel file ===" | ||
echo "=== Testing source tar file ===" | ||
# Install tar gz and check import | ||
python -m pip uninstall --yes caustic | ||
python -m pip install --extra-index-url https://test.pypi.org/simple --upgrade --pre --no-binary=:all: caustic | ||
python -c "import caustic; print(caustics.__version__)" | ||
echo "=== Done testing source tar file ===" | ||
publish: | ||
needs: [dist, test-built-dist] | ||
name: Publish to PyPI | ||
environment: pypi | ||
permissions: | ||
id-token: write | ||
runs-on: ubuntu-latest | ||
if: github.event_name == 'release' && github.event.action == 'published' | ||
|
||
steps: | ||
- uses: actions/download-artifact@v3 | ||
with: | ||
name: artifact | ||
path: dist | ||
|
||
- uses: pypa/[email protected] | ||
if: startsWith(github.ref, 'refs/tags') |
Oops, something went wrong.