plasma-tv

Work on plasma tv image data

This repo is set up to work with both the raw data and any synthetic data. It was a bit unorganized so I reorganized it, but this might cause some directory issues.

Directories of interest:

1. notebooks (intended workflows)
2. notebooks_temp (depracated, will be removed)
3. cam_geo (used for generating synthetic data using camera geometry)
4. eq_field (intended to get x-value and strike point value from magnetic field)

Creating a Virtual Environment

python -m venv myenv
source myenv/bin/activate
pip install -r requirements.txt
pip install -e .

This way, you can go into src and modify the code, and you don't have to reinstall. And also then you can directly import like from src.idk import chicken as ch

Copying Videos From Aza

scp -r -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected]:/cscratch/jalalvanda/tangtv/200910.txt /scratch/gpfs/nc1514/plasma-tv/data/raw/tv_images/aza_9_18

ssh -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected] 'ls /cscratch/jalalvanda/tangtv/tangtv_*.pkl | grep -E "tangtv_([0-9]{6,}).pkl" | awk -F"[_|.]" '''$2 >= 200950''

scp -r -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected] $(ssh -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected] 'ls /cscratch/jalalvanda/tangtv/tangtv_*.pkl | grep -E "tangtv_([0-9]{6,}).pkl" | awk -F"[_|.]" '''$2 >= 200950'') .

scp -r -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected]:/cscratch/chenn/detach_aza.h5 /scratch/gpfs/nc1514/plasma-tv/data/external/toksearch

rsync -a --ignore-existing -P -e 'ssh -o "ProxyCommand ssh -p 2039 [email protected] -W %h:%p"' [email protected]:/cscratch/jalalvanda/tangtv/tangtv_*.mp4 /scratch/gpfs/nc1514/plasma-tv/outputs/video/azavids

scp -r -o 'ProxyCommand ssh -p 2039 [email protected] -W %h:%p' [email protected]:/cscratch/chenn/aps_sig.h5 /scratch/gpfs/nc1514/plasma-tv/data/external/toksearch