Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regularly update monthly data files on s3 #49

Open
jsignell opened this issue Jun 4, 2024 · 1 comment
Open

Regularly update monthly data files on s3 #49

jsignell opened this issue Jun 4, 2024 · 1 comment
Labels
next-release Target for next release

Comments

@jsignell
Copy link
Collaborator

jsignell commented Jun 4, 2024

The NRT files are regularly updated as part of the scheduled DPS jobs. It would be great to do the same for the monthly files. According to @eorland this is the current manual process:

The monthly data comes from a sftp site hosted by the university of Maryland. All information for access is available in this guide on page 16: https://lpdaac.usgs.gov/documents/427/VNP14_User_Guide_V1.pdf.

Users can download the VNP14IMGML and VNP14ML data sets by connecting to an ftp
server at the University of Maryland using:
server: fuoco.geog.umd.edu
login: fire
password: burnt
directory (VNP14IMGML): /VIIRS/VNP14IMGML
directory (VNP14ML): /VIIRS/VNP14ML

It would be interesting to try to use the fsspec sftp file system to manage this download process.

@mccabete
Copy link
Contributor

mccabete commented Jul 16, 2024

@scoffiel thought through some of the issues with this. (see here)

Seems like the"ML" files use a .txt files that are generated by a group at UMD on a sporratic basis (and only for SNPP). They are also sporatically generated by FIRMS. They are systematically generated for the NRT files.

@scoffiel suggested that the .txt would be easy fro us to generate ourselves. This MAAP discussion: https://github.com/orgs/MAAP-Project/discussions/1031

is a request for access that would facilitate generating those files.

@zebbecker zebbecker added the next-release Target for next release label Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
next-release Target for next release
Projects
None yet
Development

No branches or pull requests

3 participants