Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dask Demo Day - Sign up issue #307

Open
ncclementi opened this issue Feb 16, 2023 · 73 comments
Open

Dask Demo Day - Sign up issue #307

ncclementi opened this issue Feb 16, 2023 · 73 comments

Comments

@ncclementi
Copy link
Member

ncclementi commented Feb 16, 2023

Next Demo Day: November 7th

See what the Dask community has been up to, or share some Dask work of your own. Demos are short and informal (~5-10 minutes). Have something you'd like to share? Leave a comment and let us know.

Meetings are held on the first Thursday of each month at 11am US Eastern on Zoom: https://dask.org/meeting-room

Subscribe to the Dask event calendar to be notified of changes:

Past Demo Days

Meetings are recorded and shared on the Dask YouTube channel.

Oct 3rd, 2024

@ncclementi
Copy link
Member Author

  • @brian-methodical Can we get some folks from your team to sign up for one of the upcoming dates?

  • @mgrover1 Do you think the 03/16 date would work for you? Do you want to drop a comment with a proposed date and title?

  • @TomNicholas Whenever you can drop a comment on what date would be more convenient for you, that would be great.

  • @raybellwaves @jorisvandenbossche @tastatham @martinfleis Can we get a demo (or two) that involves dask-geopandas? Or can you volunteer someone :) ?

@martinfleis
Copy link

@ncclementi I could do a short demo of dask-geopandas in May but happy to leave the place to others if they're interested.

@ncclementi
Copy link
Member Author

@martinfleis I'll take you up for May, if you know of folks that would like to show their applications on any of the dates, please send them this issue. It'll be great to hear more about how dask-geopandas is being used.

@TomNicholas
Copy link

I think 16th March is good for me!

@ncclementi
Copy link
Member Author

@TomNicholas Thanks Tom 🙌 , do you have a title that would summarize your demo? If not yet, we can set it later

@TomNicholas
Copy link

Something like "Analysing Terabytes of Ocean Simulation model output with Xarray, xgcm and xhistogram"

@dchudz
Copy link

dchudz commented Feb 28, 2023

@ncclementi I'd like to demo Coiled's "package sync" feature (should be interesting even for folks not planning to use Coiled).

@mgrover1
Copy link

mgrover1 commented Mar 1, 2023

Yes to 3/16! Still trying to come up with a title, but it will be related to scaling weather radar data analysis with dask!

@ncclementi
Copy link
Member Author

Thanks @mgrover1 and @dchudz We'll have you on the list! 🎉

@ncclementi
Copy link
Member Author

@martindurant and @douglasdavis would you be interested in presenting at the April upcoming session?

@lgray
Copy link

lgray commented Mar 31, 2023

Hi @ncclementi - I'm using dask-awkward and dask-histogram for high energy physics analysis and can give some real-world examples of how we'd use @martindurant and @douglasdavis's work. I think I can fit that all into 10 minutes. I'm available for April 20th.

@ncclementi
Copy link
Member Author

@lgray That would be awesome! We usually do 5-7 min but since we do not have folks for April yet, I think 10 min will work, plus you will be showcasing two dask projects!
I'll write you down for April 20th then!!

@AmineDiro
Copy link

Hello @ncclementi , I built daskqueue, a lightweight Distributed Task Queue library built on top of Dask. Daskqueue also implements persistent queues for holding tasks on disk and surviving Dask cluster restart. I would love to present this library according to the format of your choosing and April 20th sounds excellent for me.

The title of the talk would be daskqueue : a dask-based distributed task queue.

@brian-methodical
Copy link

brian-methodical commented Apr 4, 2023 via email

@ncclementi
Copy link
Member Author

@AmineDiro Thank you, that sounds awesome. I'll set you on the list for April 20th, regarding the format.

These are 5-7 minute demos that show off ongoing or lesser-known work. We hope to have 3-5 of these during the meeting. Meetings will be recorded and advertised on social. Hopefully, this helps to educate folks on some of the great work people are up to.

I just updated this issue with a link to the meeting for clarity. I will eventually create an April issue specific.

@brian-methodical
Copy link

brian-methodical commented Apr 6, 2023

We can take May Demo, I’ll bring Dan from my MLOps team to this weeks meeting to intro and get involved

RE https://github.com/dandawg

@ncclementi
Copy link
Member Author

@danwang if you can drop a title for your may demo that would be great.

@dandawg
Copy link

dandawg commented Apr 6, 2023

@danwang if you can drop a title for your may demo that would be great.

Thanks @ncclementi . I don't have a title yet--I need to narrow my topic area a little more. I'll commit to having one though by next week.

@jacobtomlinson
Copy link
Member

@ncclementi if you're still looking for another demo for the April Demo Day I'd love to do a quick demo of launching a Jupyter/Dask cluster on NVIDIA Base Command Platform which comes with all the GPU stuff configured.

@ncclementi
Copy link
Member Author

@jacobtomlinson That would be great! I'll add you to the list.

@mrocklin
Copy link
Member

I'm talking to @fab_clemente here from https://github.com/ydataai/ydata-profiling , a dataframe profiling library (gives summary statistics and more like https://ydata-profiling.ydata.ai/examples/master/census/census_report.html) that works well with Pandas and Spark. It might be an interesting demo to try to see if there is interest in a Dask integration.

@ncclementi what do you think?

@ncclementi
Copy link
Member Author

@fabclmnt would you be up for demoing according to the format described above on May 18th 11am EDT?

@mrocklin
Copy link
Member

mrocklin commented May 3, 2023

@rjzamora want to give a demo on dask-expr?

@dandawg
Copy link

dandawg commented May 3, 2023

I owe an update here. My topic is still in dev, and needs some more exploring. Client work has gotten in the way a bit. I'll attend the community meeting tomorrow, and I can give an update on what I'm thinking about, and maybe get some feedback.

@ncclementi
Copy link
Member Author

@martinfleis Are you still on for the May Dask Demo Day? Do you have a title/topic?

@martinfleis
Copy link

@ncclementi I apparently messed up time zones (again!) and am supposed to speak at another event at the same time. @jorisvandenbossche @jsignell any chance you'd be willing to take over? If not we may need to reschedule for another month. Sorry for complications!

@scharlottej13
Copy link
Collaborator

@mrchtr I have you down for the Oct. 19th demo day, thanks! Excited to learn more about fondant

@jhamman
Copy link
Member

jhamman commented Sep 21, 2023

If there's room, I'd be up for sharing a Dask <> Arraylake integration demo on Oct. 19th.

@mrocklin
Copy link
Member

mrocklin commented Sep 21, 2023 via email

@jrbourbeau
Copy link
Member

Sounds great, thanks @jhamman

@cisaacstern
Copy link

Is this still the place to sign up for demo day?

If so, and assuming there's space in the schedule for 12/21, I'd love to present a status update on the Apache Beam DaskRunner (possibly with assistance of @jacobtomlinson, assuming he'll be in attendance).

@mrocklin
Copy link
Member

mrocklin commented Dec 18, 2023 via email

@cisaacstern
Copy link

Absolutely. Based on https://docs.dask.org/en/stable/support.html#discussion, looks like the next one will be Jan 18?

@scharlottej13
Copy link
Collaborator

@ahuang11 is up for presenting on streamjoy for the next demo day on April 18th 🎉. Streamjoy turns images into animations and uses Dask for parallel image processing.

@v2thegreat
Copy link

Hi!

If spots are still available, I'd like to demo Hvplot on May 16th. I'll be showing some examples of its use with Xarray, Pandas, and, of course, Dask.

It's a great, underutilized Python library that I've come to love after using it almost daily over the past few years.

@jacobtomlinson
Copy link
Member

@v2thegreat the next community meeting will be on June 6th at 10am US Central. Are you up for doing a demo then?

@v2thegreat
Copy link

That sounds good to me!

@jacobtomlinson
Copy link
Member

Ok great I've added you to the agenda

@scharlottej13
Copy link
Collaborator

the next community meeting will be on June 6th at 10am US Central.

@ahuang11 would you also be up for doing a demo on streamjoy at the next community meeting? (I think you ended up not presenting in April because not enough people signed up)

@ahuang11
Copy link

Yes that works for me!

@scharlottej13
Copy link
Collaborator

Great! I've added you to the agenda as well.

@raybellwaves
Copy link
Member

Is the meeting this month going to be postponed? It falls on July 4th when people in the US have the day off work.

Note: I'll be happy to present on a dask-repo-explorer (if I finish it before the meeting)

@jacobtomlinson
Copy link
Member

Yep we are skipping July (#383) but it would be great to have you present in August.

@jrbourbeau
Copy link
Member

Yeah, +1 for you presenting in August if you're game @raybellwaves

(if I finish it before the meeting)

That's too high a bar for demo day : )

@scharlottej13
Copy link
Collaborator

Looking forward to seeing folks tomorrow! Just a heads up, I updated the zoom link (for tomorrow and future meetings): https://us06web.zoom.us/j/89383035703?pwd=WkRJSzNnRTh4T2R1ZjJuVVdJWlMxQT09

@raybellwaves are you still up for demoing a dask-repo-explorer?

@lucascolley
Copy link

Hi! If there is time, I would be happy to do a 2 minute demo of support for dask.array in SciPy.

@jacobtomlinson
Copy link
Member

@lucascolley it would be great to have your demo in the September meeting!

@dougbrn
Copy link

dougbrn commented Aug 19, 2024

Hi there! I'm with LINCC-Frameworks, an organization that has been focused on enabling astronomy workflows at scale, particularly with the upcoming Rubin Observatory providing a ~petabyte-scale dataset for the community. We have been building a few projects on top of Dask, particularly Nested-Dask and LSDB. We'd be interested in giving a small demo (~10 minutes?) at the next available meeting introducing our work with Dask. We'd love to have the opportunity to meet some of the Dask developers and share ideas on scalability challenges with the package. Thank you in advance!

@jacobtomlinson
Copy link
Member

That sounds great @dougbrn ! The next community meeting is on the 5th of September. https://docs.dask.org/en/latest/support.html

@dougbrn
Copy link

dougbrn commented Aug 20, 2024

@jacobtomlinson sounds good! I can plan to bring a ~10 minute demo to the September meeting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests