Elastic jobs

[bgedik]

Is there support in Kueue for managing elastic jobs?

Imagine I have ML training GPU workloads that are not elastic as typical. But I also have GPU data workloads, which are elastic. Examples would be Ray jobs that can scale up and down.

Is there any support in Kueue, now or in the future, to manage a mix of such workloads under queue quotas and fairness?

Looking at the RayCluster documentation, it mentions:

In-Tree Autoscaling Disabled: Kueue manages resource allocation for the RayCluster; therefore, the cluster’s internal autoscaling mechanisms need to be disabled

How does Kueue manage the resource allocation? Does it scale clusters up and down? If so, does that take into account fairness?

[mimowo]

Imagine I have ML training GPU workloads that are not elastic as typical. But I also have GPU data workloads, which are elastic.
Examples would be Ray jobs that can scale up and down.
Is there any support in Kueue, now or in the future, to manage a mix of such workloads under queue quotas and fairness?

We definitely plan to work on this, and have an early design #77, but this is an "aspirational long-term" goal currently in the roadmap.

Thank you! Voices like this help us to prioritize.

cc @mwielgus @mwysokin

How does Kueue manage the resource allocation? Does it scale clusters up and down? If so, does that take into account fairness?

AFAIK the resource allocation is static only ATM.

cc @andrewsykim

[chris7735]

Dear Sir,

I am writing to express my interest in the Frontend Developer position as advertised on job posting. With a robust background in frontend web development and a deep commitment to delivering exceptional user experiences, I am excited about the opportunity to contribute to your team and help drive your innovative projects forward.
I successfully led several high-impact projects that focused on building responsive, user-friendly web applications. Utilizing modern frontend technologies such as HTML5, CSS3, and JavaScript, as well as frameworks like React and Vue.js, I created dynamic and aesthetically pleasing user interfaces that significantly enhanced user engagement and satisfaction. Additionally, working closely with design teams, I translated wireframes and mockups into polished products while ensuring cross-browser compatibility and mobile responsiveness.
Some highlights of my qualifications that I believe make me a great fit for this role include:
Responsive and Accessible Design: Developed applications following best practices in responsive design and accessibility (WCAG), resulting in inclusive products for a diverse user base.
Performance Optimization: Implemented performance improvements that reduce load times and enhance user experience. Familiar with tools and techniques such as code splitting, lazy loading, and image optimization.
Collaborative Skillset: Worked in Agile teams, collaborating with backend developers and stakeholders to define project requirements and ensure alignment with business goals.
Continuous Learning: Passionate about keeping up with industry trends and technologies, I actively contribute to open-source projects and participate in local developer meetups.
I am confident that my hands-on experience with frontend technologies, coupled with my proactive approach to problem-solving, makes me a strong candidate for this role. I look forward to discussing how I can contribute to your projects and help your company continue to deliver exceptional user experiences.

Thank you for considering my application. I hope to discuss my application further in an interview.

Sincerely,

Christopher Chan