Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update spark-compute.md #1175

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update spark-compute.md #1175

wants to merge 1 commit into from

Conversation

zincob
Copy link

@zincob zincob commented Oct 2, 2024

Spark VCores in the text is mentioned as 128 but in the table is 384. Table have been updated with 128

Thank you for contributing to Microsoft Fabric documentation

Fill out these items before submitting your pull request:

If you are working internally at Microsoft:
Provide a link to an Azure DevOps Boards work item that tracks this feature/update.

Not Applicable

Who is your primary Skilling team contact? @mention them individually tag them and let them review the PR before signing off.

Not sure

For internal Microsoft contributors, check off these quality control items as you go

Not applicable

Merge and publish

  • After you #sign-off, there is a separate PR Review team that will review the PR and describe any necessary feedback before merging.
  • The review team will use the comments section in the PR to provide feedback if changes are needed. Address any blocking issues and sign off again to request another review.
  • Once all feedback is resolved, you can #sign-off again. The PR Review team reviews and merges the pull request into the specified branch (usually the main branch or a release- branch).
  • From the main branch, the change is merged into the live branch several times a day to publish it to the public learn.microsoft.com site.

Spark VCores	in the text is mentioned as 128 but in the table is 384.
Table have been updated with 128
Copy link
Contributor

@zincob : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Copy link
Contributor

Learn Build status updates of commit 27c9194:

✅ Validation status: passed

File Status Preview URL Details
docs/data-engineering/spark-compute.md ✅Succeeded

For more details, please refer to the build report.

For any questions, please:

@ShannonLeavitt
Copy link
Contributor

@santhoshravindran7

Can you review the proposed changes?

IMPORTANT: When the changes are ready for publication, adding a #sign-off comment is the best way to signal that the PR is ready for the review team to merge.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@zincob
Copy link
Author

zincob commented Oct 14, 2024

Is there any update? Documentation is still unclear and providing 2 different information

@zincob
Copy link
Author

zincob commented Oct 29, 2024

The documentation is extremely confusing.
Spark Compute: Here the text says "SKU F64 has 64 capacity units, which is equivalent to 128 Spark VCores." there is no reference at all the Burst and then the table out of the blue mentions 384 VCore

Spark Job Concurrency: Here the Burst factor for F64 is 3.

Burstable Capacity: Here Burstable scale factor is 1-12x. True that this is referring to the warehousing but it makes everything quite confusing.

@santhoshravindran7
Copy link
Contributor

thanks for the feedback
will it help i change the column name to Max Spark VCores with Burst Factor
if we are adding the burst vcores along with spark vcores available

the bursting for spark is explained in the https://learn.microsoft.com/en-us/fabric/data-engineering/spark-job-concurrency-and-queueing

will add another column with the max burst so its more clear

@SnehaGunda
Copy link
Collaborator

@santhoshravindran7 can you reference your PR once you have it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants