Skip to content

Conversation

johndmulhausen
Copy link
Contributor

@johndmulhausen johndmulhausen commented Sep 16, 2025

Overview

Overhauls the Query Expression Language docs in Reference.

Changes

Documentation Structure

  • Reorganized data types: Moved all data type documentation files from /content/en/ref/query-panel/ into a dedicated /content/en/ref/query-panel/data-types/ subdirectory
  • Added operations section: Created a new /content/en/ref/query-panel/operations/ directory for query panel operations documentation
  • Improved organization: Better separation of concerns between data types and operations

Data Type Cleanup - IMPORTANT

Removed non-queryable media types from Query Panel documentation

Justification for Deletions

After thorough validation against the W&B core source code, the following media/file types were removed from the Query Panel documentation:

Deleted Types:

  • object3D-file.md
  • molecule-file.md
  • audio-file.md
  • video-file.md
  • html-file.md
  • bokeh-file.md
  • image-file.md
  • pytorch-model-file.md
  • And other media-specific types

Why These Deletions Are Justified:

  1. These types are NOT queryable: While these types ARE still fully supported in W&B for data logging and visualization (confirmed in /scripts/core/frontends/weave/src/core/model/media/mediaTypes.ts), they are not queryable in the Query Expression Language. No query operations exist for these types in the ops directory.

  2. Display-only types: These are media/visualization types meant for rendering in the UI, not for data analysis or querying. The old documentation files only contained generic asset-file operations with no specific query functionality.

  3. Avoiding user confusion: Including non-queryable media types in the Query Panel reference would mislead users into expecting query operations that don't exist.

  4. Proper documentation scope: The Query Panel documentation should focus exclusively on types that can be meaningfully queried and manipulated:

    • Core entities: Run, Artifact, Project, Entity, User
    • Data structures: ConfigDict, SummaryDict, Table
  5. Media types belong elsewhere: Documentation for media logging (object3D, molecule, audio, video, etc.) belongs in the general SDK/logging documentation, not in the Query Expression Language reference.

Files Affected

  • Migrated 11 queryable data type files to the new structure
  • Removed 24 non-queryable media type files
  • Updated media.md files across all language versions (English, Japanese, Korean)
  • Updated main query panel index to reflect new structure

Supporting Files

  • Added migration scripts to automate future documentation updates
  • Added TypeDoc configuration for automated documentation generation
  • Added example files and documentation investigation notes

Benefits

  • ✅ Clearer documentation structure focused on queryable types
  • ✅ Eliminated confusion between media logging and query capabilities
  • ✅ Easier navigation for users
  • ✅ Better maintainability
  • ✅ Scalable for future additions

Testing

  • Documentation builds successfully
  • All links are working correctly
  • Navigation structure is intuitive
  • Verify no broken references to deleted media types

Related Issues

Please link any related JIRA tickets or GitHub issues if applicable.

📄 View preview links for changed pages

- Reorganized query panel data types into dedicated subdirectory (data-types/)
- Added new operations subdirectory for query panel operations
- Migrated individual data type files from root query-panel/ to data-types/
- Updated media.md files across all language versions (en, ja, ko)
- Added migration scripts for automated documentation updates
- Added TypeDoc configuration and example files for documentation generation
- Updated .gitignore to reflect new structure
@johndmulhausen johndmulhausen requested a review from a team as a code owner September 16, 2025 18:45
@johndmulhausen johndmulhausen changed the title Restructure query panel documentation for improved organization Replace the Query Panel reference with new scripts/docs Sep 16, 2025
Copy link

socket-security bot commented Sep 16, 2025

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Addednpm/​typedoc-plugin-frontmatter@​0.0.2881009980100
Addednpm/​typedoc-plugin-markdown@​3.17.11001008690100
Addednpm/​typescript@​5.9.210010090100100
Addednpm/​typedoc@​0.25.131001009897100

View full report

Copy link

socket-security bot commented Sep 16, 2025

All alerts resolved. Learn more about Socket for GitHub.

This PR previously contained dependency changes with security issues that have been resolved, removed, or ignored.

Ignoring alerts on:

View full report

@johndmulhausen johndmulhausen changed the title Replace the Query Panel reference with new scripts/docs Replace the Query Expression Language reference with new scripts/docs Sep 16, 2025
Copy link

cloudflare-workers-and-pages bot commented Sep 16, 2025

Deploying docs with  Cloudflare Pages  Cloudflare Pages

Latest commit: 340564c
Status: ✅  Deploy successful!
Preview URL: https://83ae1560.docodile.pages.dev
Branch Preview URL: https://query-panels.docodile.pages.dev

View logs

Copy link
Contributor

github-actions bot commented Sep 16, 2025

PR Preview: Changed content

Base preview: https://query-panels.docodile.pages.dev

Added

Title Path
Data Types content/en/ref/query-panel/data-types/_index.md
Artifact content/en/ref/query-panel/data-types/artifact.md
ArtifactType content/en/ref/query-panel/data-types/artifacttype.md
ArtifactVersion content/en/ref/query-panel/data-types/artifactversion.md
ConfigDict content/en/ref/query-panel/data-types/configdict.md
Entity content/en/ref/query-panel/data-types/entity.md
Project content/en/ref/query-panel/data-types/project.md
Run content/en/ref/query-panel/data-types/run.md
SummaryDict content/en/ref/query-panel/data-types/summarydict.md
Table content/en/ref/query-panel/data-types/table.md
User content/en/ref/query-panel/data-types/user.md
Operations content/en/ref/query-panel/operations/_index.md
Artifact Operations content/en/ref/query-panel/operations/artifact-operations.md
Run Operations content/en/ref/query-panel/operations/run-operations.md

Modified

Title Path
Log media and objects content/en/guides/models/track/log/media.md
Query Expression Language content/en/ref/query-panel/_index.md
メディアとオブジェクトをログする content/ja/guides/models/track/log/media.md
Log media and objects content/ko/guides/models/track/log/media.md

Deleted

Title Path
Artifact Type content/en/ref/query-panel/artifact-type.md
Artifact Version content/en/ref/query-panel/artifact-version.md
Artifact content/en/ref/query-panel/artifact.md
Audio File content/en/ref/query-panel/audio-file.md
Bokeh File content/en/ref/query-panel/bokeh-file.md
Boolean content/en/ref/query-panel/boolean.md
Entity content/en/ref/query-panel/entity.md
File content/en/ref/query-panel/file.md
Float content/en/ref/query-panel/float.md
Html File content/en/ref/query-panel/html-file.md
Image File content/en/ref/query-panel/image-file.md
Int content/en/ref/query-panel/int.md
Joined Table content/en/ref/query-panel/joined-table.md
Molecule File content/en/ref/query-panel/molecule-file.md
Number content/en/ref/query-panel/number.md
Object 3 D File content/en/ref/query-panel/object-3-d-file.md
Partitioned Table content/en/ref/query-panel/partitioned-table.md
Project content/en/ref/query-panel/project.md
Pytorch Model File content/en/ref/query-panel/pytorch-model-file.md
Run content/en/ref/query-panel/run.md
String content/en/ref/query-panel/string.md
Table content/en/ref/query-panel/table.md
User content/en/ref/query-panel/user.md
Video File content/en/ref/query-panel/video-file.md

johndmulhausen and others added 3 commits September 16, 2025 14:53
- Deleted obsolete scripts related to type structures, type linking, and data type fixes.
- Removed outdated documentation files that no longer align with the current project structure.
- Cleaned up the repository by eliminating unnecessary files to streamline future development.
…ion character escape

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
- Updated data types section with detailed descriptions for each type, including Run, Artifact, and new entries like ArtifactType and User.
- Revised the operations description to clarify the functions available in the Query Expression Language.
- Improved overall clarity and organization of the documentation for better user understanding.
@johndmulhausen
Copy link
Contributor Author

@SocketSecurity ignore npm/[email protected]

@johndmulhausen
Copy link
Contributor Author

@SocketSecurity ignore npm/[email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant