Skip to content

Commit

Permalink
feat (format): Introduce buf (#519)
Browse files Browse the repository at this point in the history
* feat(spark): Refactoring datasources (#514)

### Reason for this PR
By moving datasources under `org.apache.spark.sql` we are able to access private Spark API. Last time when I was trying to fully migrate datasources to V2 it was a blocker. Detailed motivation is in #493 

### What changes are included in this PR?
Mostly refactoring.

### Are these changes tested?
Unit tests are passed

I manually checked the generated JARs:
![image](https://github.com/apache/incubator-graphar/assets/29755009/1b094516-88b1-490a-a2ea-8dcd092a3b1d)

### Are there any user-facing changes?
Mostly not because `GarDataSource` was left under the same package.


Close #493

* feat(dev): Add release and verify scripts (#507)

Reason for this PR
Add scripts for developer or release manager to easily release version or verify a version.

What changes are included in this PR?
Add release and verify scripts
related document is updated to website, see Update the release and verify document, and add development document incubator-graphar-website#18
Are these changes tested?
yes

Are there any user-facing changes?
no
---------

Signed-off-by: acezen <[email protected]>

* chore: Bump to version v0.12.0 (Round 1) (#517)


Signed-off-by: acezen <[email protected]>

* chore: Add CHANGELOG.md (#513)


Signed-off-by: acezen <[email protected]>

* Introduce buf

- v2
- buf.gen
- buf

 On branch format-definition-dev
 Your branch is up to date with 'origin/format-definition-dev'.

 Changes to be committed:
	new file:   buf.gen.yaml
	new file:   buf.yaml
	modified:   format/adjacent_list.proto
	modified:   format/edge_info.proto
	modified:   format/graph_info.proto
	modified:   format/property_group.proto
	modified:   format/types.proto
	modified:   format/vertex_info.proto

---------

Signed-off-by: acezen <[email protected]>
Co-authored-by: Weibin Zeng <[email protected]>
  • Loading branch information
SemyonSinchenko and acezen committed Jun 13, 2024
1 parent 57018e1 commit 2509d40
Show file tree
Hide file tree
Showing 8 changed files with 34 additions and 7 deletions.
18 changes: 18 additions & 0 deletions buf.gen.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
version: v2
managed:
enabled: true
disable:
- file_option: java_package
plugins:
# Python classes
- remote: buf.build/protocolbuffers/python:v27.1
out: pyspark/graphar_pyspark/proto/
# Python headers for IDEs and MyPy
- remote: buf.build/protocolbuffers/pyi
out: pyspark/graphar_pyspark/proto/
# Cpp
- remote: buf.build/protocolbuffers/cpp:v27.1
out: cpp/src/proto
# Java
- remote: buf.build/protocolbuffers/java:v27.1
out: maven-projects/info/src/main/java/
3 changes: 3 additions & 0 deletions buf.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
version: v2
modules:
- path: format
3 changes: 2 additions & 1 deletion format/adjacent_list.proto
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

import "types.proto";

Expand Down
3 changes: 2 additions & 1 deletion format/edge_info.proto
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

import "property_group.proto";
import "adjacent_list.proto";
Expand Down
3 changes: 2 additions & 1 deletion format/graph_info.proto
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

import "vertex_info.proto";
import "edge_info.proto";
Expand Down
3 changes: 2 additions & 1 deletion format/property_group.proto
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

import "types.proto";

Expand Down
3 changes: 2 additions & 1 deletion format/types.proto
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

enum DataType {
BOOL = 0;
Expand Down
5 changes: 3 additions & 2 deletions format/vertex_info.proto
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
/*
/*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
Expand All @@ -20,7 +20,8 @@
syntax = "proto3";

package graphar;
option java_package = "org.apache.graphar.info";
option java_multiple_files = true;
option java_package = "org.apache.graphar.info.proto";

import "property_group.proto";

Expand Down

0 comments on commit 2509d40

Please sign in to comment.