Skip to content

2.3 Java,若增加一个rabbitmq模块,以spark为参照

Dong Xie edited this page Jul 6, 2021 · 3 revisions

注意:此为1.3.6版本,目前dev branch在重构系统架构,有新文件和位置出现,暂不理会

在repo根下运行:

grep -rl --ignore-case "spark"

sort后输出为:

ambari_plugin/common-services/DOLPHIN/1.3.6/configuration/dolphin-env.xml
docker/build/conf/dolphinscheduler/env/dolphinscheduler_env.sh.tpl
docker/build/startup-init-conf.sh
docker/docker-swarm/config.env.sh
docker/kubernetes/dolphinscheduler/values.yaml
dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/DataSourceService.java
dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/utils/CheckUtilsTest.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/Constants.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/DbType.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/SparkVersion.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/TaskType.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/UdfType.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/task/spark/SparkParameters.java
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/TaskParametersUtils.java
dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/HadoopUtilsTest.java
dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/TaskParametersUtilsTest.java
dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/datasource/BaseDataSource.java
dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/datasource/DataSourceFactory.java
dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/datasource/SparkDataSource.java
dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/UdfFunc.java
dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao/datasource/BaseDataSourceTest.java
dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/SparkArgsUtils.java
dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/AbstractTask.java
dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/spark/SparkTask.java
dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/utils/MapReduceArgsUtilsTest.java
dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/utils/SparkArgsUtilsTest.java
dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/spark/SparkTaskTest.java
dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/config.js
dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/dag.scss
dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/formModel/formModel.vue
dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/formModel/tasks/spark.vue
dolphinscheduler-ui/src/js/conf/home/pages/datasource/pages/list/_source/createDataSource.vue
dolphinscheduler-ui/src/js/conf/home/pages/resource/pages/udf/pages/function/_source/createUdf.vue
dolphinscheduler-ui/src/js/conf/home/store/dag/state.js
dolphinscheduler-ui/src/js/conf/home/store/datasource/actions.js
dolphinscheduler-ui/src/js/module/i18n/locale/en_US.js
dolphinscheduler-ui/src/js/module/i18n/locale/zh_CN.js
e2e/src/test/java/org/apache/dolphinscheduler/locator/project/CreateWorkflowLocator.java
.git/index
.git/objects/pack/pack-e1aaf0b3da3f44f32f0f7d567a98d9176c47c1ff.pack
pom.xml
README.md
README_zh_CN.md
script/env/dolphinscheduler_env.sh
sql/create/release-1.0.0_schema/mysql/dolphinscheduler_ddl.sql
sql/dolphinscheduler_mysql.sql

以上可见工作量基本平分为Java和js两部分,及一些配置文件

Clone this wiki locally