lsm/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2025-10-08 03:44:24 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Updated run Spark on SeaweedFS (markdown)

Chris Lu
2020-09-28 21:12:48 -07:00
parent 8d9e04d14d
commit caf9033926
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
run-Spark-on-SeaweedFS.md

@@ -15,8 +15,8 @@ Copy the seaweedfs-hadoop2-client-x.x.x.jar to all executor machines.
Add the following to spark/conf/spark-defaults.conf on every node running Spark
```
spark.driver.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.executor.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.driver.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
spark.executor.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
```
And modify the configuration at runntime: