目录

Spark

SPARK

1 概述

2 配置

2.1 pyspark use Python3

#安装python3
wget https://www.python.org/ftp/python/3.6.4/Python-3.6.4.tar.xz
xz -d Python-3.6.4.tar.xz
tar -xf Python-3.6.4.tar
cd Python-3.6.4
./configure prefix=/usr/local/python3
make && make install

#引入环境变量
export PYSPARK_PYTHON=/usr/local/python3/bin/python3

$ pyspark