安装sparkmagic

pip install sparkmagic

确保ipywidgets安装

 jupyter nbextension enable --py --sys-prefix widgetsnbextension

选择是否安装kernel

 jupyter-kernelspec install sparkmagic/kernels/sparkkernel
 jupyter-kernelspec install sparkmagic/kernels/pysparkkernel
 jupyter-kernelspec install sparkmagic/kernels/pyspark3kernel
 jupyter-kernelspec install sparkmagic/kernels/sparkrkernel

配置~/.sparkmagic/config.json

server extension使能

jupyter serverextension enable --py sparkmagic