juypter-notebook安裝配置
Table of Contents
1 jupyter notebook概述
Jupyter Notebook(此前被稱爲 IPython notebook)是一個交互式筆記本,支持運行 40 多種編程語言。
前端展示基於瀏覽器,能夠遠程使用(服務器上安裝使用jupyter notebook)
跨平臺 ipad就能夠用?
html
經過內核支持語言擴展
前端
jupyter kernelspec list
2 jupyter notebook安裝
pip3 install jupyter jupyter notebook
3 在jupyter notebook中運行pyspark
PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS="notebook" ~/run/spark-2.0.0-bin-hadoop2.7/bin/pyspark
java
4 在jupyter notebook中安裝toree(scala for spark)
4.1 版本要求
scala: 2.10.4
spark: 1.6.2
高版本的安裝包還沒有正式發佈,須要本身編譯、安裝(須要docker,沒有走通)
python
4.2 配置環境變量
export SCALA_HOME=/usr/local/Cellar/scala/2.10.4 export PATH=$SCALA_HOME/bin:$PATH export SPARK_HOME="/Users/galaxy/run/spark-1.6.2-bin-hadoop2.6/" export PATH=$SPARK_HOME/bin:$PATH
4.3 執行安裝
pip3 install --pre toree jupyter toree install
4.4 運行
jupyter notebook New -> Apache Toree-scala
5 參考資料
Running Spark Applications Using IPython and Jupyter Notebooks
http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html#ipython__notebook_quickstart
git
Using IPython Notebook with Apache Spark - Hortonworks
http://zh.hortonworks.com/hadoop-tutorial/using-ipython-notebook-with-apache-spark/
github
27 Jupyter Notebook tips, tricks and shortcuts
https://www.dataquest.io/blog/jupyter-notebook-tips-tricks-shortcuts/
sql
GitHub - tribbloid/ISpark: An Apache Spark-shell backend for IPython
https://github.com/tribbloid/ISpark
docker
GitHub - alexarchambault/jupyter-scala: Lightweight Scala kernel for Jupyter / IPython 3
https://github.com/alexarchambault/jupyter-scala
shell
GitHub - apache/incubator-toree: Mirror of Apache Toree (Incubating)
https://github.com/apache/incubator-toree
apache
Hadoop Dev | How to install Jupyter Notebook for Spark - Hadoop Dev
https://developer.ibm.com/hadoop/2016/05/04/install-jupyter-notebook-spark/
How to install the Scala Spark (Apache Toree) Jupyter kernel with GeoMesa support - GeoMesa - Confluence
https://geomesa.atlassian.net/wiki/display/GEOMESA/How+to+install+the+Scala+Spark+(Apache+Toree)+Jupyter+kernel+with+GeoMesa+support
Tour of the Jupyter (IPython3) notebook — Computational Statistics in Python 0.1 documentation
http://people.duke.edu/~ccc14/sta-663/Jupyter.html
./jove-scala –kernel-spec
How it works
https://toree.incubator.apache.org/documentation/user/how-it-works.html
GitHub - andypetrella/spark-notebook: Interactive and Reactive Data Science using Scala and Spark.
https://github.com/andypetrella/spark-notebook/
jupyter與spark kernel結合的notebook安裝及使用 - heng_2218的博客 - 博客頻道 - CSDN.NET
http://blog.csdn.net/heng_2218/article/details/51006075