Spark
===================

.. toctree::
    :hidden:
    :glob:

    ./spark/*

## 环境搭建

:doc:`spark环境搭建<./spark/sparkEnv>`

## spark集群问题

:doc:`spark集群使用sbin目录下的stop-all.sh脚本关闭不了集群<./spark/spark1>`

:doc:`spark提交yarn任务，每次都需要上传jar报的解决办法<./spark/spark2>`

:doc:`spark启动报错：java.lang.IllegalStateException: Spark context stopped while waiting for backend<./spark/spark3>`


## spark性能调优

:doc:`spark常规性能调优<./spark/sparkOptimize1>`

:doc:`spark算子调优<./spark/sparkOptimize2>`

:doc:`spark的shuffle调优<./spark/sparkOptimize3>`

:doc:`spark的JVM调优<./spark/sparkOptimize4>`


## 官方测试事例

:doc:`spark官方测试事例(可以用来检验新搭的环境是否健康)<./spark/sparkExample>`