版权声明:本文为博主chszs的原创文章,未经博主允许不得转载。 https://blog.csdn.net/chszs/article/details/51194023
Spark和Scala的网络资源汇集
作者:chszs,未经博主允许不得转载。经许可的转载需注明作者和博客主页:http://blog.csdn.net/chszs
本文的目的是为Spark和Scala初学者提供一些学习资源。
1、Github上的Scala Workshop
https://github.com/airisdata/scalaworkshop
2、Setup资源
- 下载Scala 2.11.8: http://www.scala-lang.org/download/
- 下载Apache Spark 1.6.1: http://spark.apache.org/downloads.html
3、Scala安装
http://www.scala-lang.org/download/install.html
4、Setup
首先确保本地安装了Java 7或Java 8环境,再下载Scala 2.11.8、SBT以及Spark,最好是再安装Maven。
5、解决本地Spark的问题
export SPARK_MASTER_IP=127.0.0.1
export SPARK_LOCAL_IP=127.0.0.1
export SCALA_HOME=~/Downloads/scala-2.10.6
export PATH=$PATH:$SCALA_HOME/bin
对于Windows系统,使用SET命令代替EXPORT。
6、书籍
- Learning Spark: http://www.amazon.com/Learning-Spark-Lightning-Fast-Data-Analysis/dp/1449358624
- Scala by Example by Odersky: http://www.scala-lang.org/docu/files/ScalaByExample.pdf
- Scala Overview by Odersky: http://www.scala-lang.org/docu/files/ScalaOverview.pdf
- Programming in Scala, First Edition by Odersky: http://www.artima.com/pins1ed/
- Structure and Interpretation of Computer Programs: http://mitpress.mit.edu/sicp/full-text/book/book.html
- Scala for the Impatient: http://www.amazon.com/Scala-Impatient-Cay-S-Horstmann/dp/0321774094
- Programming Scala: http://www.amazon.com/Programming-Scala-Scalability-Functional-Objects/dp/0596155956
- Scala-Lang官网给出的书籍列表: http://www.scala-lang.org/documentation/books.html
- Advanced Analytics with Spark: http://www.amazon.com/Advanced-Analytics-Spark-Patterns-Learning/dp/1491912766
- Spark Cookbook: http://www.amazon.com/Spark-Cookbook-Rishi-Yadav/dp/1783987065
7、在线指南
- Scala for Java Programmers: http://docs.scala-lang.org/tutorials/scala-for-java-programmers.html
- Scala Tutorial: http://www.scala-lang.org/docu/files/ScalaTutorial.pdf
- Effective Scala (Twitter): http://twitter.github.io/effectivescala/
- Scala Tour: http://www.scala-tour.com/#/welcome
8、E-Books
- Books at Lightbend (Typesafe): http://www.lightbend.com/resources/e-books
- AtomicScala (sample): http://www.atomicscala.com/free-sample/
9、Scala Koans/Exercises
- Scala Exercises: http://scala-exercises.47deg.com/
- Scala Koans: http://www.scalakoans.org/
10、资源
- Scala Roundup for Java Engineers: http://www.codecommit.com/blog/scala/roundup-scala-for-java-refugees
- Scala Info at StackOverflow: http://stackoverflow.com/tags/scala/info
- Scala Cheetsheats: http://docs.scala-lang.org/cheatsheets/
- Scala Notes: http://aperiodic.net/phil/scala/s-99/
- Cake Solutions Blog: http://www.cakesolutions.net/teamblogs
- Scala School (Twitter): https://twitter.github.io/scala_school/
- Functional Programming in Scala: http://nerd.kelseyinnis.com/blog/2013/01/07/resources-for-getting-started-with-functional-programming-and-scala/
- How to Learn Scala: http://blog.codacy.com/2015/07/03/how-to-learn-scala/#gs.GX=delw
- Scala Lang Overviews: http://docs.scala-lang.org/overviews/
- Learning Scala in Small Bites: http://matt.might.net/articles/learning-scala-in-small-bites/
11、Scala在线免费课程
- Functional Programming with Scala: https://www.coursera.org/course/progfun
- Reactive Programming with Scala: https://www.coursera.org/course/reactive
12、Spark在线免费课程
- Big Data Analysis with Spark: https://www.edx.org/course/big-data-analysis-spark-uc-berkeleyx-cs110x
- Distributed Machine Learning with Spark: https://www.edx.org/course/distributed-machine-learning-spark-uc-berkeleyx-cs120x
- Introduction to Spark: https://www.coursera.org/learn/hadoop/lecture/9cq0R/introduction-to-apache-spark
- Spark Fundamentals: http://bigdatauniversity.com/courses/spark-fundamentals/
- Data Science / Engineering Spark: https://www.edx.org/xseries/data-science-engineering-spark
- CS100: https://courses.edx.org/courses/BerkeleyX/CS100.1x/1T2015/
- CS190: https://courses.edx.org/courses/BerkeleyX/CS190.1x/1T2015/