Index ¦ Archives ¦ Atom > Category: Spark ¦ Atom

How to Run Spark on Jupyter Notebook

Cat Meme

Introduction

This post is about setting up Spark to run on a Jupyter Notebook on a computer running Windows 10.

To follow along with this post, you should already have Java (JDK 8), Spark, Python, and Jupyter Notebook installed on your machine.

If you need help with those things, here …


Yes, you can install Spark on your computer

Spark Meme

Introduction

This post is about installing Spark on a computer running Windows 10.

If you want to run PySpark, you must have Python installed on your machine. If you need help with that, refer to this:
How to Install Anaconda (Python)

If you only want install Spark (Scala), you can …


How to Install Java

Java Meme

Download & Install Java

Download & Install Java Development Kit 8. To figure out which version of Java I need to download, I check my windows version by entering the following in a command prompt:

cmd> wmic os get osarchitecture

The output tells me I'm using the 64 bit version of Windows …

© Eric Chan. Built using Pelican. Theme by Giulio Fidente on github.