What are Notebooks?
Notebooks consist of two cells, code cells and annotation cells. The code cells perform task while the annotation cells provide documentation.
What is cell magic?
Cell magic is how you tell the notebook cell which language to use for processing that cell. Examples: %r, %py, %Sql, %md
%fs
Emulates local disk storage within the DFS system.
%md
Markdown Cell. These cells are used to annotate the notebook and support html.
%python
Supports Python 2 and python 3 depending on the cluster.
%r
R language cell.
%run
Executes another notebook
%scala
Uses the scala language
%sh
Shell statements used to run BASH commands
%sql
Used to run SQL commands