11: Big Data

Question 1

Characteristics of Big Data (3)

Answer 1

• Volume: too big to fit into a single server
• Velocity: streaming data, milliseconds to seconds to respond
• Variety: data in many forms such as structured, unstructured, text, multimedia

Question 2

Fact

Answer 2

Each fact in a fact-based model captures a single piece of information and is timestamped

Question 3

Graph Schema (4)

Answer 3

• Graph schemas are graphs that depict the structure of a data set that is stored using a fact-based model
• Nodes are used to represent the core entities in the data set. They are depicted with ovals
• Edges are used to represent the relationships between nodes. They are depicted with directed or undirected solid lines
• Properties are used to represent information about nodes. They are depicted with rectangles

Question 4

When Data Sizes are so Big as not to Fit on a Single-Server (2)

Answer 4

• The processing may be distributed across more than one machine
• Functional programming is a solution, because it makes it easier to write correct and efficient distributed code

Question 5

Features of Functional Programming (3)

Answer 5

• Immutable data structures
• Statelessness
• High-order functions

Question 6

Immutable Data Structures

Answer 6

They cannot be changed during program execution. This eliminates errors caused when data is overwritten by another server

Question 7

Statelessness

Answer 7

Data structures are immutable and variables are not used so the program state does not change in execution. This means that a function with the same inputs will always produce the same output

Question 8

High-Order Functions

Answer 8

They can take other functions as parameters and return functions as a result. They can run in parallel systems without disturbing other parts of the data sets