Week 5 Flashcards

(35 cards)

1
Q

What are examples of undirected acyclic graphs?

A
  • one with nodes on a line (but not a circle).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What types of graphs are trees and forests?

A
  • Trees = Connected undirected acyclic graphs
  • forests = partially unconnected undirected acyclic graphs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are DAGs? (2 examples)

A

Directed acyclic graphs, e.g family trees and citation networks,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a preferential attachment network?

A
  • “scale-free,”
  • degree distribution that follows power law
  • some nodes have many links but most just have a few
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Why are preferential attachment networks often called complex?.

A

because they exhibit nontrivial structural patterns.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does it mean that a network is scale-free, and what are such networks particularly useful for studying?

A
  • the degree distribution looks the same no matter the scale.
    Useful for studying
  • the robustness and vulnerability of networks to targeted attacks on highly connected nodes: Removing hubs with high connectivity potentially split the network into disconnected components and impede the network’s functionality. Because most nodes in the network have a small degree (few connections), randomly removing nodes tends not to disrupt the network’s overall structure.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the HSBM?

A
  • hierarchical/nested stochastic block model (HSBM).
  • extension of the SBM concept: clusters are nested within larger clusters, which in turn are part of even larger clusters in a continuous sequence resembling fractals.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is “the emergence of a giant component”, how does this occur and what is the implication?

A
  • prominent (second-order) phase transition in network theory
    (1) start with a completely unconnected network
    (2) randomly add links.
    -> many small unconnected clusters at first,
    -> then a giant component appears.
    This happens when about n/2 links have been added.
  • Implication: randomly connected networks with a sufficient number of links are almost always connected networks.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What 3 aspects of dynamics can we distinguish between?

A
  • dynamics on node values (e.g., Lotka—Volterra models),
  • link values (connection strength in neural networks),
  • cases where the structure of the network is dynamic (e.g giant component)
    (These types of dynamics also coexist and interact)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What do Latent variables represent in statistical modeling?

A

unobservable/underlying factors that cannot be directly measured or observed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Where do the statistical tools for analyzing latent variables come from?

A
  • modern test theory
  • structural equation modeling (SEM)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the main motivation for the network approach in psychology?

A

underlying common causes (latent variables) are unsatisfactory if they cannot be identified independently of the observed relationships they are supposed to explain.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the Cattell-Horn-Carroll (CHC) model?

A
  • a g-model/factor model of intelligence (often called “the standard model”)
  • test scores load on subfactors such as visual processing (Gv) and fluid reasoning (Gf)
  • subfactors are correlated
  • These latent correlations are explained by the general, higher-order factor g
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Reflective vs formative interpretations of the factor model?

A
  • Reflective = the latent factor is a common cause for the observations. e.g temperature -> e.g different thermometers
  • Formative = factor is not a common cause - just an index (e.g., an economic index) that summarizes the state of many interacting components (e.g companies)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How does interventions affect formative and reflective models differently?

A

In a reflective model, intervening on on one x (e.g thermometer) will only change that particular x because each x has no outgoing connections. In the formative case, only interventions on the x can have an overall effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the mutualism model and what is the basic idea behind it?

A
  • an alternative model that is consistent with the formative interpretation of the factor model.
    The idea is:
  • cognitive system consists of many functions that develop over time in an autocatalytic process based on experience and training
  • but also due to weak positive reciprocal interactions between developing cognitive function
  • These mutualistic interactions can create correlations that are typically associated with factor models.
17
Q

Examples of mutualistic interactions between cognitive functions?

A
  • between STM and cognitive strategies, * language and cognition (syntactic and semantic bootstrapping),
  • cognition and metacognition
  • action and perception
  • performance and motivation
18
Q

What is the difference between a competitive and a mutualistic lotka-volterra model?

A

competitive = M (interaction matrix) contains mostly negative values
* limit cycles and other nonlinear phenomena may occur

Mutualistic = positive M
* either convergence to a positive state or exponential growth. (This exponential growth is an unfortunate aspect of the Lotka—Volterra mutualism model)

19
Q

What is a limitation of the mutalism models?

A

only the activation of nodes is updated. The weight and structure of the network are fixed.

20
Q

What is the Fortuin—Kasteleyn model and what can it explain in terms of intelligence?

A
  • a generalization of the Ising model,
  • both nodes and links are random variables.
  • whenever two abilities are connected, they are necessarily in the same state (i.e either both present or both absent)
  • It provides a parsimonious explanation of the positive manifold and hierarchical factor structure of intelligence.
21
Q

What is resilience in dynamic terms and which states have lower/higher resilience?

A
  • The ability of a system to recover from perturbations and maintain its current equilibrium.
  • The Metastable states (E.g a less deep minimum) have less resilience than the globally stable state
22
Q

How does resilience relate to healthy and unhealthy states?

A

associated not with the healthy or unhealthy state but with the stability of these states

23
Q

How do perturbations differ from interventions and how does that relate to resilience?

A
  • Interventions change the equilibrium landscape to allow a sustainable change to a healthy state.
  • Perturbations (a brief intervention or a positive or negative event) can have a permanent or temporary effect, depending on which state is more resilient.
24
Q

What are connectionist models of attitudes and in which framework were these developed?

A
  • attitude units (e.g., beliefs) form a connected network
  • Their activations (usually between 1 and -1) are updated based on the weighted sum of internal inputs from other units and an external input - according to either the delta rule (supevised learning rule) or the hebb rule
  • Developed in the parallel distributed processing (PDP) framework,
25
What is the advantage of th network approach to attitudes using the Ising model over the connectionist PDP models?
*derived from basic assumptions, * better understood mathematically easy to simulate, * provides a psychological interpretation of the temperature parameter * can be fitted to data
26
What does the Metropolis—Hastings algorithm do?
slightly modifies the Glauber dynamics
27
The Ising model (of attitudes) was developed as an alternative to the tripartite factor model of attitudes. Describe this model (the triparte one)
Attitude = latent factor, Attitude consists of lower-order cognitive, affective, and behavioral factors that each explain observed responses ( similar to the Cattell—Horn—Carroll model of general intelligence. )
28
What is the temperature and the external field in the ising model of attitudes?
* Attention = (inverse) temperature ( The alignment of nodes to other nodes and to the external field depends on one’s attention) * External field = external efforts to change attitude?
29
3 basic assumptions of the Ising attitude model
* nodes are binary * Nodes influence each other causally, Nodes have specific thresholds (as in the model for depression).
30
How does random field ising model differ from the ising model described previously?
* the first term has 2 components: a general external effect (T) + an effect of node-specific (xi) thresholds * interactions are weighted and can even be negative.
31
How can we quantify the consistency of attitudes?
By computing the Gibbs entropy
32
What is the difference between Gibbs entropy and Boltzman entropy?
Gibbs entropy is more general in that it does not assume that each microstate is equally probable.
33
What is the difference between a regular Ising model and what in physics is know as tricritical Ising model/Blume—Capel model?
* The tricitical ising model has trichotomic node values (-1, 0, 1). * More complicated dynamics - It resembles the butterfly catastrophe which has a tricritical point. * The potential function, , has three stable fixed points for specific combinations of values of parameter
34
why are preferential attachment networks of particular interest?
* because it is created dynamically. * starts with a node and then new nodes are added that prefer links to nodes that already have many links
35
What does near decomposability mean and which model is it associated with?
* subsystems are internally cohesive but more loosely connected to other systems meaning they can function( and be studied) somewhat independently * HSBM