1
Q
How much power if data centers globally?
A
50GW
2
Q
How much power needed for human brains globally?
A
160 GW (8 billion humans at 20W/brain)
3
Q
Total power from sunlight on earth?
A
173k TW
4
Q
Global primary power as of 2024
A
20 TW
5
Q
How many watts does an h100 in the PCIE form factor use?
A
350W
6
Q
How many 8B LLMs 4K CW can you fit on an 80GB H100? [late 2024]
A
13 at 35 tok/s
7
Q
A
-AI
flashcards
Decks in class (33)
# Cards
-
Transformers57
-
Large Language Models10
-
Misc11
-
Optical DNNs3
-
RNNs1
-
Neural Network Basic Ingredienrs55
-
Paper: Neural Networks and the Chomsky Hierarchy0
-
Stats25
-
Basic Info Theory5
-
AI Hardware18
-
Tesla AI Hardware2
-
AI Tests2
-
Diffusion Models5
-
Autoencoders3
-
Transformers:Attention9
-
Misc Math0
-
Transformers: The attention Mechanism From Scratch2
-
Article: Will Transformers Take Over Artificial Intelligence?2
-
Image Models1
-
Text Models3
-
Transformers:Self attention2
-
Seq To Seq Models1
-
Transformers:Misc1
-
PMAI: Chapter 90
-
PMAI Ch92
-
Ai Engineering0
-
Sarathi2
-
Training23
-
Hessian Approximation2
-
Decision Trees And Random Forests2
-
Open Source LLM details6
-
Evals8
-
Energy7
