Large Language Models (LLMs)

Question 1

What is a Large Language Model?

(LLM)

Answer 1

It is a type of artificial intelligence designed to understand and generate human-like text based on large amounts of text data.

LLMs are used in applications like chatbots, translation services, and content creation.

Question 2

What does the architecture of LLMs primarily rely on?

Answer 2

transformers

Transformers are a type of neural network architecture that improves the handling of sequential data and parallel processing.

Question 3

What is a transformer in the context of AI?

Answer 3

It is a neural network architecture that uses self-attention mechanisms to process and generate sequences of data efficiently.

Question 4

True or False:

Transformers are only used in language models.

Answer 4

False

Transformers are also used in various domains like image processing and protein folding predictions.

Question 5

What is the primary function of the self-attention mechanism in transformers?

Answer 5

To weigh the significance of different words in a sequence to each other, helping the model understand context and relationships.

Question 6

What does BERT stand for?

Answer 6

Bidirectional Encoder Representations from Transformers

Question 7

What is the main difference between BERT and GPT?

Answer 7

• BERT is designed for understanding the context of words in a sentence (bidirectional).
• GPT is designed for generating text (unidirectional).

BERT processes text in both directions for better understanding, whereas GPT generates text in a forward manner.

Question 8

True or False:

BERT is mainly used for text generation.

Answer 8

False

BERT is primarily used for understanding text, such as in tasks like sentiment analysis and question answering.

Question 9

What does fine-tuning mean in the context of LLMs?

Answer 9

It is the process of adapting a pre-trained language model to a specific task by training it further on a smaller, task-specific dataset.

Question 10

Why is fine-tuning important for LLMs?

Answer 10

It allows general-purpose models to be specialized for specific tasks, improving their performance on those tasks.

For example, fine-tuning can customize a model for better results in medical text analysis or customer service.

Question 11

Fill in the blank:

A common issue with LLMs is ______, where the model generates incorrect or nonsensical information.

Answer 11

hallucination

Question 12

What is hallucination in LLMs?

Answer 12

It occurs when an LLM generates information that is not based on the input data or factual reality.

Question 13

How can hallucination be mitigated in LLMs?

Answer 13

By carefully curating input data, using external verification systems, and applying techniques like reinforcement learning from human feedback.

Question 14

Which LLM type is better suited for tasks requiring deep understanding of text context?

Answer 14

BERT

BERT’s bidirectional nature makes it excellent at understanding complex text contexts.

Question 15

What is the role of the attention mechanism in transformers?

Answer 15

To focus on different parts of the input sequence, allowing the model to weigh the importance of each part when making predictions.

Question 16

True or False:

GPT is a generative model.

Answer 16

True

GPT generates new text based on input prompts, making it a powerful tool for content creation.

Question 17

In what type of tasks is GPT commonly used?

Answer 17

Text generation, such as writing essays, creating dialogues, and completing text prompts.

Question 18

Why are transformers more efficient than previous sequence models like RNNs?

Answer 18

Transformers can process data in parallel, unlike RNNs which process sequentially, making transformers faster and more scalable.

Question 19

Which model would you choose for a task that requires generating a coherent paragraph from a short prompt?

Answer 19

GPT

GPT is designed for generating fluent and coherent text based on minimal input.

Question 20

Fill in the blank:

The key innovation of transformers is the use of ______ attention.

Answer 20

self