The Document-as-Implementation Pattern Flashcards

(45 cards)

1
Q

What is the “document-as-implementation” pattern?

A

A design pattern where a human-readable document (policy/procedure) is treated as the system’s operating logic, and the agent reasons over it directly instead of relying on hardcoded rules.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

In traditional systems, what usually happens to business rules before a system can use them?

A

Humans write policies, developers interpret them, then developers translate them into code.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is “translation loss” in policy-to-code workflows?

A

Nuance and context get lost each time knowledge moves from policy document → developer understanding → code.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why do policy changes often create maintenance problems in traditional systems?

A

The document can be updated quickly, but the code stays outdated until a developer manually updates and redeploys it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are “knowledge silos” in the context of business logic?

A

Only developers can change system behavior, creating bottlenecks and dependencies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is validation difficult when policies are implemented as code?

A

It’s hard to verify whether the code truly matches the current policy documents.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

In the invoice example, what simple operation demonstrates the paradigm shift?

A

Loading the latest purchasing rules from disk at startup and letting the agent interpret them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

In the invoice example, what does the rules file represent in the new pattern?

A

The “implementation” of purchasing logic, written in human-readable form.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the key idea behind “direct use of human knowledge”?

A

Use the human document itself as the logic instead of translating it into code.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a major benefit of using documents directly instead of hardcoded policy logic?

A

The system can preserve nuance and reduce translation loss.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What does “dynamic updates without code changes” mean?

A

Updating the document changes system behavior on the next run without developer intervention or redeployment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What organizational roles benefit from document-as-implementation alignment?

A

The people who define policies (legal, compliance, finance) can maintain the documents that drive behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Why does document-as-implementation improve organizational alignment?

A

It matches how organizations naturally manage policies: domain experts update documents.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does “traceability” mean in this pattern?

A

You can identify which document (and version) the agent used to make a decision.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does “transparency” mean in this pattern?

A

Decisions can be explained by pointing to the policy text the agent referenced.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How does document-as-implementation support auditing?

A

It creates an auditable trail linking decisions to the exact policies in effect at the time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

In the example, why include a fallback rule when the file is missing?

A

To define safe default behavior if no rules are available (e.g., assume compliant).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the risk of a missing rules document without a fallback behavior?

A

The agent may fail or behave unpredictably because its decision criteria are undefined.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is meant by “the document becomes the logic”?

A

The document’s content is treated as the operational rules the agent follows.

20
Q

How can this pattern extend beyond local text files?

A

Agents can pull from knowledge bases, internal wikis, or document management systems.

21
Q

Why are knowledge bases and wikis powerful for this pattern?

A

They let agents reason over large amounts of organizational knowledge maintained by humans.

22
Q

What is the benefit of using versioned documents?

A

You can trace exactly which version of a policy was applied for any decision.

23
Q

Why is document versioning especially important for compliance?

A

Compliance often requires proving which rules were followed at a specific time.

24
Q

What is “multi-document reasoning”?

A

The agent reasons across multiple documents and reconciles information between them.

25
Why is multi-document reasoning valuable in organizations?
Real decisions often require combining rules from different sources (e.g., finance + legal + ops).
26
What are “document-guided workflows”?
Workflows where process documentation (SOPs) tells the agent what steps to take next.
27
How can SOPs drive agent behavior in this pattern?
The agent reads procedure docs and determines next steps like a human following instructions.
28
In compliance systems, what becomes the “source of truth” using this pattern?
The regulatory compliance documents themselves.
29
Why does using compliance documents as source of truth help institutions?
AI behavior stays aligned with current regulations as soon as documents are updated.
30
In healthcare, what kinds of documents can guide AI reasoning?
Clinical guidelines and hospital protocols.
31
What is a key benefit of document-as-implementation for healthcare protocols?
Systems can adapt immediately when best practices and protocols are updated.
32
In HR policy enforcement, what does the agent evaluate requests against?
The actual HR policy documents that HR maintains.
33
In customer service, what documents can improve answer consistency?
Product documentation, FAQs, and policy documents.
34
What is the first step to implementing document-as-implementation in an organization?
Identify human-readable documents that contain decision-making knowledge.
35
How should these documents be treated in the new pattern?
As interfaces between human experts and AI systems.
36
What runtime capability is required to make this pattern work?
Loading the current document versions at runtime (startup or per request).
37
Why does runtime loading matter?
It ensures the agent uses the latest rules without code changes.
38
What prompt design goal is critical when using documents as logic?
Frame the document content so the LLM can reliably reason over it.
39
Why must outputs be structured in document-as-implementation systems?
So downstream systems can process the agent’s decisions consistently.
40
What is the “paradigm shift” described by this lesson?
Moving from translating policies into code to letting AI work directly with the documents humans maintain.
41
How does this pattern reduce the gap between documentation and implementation?
Documentation no longer describes the system—documentation is the system’s rule source.
42
What is the core maintainability advantage of this pattern?
Updating a document updates behavior, reducing developer bottlenecks.
43
What is the core governance advantage of this pattern?
Domain experts can directly influence system behavior by maintaining policy documents.
44
What is the core accountability advantage of this pattern?
Decisions can be traced to specific document versions, supporting audits and transparency.
45
What is the core scaling advantage of this pattern?
Agents can reason over expanding document sets (wikis/KBs) without rewriting logic in code.