You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/src/content/docs/why-querymode.mdx
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,15 +3,15 @@ title: Why QueryMode
3
3
description: Agents are the new users. They need dynamic pipelines, not pre-built ETL.
4
4
---
5
5
6
-
## The world is changing
6
+
## Agents can't coordinate
7
7
8
-
Three things are happening at once:
8
+
Agents share the same training data and independently reach the same conclusions. They serve different owners, run in different parts of the world, and have no way to talk to each other. When thousands of agents independently decide to query the same data at the same millisecond, the result looks like a DDoS — except every request is legitimate. Thundering herds become the normal traffic pattern, not an anomaly. Data must live at the edge to survive this.
9
9
10
-
1.**Agents are becoming the majority of internet traffic.** Unlike humans, agents share the same training data and reach the same conclusions independently. They can't coordinate with each other — they serve different owners, run in different parts of the world. When thousands of agents independently decide to query the same data at the same millisecond, the result looks like a DDoS — except every request is legitimate. Thundering herds become the normal traffic pattern, not an anomaly. Data must live at the edgeto survive this.
10
+
Training data can't keep up with the speed the world produces information, so agents make API calls for live data. Because they can't coordinate, the same data gets requested independently by thousands of agents. That data needs to live at the edge, close to where agents run.
11
11
12
-
2.**Agents need live data.** Training data can't keep up with the speed the world produces information. Agents will make API calls — lots of them. And because they can't coordinate (they're not a hive mind), the same data gets requested independently by thousands of agents. That data needs to live at the edge, close to where agents run.
12
+
## Pre-built ETL can't serve agents
13
13
14
-
3.**Pre-built ETL can't serve agents.**Traditional data pipelines assume a human pre-defines what questions matter, builds a pipeline on a schedule, and stores the results. Agents don't ask pre-defined questions. They chain queries in ways no pipeline designer anticipated — funnel analysis, then retention for just those users, then attribution for just those retained users. The pipeline doesn't exist until the agent creates it.
14
+
Traditional data pipelines assume a human pre-defines what questions matter, builds a pipeline on a schedule, and stores the results. Agents don't ask pre-defined questions. They chain queries in ways no pipeline designer anticipated — funnel analysis, then retention for just those users, then attribution for just those retained users. The pipeline doesn't exist until the agent creates it.
15
15
16
16
## Fixed ETL vs dynamic pipelines
17
17
@@ -58,7 +58,7 @@ Three analyses on one result set. No SQL string construction, no JSON parsing, n
58
58
59
59
## What we've tested so far
60
60
61
-
We ported query patterns from two open-source analytics platforms to see where dynamic pipelines help and where they don't:
61
+
We ported query patterns from two open-source analytics platforms:
62
62
63
63
**[Counterscale](https://github.com/benvinegar/counterscale)** (Cloudflare Analytics Engine) — 7 query patterns. Each one normally goes through Analytics Engine's HTTP SQL API with JSON serialization per request. The same patterns run on QueryMode's DataFrame API without that overhead.
64
64
@@ -68,4 +68,4 @@ Both test suites also include multi-step analyses that would be awkward with the
68
68
69
69
## The agent IS the pipeline
70
70
71
-
QueryMode doesn't eliminate transformation. It moves it from a pre-built schedule to query time. The agent decides what to query, how to transform it, and what to do with the result — all in the same code, all at the edge, all without waiting for a pipeline that someone built last quarter.
71
+
QueryMode doesn't eliminate transformation. It moves it from a pre-built schedule to query time. The agent decides what to query, how to transform it, and what to do with the result — all in the same code, same process. If the data is well-structured, the agent queries it directly. If it's not, the agent builds the transformation on the spot. Either way, no one had to anticipate the question in advance.
0 commit comments