From 6c30ce89e843bf469452b9ab8edefc3139345fb8 Mon Sep 17 00:00:00 2001 From: Mark Hulbert <39801222+m-hulbert@users.noreply.github.com> Date: Mon, 12 Jan 2026 15:24:03 +0100 Subject: [PATCH 1/8] Add an overview page for AI Transport --- src/data/nav/aitransport.ts | 11 +- src/pages/docs/ai-transport/index.mdx | 161 +++++++++++++++++++++++++- 2 files changed, 162 insertions(+), 10 deletions(-) diff --git a/src/data/nav/aitransport.ts b/src/data/nav/aitransport.ts index e049109ea2..517d77459a 100644 --- a/src/data/nav/aitransport.ts +++ b/src/data/nav/aitransport.ts @@ -9,14 +9,9 @@ export default { }, content: [ { - name: 'Introduction', - pages: [ - { - name: 'About AI Transport', - link: '/docs/ai-transport', - index: true, - }, - ], + name: 'About AI Transport', + link: '/docs/ai-transport', + index: true, }, { name: 'Token streaming', diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index fb2f2b271e..b9dd0961b8 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -1,6 +1,163 @@ --- title: About AI Transport +intro: "Ably AI Transport is a drop-in infrastructure layer that upgrades your AI streams into bi-directional, stateful experiences. It enables you to build multi-device, steerable AI applications that are agent agnostic, incredibly resilient and highly scalable." meta_description: "Learn more about Ably's AI Transport and the features that enable you to quickly build functionality into new and existing applications." -redirect_from: - - /docs/products/ai-transport --- + +Regardless of whether you're building with OpenAI, Anthropic or Vercel, AI Transport enables you to add a realtime delivery layer to your application, providing the infrastructure required to deliver modern, stateful AI experiences to users. + +AI Transport runs on Ably's [fault-tolerant](/docs/platform/architecture/fault-tolerance) and highly-available platform. The platform enables data to be streamed between all internet-connected devices at [low latencies](/docs/platform/architecture/latency) across the globe. Its elastic global infrastructure delivers enterprise-scale messaging that [effortlessly scales](/docs/platform/architecture/platform-scalability) to meet demand. + +Drop AI Transport into your applications to transform them into modern, bi-directional AI experiences that keep users engaged. AI Transport provides the building blocks to deliver reliable, resumable token streams with robust session management and state hydration to always keep your users and agents in sync. + +![Before and after adding AI Transport](../../../images/content/diagrams/ai-transport-before-and-after.png) + +## Get started + +Start learning the basics of AI Transport right away with a getting started guide using your agent and framework of choice: + +### OpenAI + + +{[ + { + title: 'JavaScript', + description: 'Start building with OpenAI', + image: 'icon-tech-javascript', + link: '', + }, + { + title: 'Python', + description: 'Start building with Open AI', + image: 'icon-tech-python', + link: '', + }, +]} + + +### Anthropic + + +{[ + { + title: 'JavaScript', + description: 'Start building with Anthropic', + image: 'icon-tech-javascript', + link: '', + }, + { + title: 'Python', + description: 'Start building with Anthropic', + image: 'icon-tech-python', + link: '', + }, +]} + + +### LangChain + + +{[ + { + title: 'JavaScript', + description: 'Start building with LangChain', + image: 'icon-tech-javascript', + link: '', + }, + { + title: 'Python', + description: 'Start building with LangChain', + image: 'icon-tech-python', + link: '', + }, +]} + + +### Vercel AI + + +{[ + { + title: 'JavaScript', + description: 'Start building with Vercel AI', + image: 'icon-tech-javascript', + link: '', + }, + { + title: 'Python', + description: 'Start building with Vercel AI', + image: 'icon-tech-python', + link: '', + }, +]} + + + +## Features + +AI Transport provides a range of features that extend the existing functionality of Ably's Pub/Sub product to enable you to deliver reliable, stateful AI experiences, that provide the first class UX that your users expect from modern applications. + +### Token streaming + +Token streaming is the core of how LLMs deliver their responses to users. Tokens are progressively streamed to users from your LLM so that users don't need to wait for a complete response before seeing any output. + +Using AI Transport, your token streams are reliable and persistent. They survive modern environments where users change browser tabs, refresh the page or switch devices, and common interruptions such as temporary network loss. Your users can always reconnect and continue where they left off without having to start over. + +[Read more about token streams](/docs/ai-transport/features/token-streaming). + +### Session management + +AI Transport ensures that communication between your users and agents is always available. + +Communication shouldn't be tied to the connection state of either party. If a user goes offline or their connection drops, they should be able to continue their session without losing context. AI Transport provides robust session management by enabling users and agents to connect independently of one another. + +Your users can start a conversation on their mobile and seamlessly continue it on their desktop. Similarly, multiple users can participate in the same conversation with a single agent and they will all remain in sync, in realtime. + +[Read more about session management](/docs/ai-transport/features/session-management). + +### State hydration + +AI Transport benefits from all the functionality of Ably's platform. One of the key features for AI Transport is message history; enabling users and agents to retrieve the state of their conversation at any point in time. + +Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport ensures that the state of the conversation is always hydrated with both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. + +[Read more about state hydration](/docs/ai-transport/features/token-streaming/message-per-response#hydration). + +### State-aware applications + +Utilizing Ably's presence feature, AI Transport enables your applications to be state-aware. + +Users can work asynchronously by prompting an agent to perform a task and not having to monitor its progress. They can go offline and receive a push notification when the agent has completed the task. Equally, they can return to the application at any point and view the latest session state thanks to [state hydration](#hydration). + +It also puts you in control of how you want to manage your application when there aren't any users online. For example, you can choose if you want to pause a conversation when a user exits their browser tab, or if you want to continue the conversation so that the agent can complete its response and the user can view it later. + +[Read more about status-aware cost controls](/docs/ai-transport/features/sessions-identity/online-status). + +### Enterprise controls + +Ably's platform provides [integrations](/docs/platform/integrations) and functionality to ensure that your applications always exceed the requirements of enterprise environments. Whether that's [message auditing](/docs/platform/integrations/streaming), [client identification](/docs/auth/identified-clients) or [granular access controls](/docs/auth/capabilities). + +## Examples + +Take a look at some example code running in-browser of the sorts of features you can build with AI Transport underpinning your applications: + + +{[ + { + title: 'Token streaming with Anthropic', + description: 'Start building with Anthropic', + image: 'icon-tech-react', + link: '', + }, + { + title: 'Token streaming with OpenAI', + description: 'Start building with OpenAI', + image: 'icon-tech-react', + link: '', + }, +]} + + +## Pricing + +// Todo From a685a2d5676b3ca4b49d864dd8874fc426335688 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 14:58:42 +0000 Subject: [PATCH 2/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index b9dd0961b8..9b80952125 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -135,7 +135,7 @@ It also puts you in control of how you want to manage your application when ther ### Enterprise controls -Ably's platform provides [integrations](/docs/platform/integrations) and functionality to ensure that your applications always exceed the requirements of enterprise environments. Whether that's [message auditing](/docs/platform/integrations/streaming), [client identification](/docs/auth/identified-clients) or [granular access controls](/docs/auth/capabilities). +Ably's platform provides [integrations](/docs/platform/integrations) and functionality to ensure that your applications always exceed the requirements of enterprise environments. Whether that's [message auditing](/docs/platform/integrations/streaming), [client identification](/docs/auth/identified-clients) or [fine-grained authorization](/docs/auth/capabilities). ## Examples From 5882cb618a62de716ef49e76f58e8a53679f4f09 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 15:05:43 +0000 Subject: [PATCH 3/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 64 ++++++--------------------- 1 file changed, 13 insertions(+), 51 deletions(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 9b80952125..41a12bdd82 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -21,73 +21,35 @@ Start learning the basics of AI Transport right away with a getting started guid {[ { - title: 'JavaScript', - description: 'Start building with OpenAI', + title: 'Message-per-response', + description: 'Stream OpenAI responses using message appends', image: 'icon-tech-javascript', - link: '', + link: '/docs/guides/ai-transport/openai-message-per-response', }, { - title: 'Python', - description: 'Start building with Open AI', - image: 'icon-tech-python', - link: '', - }, -]} - - -### Anthropic - - -{[ - { - title: 'JavaScript', - description: 'Start building with Anthropic', + title: 'Message-per-token', + description: 'Stream OpenAI responses using individual token messages', image: 'icon-tech-javascript', - link: '', - }, - { - title: 'Python', - description: 'Start building with Anthropic', - image: 'icon-tech-python', - link: '', + link: '/docs/guides/ai-transport/openai-message-per-token', }, ]} -### LangChain +### Anthropic {[ { - title: 'JavaScript', - description: 'Start building with LangChain', + title: 'Message-per-response', + description: 'Stream Anthropic responses using message appends', image: 'icon-tech-javascript', - link: '', - }, - { - title: 'Python', - description: 'Start building with LangChain', - image: 'icon-tech-python', - link: '', + link: '/docs/guides/ai-transport/anthropic-message-per-response', }, -]} - - -### Vercel AI - - -{[ { - title: 'JavaScript', - description: 'Start building with Vercel AI', + title: 'Message-per-token', + description: 'Stream Anthropic responses using individual token messages', image: 'icon-tech-javascript', - link: '', - }, - { - title: 'Python', - description: 'Start building with Vercel AI', - image: 'icon-tech-python', - link: '', + link: '/docs/guides/ai-transport/anthropic-message-per-token', }, ]} From 6e08789c9ca812bd2a193eb8d7e4a6a518fd3afb Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 15:12:22 +0000 Subject: [PATCH 4/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 41a12bdd82..6e2dff0b79 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -57,7 +57,7 @@ Start learning the basics of AI Transport right away with a getting started guid ## Features -AI Transport provides a range of features that extend the existing functionality of Ably's Pub/Sub product to enable you to deliver reliable, stateful AI experiences, that provide the first class UX that your users expect from modern applications. +AI Transport provides a range of features built on Ably's highly-scalable realtime platform to enable you to deliver reliable, stateful AI experiences that provide the first-class UX your users expect from modern applications. ### Token streaming From 7eb9869445cdd4c85fa5332d71be5f215ba61695 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 15:16:09 +0000 Subject: [PATCH 5/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 6e2dff0b79..382e97ee03 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -79,7 +79,7 @@ Your users can start a conversation on their mobile and seamlessly continue it o ### State hydration -AI Transport benefits from all the functionality of Ably's platform. One of the key features for AI Transport is message history; enabling users and agents to retrieve the state of their conversation at any point in time. +AI Transport benefits from all the functionality of Ably's platform. One of the key features for AI Transport is the ability to hydrate conversation and session state from the channel (for example, via message history). Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport ensures that the state of the conversation is always hydrated with both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. From abb251390a68425a712f5a018b84b676d2b30b83 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 15:23:52 +0000 Subject: [PATCH 6/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 24 ++++++++++++++++++------ 1 file changed, 18 insertions(+), 6 deletions(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 382e97ee03..43bb635a80 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -106,16 +106,28 @@ Take a look at some example code running in-browser of the sorts of features you {[ { - title: 'Token streaming with Anthropic', - description: 'Start building with Anthropic', + title: 'Message per response streaming', + description: 'Stream individual tokens from AI models into a single message.', + image: 'icon-tech-javascript', + link: '/examples/ai-transport-message-per-response?lang=javascript', + }, + { + title: 'Message per response streaming', + description: 'Stream individual tokens from AI models into a single message.', image: 'icon-tech-react', - link: '', + link: '/examples/ai-transport-message-per-response?lang=react', + }, + { + title: 'Message per token streaming', + description: 'Stream individual tokens from AI models as separate messages.', + image: 'icon-tech-javascript', + link: '/examples/ai-transport-message-per-token?lang=javascript', }, { - title: 'Token streaming with OpenAI', - description: 'Start building with OpenAI', + title: 'Message per token streaming', + description: 'Stream individual tokens from AI models as separate messages.', image: 'icon-tech-react', - link: '', + link: '/examples/ai-transport-message-per-token?lang=react', }, ]} From be92c4101b23923a6b77da9722794ef974f65ba6 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 15:25:57 +0000 Subject: [PATCH 7/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 43bb635a80..90f130a268 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -81,7 +81,7 @@ Your users can start a conversation on their mobile and seamlessly continue it o AI Transport benefits from all the functionality of Ably's platform. One of the key features for AI Transport is the ability to hydrate conversation and session state from the channel (for example, via message history). -Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport ensures that the state of the conversation is always hydrated with both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. +Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport enables a client to be hydrated with the state of the conversation, including both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. [Read more about state hydration](/docs/ai-transport/features/token-streaming/message-per-response#hydration). @@ -91,7 +91,7 @@ Utilizing Ably's presence feature, AI Transport enables your applications to be Users can work asynchronously by prompting an agent to perform a task and not having to monitor its progress. They can go offline and receive a push notification when the agent has completed the task. Equally, they can return to the application at any point and view the latest session state thanks to [state hydration](#hydration). -It also puts you in control of how you want to manage your application when there aren't any users online. For example, you can choose if you want to pause a conversation when a user exits their browser tab, or if you want to continue the conversation so that the agent can complete its response and the user can view it later. +It also puts you in control of how you manage your application when there aren't any users online. For example, you can choose whether to pause a conversation when a user exits their browser tab, or to continue the conversation so that the agent can complete its response so the user can view it later. [Read more about status-aware cost controls](/docs/ai-transport/features/sessions-identity/online-status). From 2e64bf1dd561c08bca21e126f76b9b2e33eb99b0 Mon Sep 17 00:00:00 2001 From: Mike Christensen Date: Thu, 15 Jan 2026 16:31:11 +0000 Subject: [PATCH 8/8] fixup! Add an overview page for AI Transport --- src/pages/docs/ai-transport/index.mdx | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/src/pages/docs/ai-transport/index.mdx b/src/pages/docs/ai-transport/index.mdx index 90f130a268..84603aafd4 100644 --- a/src/pages/docs/ai-transport/index.mdx +++ b/src/pages/docs/ai-transport/index.mdx @@ -4,7 +4,7 @@ intro: "Ably AI Transport is a drop-in infrastructure layer that upgrades your A meta_description: "Learn more about Ably's AI Transport and the features that enable you to quickly build functionality into new and existing applications." --- -Regardless of whether you're building with OpenAI, Anthropic or Vercel, AI Transport enables you to add a realtime delivery layer to your application, providing the infrastructure required to deliver modern, stateful AI experiences to users. +AI Transport enables you to add a realtime delivery layer to your application, providing the infrastructure required to deliver modern, stateful AI experiences to users. It works seamlessly with any AI model or framework, such as OpenAI, Anthropic, Vercel or LangChain. AI Transport runs on Ably's [fault-tolerant](/docs/platform/architecture/fault-tolerance) and highly-available platform. The platform enables data to be streamed between all internet-connected devices at [low latencies](/docs/platform/architecture/latency) across the globe. Its elastic global infrastructure delivers enterprise-scale messaging that [effortlessly scales](/docs/platform/architecture/platform-scalability) to meet demand. @@ -65,11 +65,11 @@ Token streaming is the core of how LLMs deliver their responses to users. Tokens Using AI Transport, your token streams are reliable and persistent. They survive modern environments where users change browser tabs, refresh the page or switch devices, and common interruptions such as temporary network loss. Your users can always reconnect and continue where they left off without having to start over. -[Read more about token streams](/docs/ai-transport/features/token-streaming). +[Read more about token streaming](/docs/ai-transport/features/token-streaming). ### Session management -AI Transport ensures that communication between your users and agents is always available. +AI Transport enables durable sessions that persist beyond the lifetime of individual connections, allowing users and agents to connect and disconnect independently. Communication shouldn't be tied to the connection state of either party. If a user goes offline or their connection drops, they should be able to continue their session without losing context. AI Transport provides robust session management by enabling users and agents to connect independently of one another. @@ -79,19 +79,19 @@ Your users can start a conversation on their mobile and seamlessly continue it o ### State hydration -AI Transport benefits from all the functionality of Ably's platform. One of the key features for AI Transport is the ability to hydrate conversation and session state from the channel (for example, via message history). +AI Transport enables clients to hydrate conversation and session state from the channel, including message history and in-progress responses. -Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport enables a client to be hydrated with the state of the conversation, including both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. +Whether a user is briefly disconnected when they drive through a tunnel, or they're rejoining a conversation the following day of work, AI Transport allows clients to resynchronise the full conversation state, including both historical messages and in-progress responses. Your users are always up to date with the full conversation, in order, anywhere. [Read more about state hydration](/docs/ai-transport/features/token-streaming/message-per-response#hydration). ### State-aware applications -Utilizing Ably's presence feature, AI Transport enables your applications to be state-aware. +AI Transport enables your applications to be state-aware through realtime presence tracking. Users can work asynchronously by prompting an agent to perform a task and not having to monitor its progress. They can go offline and receive a push notification when the agent has completed the task. Equally, they can return to the application at any point and view the latest session state thanks to [state hydration](#hydration). -It also puts you in control of how you manage your application when there aren't any users online. For example, you can choose whether to pause a conversation when a user exits their browser tab, or to continue the conversation so that the agent can complete its response so the user can view it later. +It also puts you in control of how you manage your application when there aren't any users online. For example, you can choose whether to pause a conversation when a user exits their browser tab, or allow the agent to complete its response for the user to view when they return. [Read more about status-aware cost controls](/docs/ai-transport/features/sessions-identity/online-status).