| title | Overview |
|---|---|
| id | overview |
Welcome to the TanStack DB documentation.
TanStack DB is a reactive client store for building super fast apps on sync. It extends TanStack Query with collections, live queries and optimistic mutations.
- How it works — understand the TanStack DB development model and how the pieces fit together
- API reference — for the primitives and function interfaces
- Usage examples — examples of common usage patterns
- More info — where to find support and more information
TanStack DB works by:
- defining collections typed sets of objects that can be populated with data
- using live queries to query data from/across collections
- making optimistic mutations using transactional mutators
// Define collections to load data into
const todoCollection = createCollection({
// ...your config
onUpdate: updateMutationFn
})
const Todos = () => {
// Bind data using live queries
const { data: todos } = useLiveQuery((query) =>
query
.from({ todoCollection })
.where('@completed', '=', false)
)
const complete = (todo) => {
// Instantly applies optimistic state
todoCollection.update(todo.id, (draft) => {
draft.completed = true
})
}
return (
<ul>
{todos.map(todo =>
<li key={ todo.id } onClick={() => complete(todo) }>
{ todo.text }
</li>
)}
</ul>
)
}Collections are typed sets of objects that can be populated with data. They're designed to de-couple loading data into your app from binding data to your components.
Collections can be populated in many ways, including:
- fetching data, for example from API endpoints using TanStack Query
- syncing data, for example using a sync engine like ElectricSQL
- storing local data, for example using localStorage for user preferences and settings or in-memory client data or UI state
- from live collection queries, creating derived collections as materialised views
Once you have your data in collections, you can query across them using live queries in your components.
Live queries are used to query data out of collections. Live queries are reactive: when the underlying data changes in a way that would affect the query result, the result is incrementally updated and returned from the query, triggering a re-render.
TanStack DB live queries are implemented using d2ts, a Typescript implementation of differential dataflow. This allows the query results to update incrementally (rather than by re-running the whole query). This makes them blazing fast, usually sub-millisecond, even for highly complex queries.
Live queries support joins across collections. This allows you to:
- load normalised data into collections and then de-normalise it through queries; simplifying your backend by avoiding the need for bespoke API endpoints that match your client
- join data from multiple sources; for example, syncing some data out of a database, fetching some other data from an external API and then joining these into a unified data model for your front-end code
Every query returns another collection which can also be queried.
Collections support insert, update and delete operations. When called, by default they trigger the corresponding onInsert, onUpdate, onDelete handlers which are responsible for writing the mutation to the backend.
// Define collection with persistence handlers
const todoCollection = createCollection({
id: "todos",
// ... other config
onUpdate: async ({ transaction }) => {
const {original, changes} = transaction.mutations[0]
await api.todos.update(original.id, changes)
},
})
// Immediately applies optimistic state
todoCollection.update(todo.id, (draft) => {
draft.completed = true
})Rather than mutating the collection data directly, the collection internally treats its synced/loaded data as immutable and maintains a separate set of local mutations as optimistic state. When live queries read from the collection, they see a local view that overlays the local optimistic mutations on-top-of the immutable synced data.
The optimistic state is held until the onUpdate (in this case) handler resolves - at which point the data is persisted to the server and synced back to the local collection.
If the handler throws an error, the optimistic state is rolled back.
Mutations are based on a Transaction primitive.
For simple state changes, directly mutating the collection and persisting with the operator handlers is enough.
But for more complex use cases, you can directly create custom actions with createOptimisticAction or custom transactions with createTransaction. This lets you do things such as do transactions with multiple mutations across multiple collections, do chained transactions w/ intermediate rollbacks, etc.
For example, in the following code, the mutationFn first sends the write to the server using await api.todos.update(updatedTodo) and then calls await collection.refetch() to trigger a re-fetch of the collection contents using TanStack Query. When this second await resolves, the collection is up-to-date with the latest changes and the optimistic state is safely discarded.
const updateTodo = createOptimisticAction<{id: string}>({
onMutate,
mutationFn: async ({ transaction }) => {
const { collection, modified: updatedTodo } = transaction.mutations[0]
await api.todos.update(updatedTodo)
await collection.refetch()
},
})This combines to support a model of uni-directional data flow, extending the redux/flux style state management pattern beyond the client, to take in the server as well:
With an instant inner loop of optimistic state, superseded in time by the slower outer loop of persisting to the server and syncing the updated server state back into the collection.
There are a number of built-in collection types implemented in @tanstack/db-collections:
QueryCollectionto load data into collections using TanStack QueryElectricCollectionto sync data into collections using ElectricSQLLocalStorageCollectionfor small amounts of local-only state that syncs across browser tabs- [WIP]
LocalOnlyCollectionfor in-memory client data or UI state
You can also use:
- use live collection queries to derive collections from other collections
- the base Collection to define your own collection types
All collections optionally support a schema.
If provided, this must be a Standard Schema compatible schema instance, such as a Zod or Effect schema.
The collection will use the schema for its type so if you provide a schema, you can't also pass in an explicit
type (e.g. createCollection<Todo>()).
TanStack Query fetches data using managed queries. Use queryCollectionOptions to fetch data into a collection using TanStack Query:
const todoCollection = createCollection(queryCollectionOptions({
queryKey: ['todoItems'],
queryFn: async () => fetch('/api/todos'),
getKey: (item) => item.id,
schema: todoSchema // any standard schema
}))The collection will be populated with the query results.
Electric is a read-path sync engine for Postgres. It allows you to sync subsets of data out of a Postgres database, through your API, into a TanStack DB collection.
Electric's main primitive for sync is a Shape. Use electricCollectionOptions to sync a shape into a collection:
import { createCollection } from '@tanstack/react-db'
import { electricCollectionOptions } from '@tanstack/db-collections'
export const todoCollection = createCollection(electricCollectionOptions({
id: 'todos',
shapeOptions: {
url: 'https://example.com/v1/shape',
params: {
table: 'todos'
}
},
getKey: (item) => item.id,
schema: todoSchema
}))The Electric collection requires two Electric-specific options:
shapeOptions— the Electric ShapeStreamOptions that define the Shape to sync into the collection; this includes theurlto your sync engine; andparamsto specify thetableto sync and any optionalwhereclauses, etc.
getKey— identifies the id for the rows being synced into the collection
When you create the collection, sync starts automatically.
Electric shapes allow you to filter data using where clauses:
export const myPendingTodos = createCollection(electricCollectionOptions({
id: 'todos',
shapeOptions: {
url: 'https://example.com/v1/shape',
params: {
table: 'todos',
where: `
status = 'pending'
AND
user_id = '${user.id}'
`
}
},
getKey: (item) => item.id,
schema: todoSchema
}))Tip
Shape where clauses, used to filter the data you sync into ElectricCollections, are different from the live queries you use to query data in components.
Live queries are much more expressive than shapes, allowing you to query across collections, join, aggregate, etc. Shapes just contain filtered database tables and are used to populate the data in a collection.
If you need more control over what data syncs into the collection, Electric allows you to use your API as a proxy to both authorize and filter data.
See the Electric docs for more information.
localStorage collections store small amounts of local-only state that persists across browser sessions and syncs across browser tabs in real-time. All data is stored under a single localStorage key and automatically synchronized using storage events.
Use localStorageCollectionOptions to create a collection that stores data in localStorage:
import { createCollection } from '@tanstack/react-db'
import { localStorageCollectionOptions } from '@tanstack/db-collections'
export const userPreferencesCollection = createCollection(localStorageCollectionOptions({
id: 'user-preferences',
storageKey: 'app-user-prefs', // localStorage key
getKey: (item) => item.id,
schema: userPrefsSchema
}))The localStorage collection requires:
storageKey— the localStorage key where all collection data is storedgetKey— identifies the id for items in the collection
Mutation handlers (onInsert, onUpdate, onDelete) are completely optional. Data will persist to localStorage whether or not you provide handlers. You can provide alternative storage backends like sessionStorage or custom implementations that match the localStorage API.
export const sessionCollection = createCollection(localStorageCollectionOptions({
id: 'session-data',
storageKey: 'session-key',
storage: sessionStorage, // Use sessionStorage instead
getKey: (item) => item.id
}))Tip
localStorage collections are perfect for user preferences, UI state, and other data that should persist locally but doesn't need server synchronization. For server-synchronized data, use QueryCollection or ElectricCollection instead.
This is WIP. Track progress at #79.
LocalOnly collections will be designed for in-memory client data or UI state that doesn't need to persist across browser sessions or sync across tabs.
Live queries return collections. This allows you to derive collections from other collections.
For example:
import { compileQuery, queryBuilder } from "@tanstack/db"
// Imagine you have a collections of todos.
const todoCollection = createCollection({
// config
})
// You can derive a new collection that's a subset of it.
const query = queryBuilder()
.from({ todoCollection })
.where('@completed', '=', true)
const compiled = compileQuery(query)
compiled.start()
const completedTodoCollection = compiledQuery.results()This also works with joins to derive collections from multiple source collections. And it works recursively -- you can derive collections from other derived collections. Changes propagate efficiently using differential dataflow and it's collections all the way down.
There is a base Collection class in ../packages/db/src/collection.ts. You can use this directly or as a base class for implementing your own collection types.
See the existing implementations in ../packages/db-collections for reference.
Use the useLiveQuery hook to assign live query results to a state variable in your React components:
import { useLiveQuery } from '@tanstack/react-db'
const Todos = () => {
const { data: todos } = useLiveQuery(query =>
query
.from({ todoCollection })
.where('@completed', '=', false)
.orderBy({'@created_at': 'asc'})
.select('@id', '@text')
)
return <List items={ todos } />
}You can also query across collections with joins:
import { useLiveQuery } from '@tanstack/react-db'
const Todos = () => {
const { data: todos } = useLiveQuery(query =>
query
.from({ todos: todoCollection })
.join({
type: `inner`,
from: { lists: listCollection },
on: [`@lists.id`, `=`, `@todos.listId`],
})
.where('@lists.active', '=', true)
.select(`@todos.id`, `@todos.title`, `@lists.name`)
)
return <List items={ todos } />
}You can also build queries directly (outside of the component lifecycle) using the underlying queryBuilder API:
import { compileQuery, queryBuilder } from "@tanstack/db"
const query = queryBuilder()
.from({ todoCollection })
.where('@completed', '=', true)
const compiled = compileQuery(query)
compiled.start()
const results = compiledQuery.results()Note also that:
- the query results are themselves a collection
- the
useLiveQueryautomatically starts and stops live query subscriptions when you mount and unmount your components; if you're creating queries manually, you need to manually manage the subscription lifecycle yourself
See the query-builder tests for many more usage examples.
Transactional mutators allow you to batch and stage local changes across collections with:
- immediate application of local optimistic updates
- flexible mutationFns to handle writes, with automatic rollbacks and management of optimistic state
Mutators are created with a mutationFn. You can define a single, generic mutationFn for your whole app. Or you can define collection or mutation specific functions.
The mutationFn is responsible for handling the local changes and processing them, usually to send them to a server or database to be stored, e.g.:
import type { MutationFn } from '@tanstack/react-db'
const mutationFn: MutationFn = async ({ transaction }) => {
const response = await api.todos.create(transaction.mutations)
if (!response.ok) {
// Throwing an error will rollback the optimistic state.
throw new Error(`HTTP Error: ${response.status}`)
}
const result = await response.json()
// Wait for the transaction to be synced back from the server
// before discarding the optimistic state.
const collection: Collection = transaction.mutations[0].collection
await collection.refetch()
}Use createOptimisticAction with your mutationFn and onMutate functions to create an action that you can use to mutate data in your components in fully custom ways:
import { createOptimisticAction } from '@tanstack/react-db'
// Create the `addTodo` action, passing in your `mutationFn` and `onMutate`.
const addTodo = createOptimisticAction<string>({
onMutate: (text) => {
// Instantly applies the local optimistic state.
todoCollection.insert({
id: uuid(),
text,
completed: false
})
},
mutationFn: async (text) => {
// Persist the todo to your backend
const response = await fetch('/api/todos', {
method: 'POST',
body: JSON.stringify({ text, completed: false }),
})
return response.json()
}
})
const Todo = () => {
const handleClick = () => {
// Triggers the onMutate and then the mutationFn
addTodo('🔥 Make app faster')
}
return <Button onClick={ handleClick } />
}By manually creating transactions, you can fully control their lifecycles and behaviors. createOptimisticAction is a ~25 line
function which implements a common transaction pattern. Feel free to invent your own patterns!
Here's one way you could use transactions.
import { createTransaction } from "@tanstack/react-db"
const addTodoTx = createTransaction({
autoCommit: false,
mutationFn: async ({ transaction }) => {
// Persist data to backend
await Promise.all(transaction.mutations.map(mutation => {
return await api.saveTodo(mutation.modified)
})
},
})
// Apply first change
addTodoTx.mutate(() => todoCollection.insert({ id: '1', text: 'First todo', completed: false }))
// user reviews change
// Apply another change
addTodoTx.mutate(() => todoCollection.insert({ id: '2', text: 'Second todo', completed: false }))
// User decides to save and we call .commit() and the mutations are persisted to the backend.
addTodoTx.commit()Transactions progress through the following states:
pending: Initial state when a transaction is created and optimistic mutations can be appliedpersisting: Transaction is being persisted to the backendcompleted: Transaction has been successfully persisted and any backend changes have been synced back.failed: An error was thrown while persisting or syncing back the Transaction
Collections support insert, update and delete operations.
// Insert a single item
myCollection.insert({ text: "Buy groceries", completed: false })
// Insert multiple items
insert([
{ text: "Buy groceries", completed: false },
{ text: "Walk dog", completed: false },
])
// Insert with custom key
insert({ text: "Buy groceries" }, { key: "grocery-task" })We use a proxy to capture updates as immutable draft optimistic updates.
// Update a single item
update(todo.id, (draft) => {
draft.completed = true
})
// Update multiple items
update([todo1.id, todo2.id], (drafts) => {
drafts.forEach((draft) => {
draft.completed = true
})
})
// Update with metadata
update(todo.id, { metadata: { reason: "user update" } }, (draft) => {
draft.text = "Updated text"
})// Delete a single item
delete(todo.id)
// Delete multiple items
delete([todo1.id, todo2.id])
// Delete with metadata
delete(todo.id, { metadata: { reason: "completed" } })Here we illustrate two common ways of using TanStack DB:
- using TanStack Query with an existing REST API
- using the ElectricSQL sync engine with a generic ingestion endpoint
Tip
You can combine these patterns. One of the benefits of TanStack DB is that you can integrate different ways of loading data and handling mutations into the same app. Your components don't need to know where the data came from or goes.
You can use TanStack DB with your existing REST API via TanStack Query.
The steps are to:
- create
QueryCollections that load data using TanStack Query - implement
mutationFns that handle mutations by posting them to your API endpoints
import { useLiveQuery, createCollection } from "@tanstack/react-db"
import { queryCollectionOptions } from "@tanstack/db-collections"
// Load data into collections using TanStack Query.
// It's common to define these in a `collections` module.
const todoCollection = createCollection<Todo>(queryCollectionOptions({
queryKey: ["todos"],
queryFn: async () => fetch("/api/todos"),
getKey: (item) => item.id,
schema: todoSchema, // any standard schema
onInsert: ({ transaction }) => {
const { changes: newTodo } = transaction.mutations[0]
// Handle the local write by sending it to your API.
await api.todos.create(newTodo)
}
// also add onUpdate, onDelete as needed.
}))
const listCollection = createCollection<TodoList>(queryCollectionOptions({
queryKey: ["todo-lists"],
queryFn: async () => fetch("/api/todo-lists"),
getKey: (item) => item.id,
schema: todoListSchema
onInsert: ({ transaction }) => {
const { changes: newTodo } = transaction.mutations[0]
// Handle the local write by sending it to your API.
await api.todoLists.create(newTodo)
}
// also add onUpdate, onDelete as needed.
}))
const Todos = () => {
// Read the data using live queries. Here we show a live
// query that joins across two collections.
const { data: todos } = useLiveQuery((query) =>
query
.from({ t: todoCollection })
.join({
type: 'inner',
from: { l: listCollection },
on: [`@l.id`, `=`, `@t.list_id`]
})
.where('@l.active', '=', true)
.select('@t.id', '@t.text', '@t.status', '@l.name')
)
// ...
}This pattern allows you to extend an existing TanStack Query application, or any application built on a REST API, with blazing fast, cross-collection live queries and local optimistic mutations with automatically managed optimistic state.
One of the most powerful ways of using TanStack DB is with a sync engine, for a fully local-first experience with real-time sync. This allows you to incrementally adopt sync into an existing app, whilst still handling writes with your existing API.
Here, we illustrate this pattern using ElectricSQL as the sync engine.
import type { Collection } from '@tanstack/db'
import type { MutationFn, PendingMutation, createCollection } from '@tanstack/react-db'
import { electricCollectionOptions } from '@tanstack/db-collections'
export const todoCollection = createCollection(electricCollectionOptions<Todo>({
id: 'todos',
schema: todoSchema,
// Electric syncs data using "shapes". These are filtered views
// on database tables that Electric keeps in sync for you.
shapeOptions: {
url: 'https://api.electric-sql.cloud/v1/shape',
params: {
table: 'todos'
}
},
getKey: (item) => item.id,
schema: todoSchema
onInsert: ({ transaction }) => {
const response = await api.todos.create(transaction.mutations[0].modified)
return { txid: response.txid}
}
// You can also implement onUpdate, onDelete as needed.
}))
const AddTodo = () => {
return (
<Button
onClick={() =>
todoCollection.insert({ text: "🔥 Make app faster" })
}
/>
)
}If you have questions / need help using TanStack DB, let us know on the Discord or start a GitHub discussion: