Skip to content

Multiversion Concurrency Control (MVCC) API for TypeScript

License

Notifications You must be signed in to change notification settings

izure1/mvcc-api

Repository files navigation

Node.js workflow

mvcc-api

Multiversion Concurrency Control (MVCC) API for TypeScript.

It implements Snapshot Isolation and supports synchronous/asynchronous operations and flexible nested transactions.

Key Features

Feature Description
MVCC Support Prevents blocking between reads/writes via Snapshot Isolation
Strict Isolation Children can only see data committed by their parents
Reusable Root Root transaction can be committed multiple times
Conflict Detection Automatic conflict detection between transactions modifying the same key
Result Tracking Returns list of created/updated/deleted keys and data upon commit/rollback

Why mvcc-api?

It easily and powerfully solves complex concurrency problems that are difficult to handle with simple file I/O or data manipulation.

  1. High-Performance Non-blocking Reads

    • Read operations do not wait even if write operations are in progress.
    • Snapshot Isolation always provides data from a consistent point in time.
  2. Perfect Atomicity (All-or-Nothing)

    • Bundles changes to multiple files or data into a single transaction.
    • If it fails midway, all changes are cleanly cancelled. No worries about data corruption due to partial updates.
  3. Flexible Storage Extension

    • You can apply MVCC features to anything—file systems, in-memory objects, local storage, etc.—just by implementing the Strategy interface.
    • Business logic and storage logic can be perfectly separated.
  4. Improved Development Productivity

    • No need to write complex synchronization code yourself; write safe code with just intuitive api.read(), api.write(), and api.commit().

Installation

Node.js

npm install mvcc-api
# or
npx jsr add @izure/mvcc-api

Browser

import {
  SyncMVCCStrategy,
  SyncMVCCTransaction,
  AsyncMVCCStrategy,
  AsyncMVCCTransaction
} from 'https://cdn.jsdelivr.net/npm/mvcc-api@1/+esm'

Usage

1. Implement Strategy

import fs from 'node:fs'
import { AsyncMVCCStrategy } from 'mvcc-api'

export class FileStrategy extends AsyncMVCCStrategy<string, string> {
  async read(key: string) {
    return fs.promises.readFile(key, 'utf-8')
  }
  async write(key: string, value: string) {
    await fs.promises.writeFile(key, value)
  }
  async delete(key: string) {
    await fs.promises.unlink(key)
  }
  async exists(key: string) {
    return fs.existsSync(key)
  }
}

2. Execute Transaction

import { AsyncMVCCTransaction } from 'mvcc-api'

const root = new AsyncMVCCTransaction(new FileStrategy())
const tx = root.createNested()

await tx.create('new.json', '{}')        // Create new key
await tx.write('config.json', '{"v":2}') // Update existing key
await tx.delete('old.json')              // Delete key
await tx.exists('config.json')           // true

const result = await tx.commit()
// result.created = [{ key: 'new.json', data: '{}' }]
// result.updated = [{ key: 'config.json', data: '{"v":2}' }]
// result.deleted = [{ key: 'old.json', data: '<value before delete>' }]

await root.commit() // Persist to storage

Caution

Immutability and Reference Types

When using write(key, value) with reference types (objects, arrays), you MUST provide a copy of the value (Copy-on-Write). Since mvcc-api stores the value in an internal buffer, modifying the original object/array after calling write() but before commit() will affect the data in the transaction.

// ❌ Wrong: Modifying original object
const data = { count: 1 }
tx.write('key', data)
data.count = 2 // Internal buffer also changes!

// ✅ Correct: Pass a copy
tx.write('key', { ...data })

Visibility Rules

sequenceDiagram
    participant P as Parent
    participant C as Child

    Note over P: "key": "A" (Committed)
    P->>P: write("key", "B") (Uncommitted)
    
    rect rgb(240,240,250)
    Note over C: Child Created
    C->>P: read("key") → "A"
    Note right of C: Cannot see parent's<br/>uncommitted data
    end
Loading

Important

Visibility Rules

  • Transactions can always see their own changes.
  • Children can only see committed data at the time of creation.
  • Snapshots are maintained even if external commits occur after creation.

Warning

Memory Management

Every transaction created via createNested() MUST be finished with either commit() or rollback(). Internally, the Root transaction tracks all active transactions to determine which old versions can be safely pruned from memory. Failing to close a transaction will prevent the internal Garbage Collection (Pruning) from reclaiming memory, eventually leading to a Memory Leak.

const tx = root.createNested()
const res = await tx.commit()
if (!res.success) {
  console.log(res.error)
  tx.rollback()
}

Conflict Detection

Conflicts occur upon commit if transactions have modified the same key.

const parent = root.createNested()
const child = parent.createNested()

parent.write('shared', 'parent')  // Parent modifies after child creation
child.write('shared', 'child')    // Child modifies same key

const result = child.commit('It should fail')
if (!result.success) {
  console.log(result.label) // "It should fail"
  console.log(result.error) // "Commit conflict: Key 'shared' was modified..."
}
Parent Mod Child Mod Result
A A ❌ Conflict
A B ✅ Success

Tip

No Conflict on Different Keys

MVCC detects conflicts on a Key basis. Sibling transactions can both commit successfully if they modify different keys.

const t1 = root.createNested()
const t2 = root.createNested()

t1.create('Key1', 'data')
t2.create('Key2', 'data') // Different key

t1.commit() // Success
t2.commit() // Success

Result Accumulation

When a child commits, the results are accumulated in the parent.

const b = a.createNested()
const c = b.createNested()

c.create('C', 'val')
const cResult = c.commit()
// cResult.created = [{ key: 'C', data: 'val' }]

b.create('B', 'val')
const bResult = b.commit()
// bResult.created = [{ key: 'C', data: 'val' }, { key: 'B', data: 'val' }]

Note

Changes from rolled-back children are not passed to the parent.

API Reference

MVCCTransaction<S, K, T>

Method Description Return Value
create(key: K, value: T) Create new key-value this
write(key: K, value: T) Update existing key this
delete(key: K) Delete key this
read(key: K) Read value T | null
exists(key: K) Check if key exists boolean
commit(label?: string) Apply changes TransactionResult<K, T>
rollback(label?: string) Discard changes TransactionResult<K, T>
createNested() Create child transaction MVCCTransaction

TransactionResult<K, T>

type TransactionEntry<K, T> = { key: K, data: T }
type TransactionConflict<K, T> = { key: K, parent: T, child: T }

{
  success: boolean              // Success status
  label?: string                // Label of the transaction
  error?: string                // Error message on failure (e.g. conflict)
  conflict?: TransactionConflict<K, T> // Conflict information on failure
  created: TransactionEntry[]   // Keys and values created via create()
  updated: TransactionEntry[]   // Keys and values updated via write()
  deleted: TransactionEntry[]   // Keys deleted via delete() and their previous values
}

Contributing

mvcc-api aims to help anyone easily use complex concurrency control. Bug reports, feature suggestions, and PRs are always welcome! Please feel free to leave your feedback via GitHub Issues.

License

MIT

About

Multiversion Concurrency Control (MVCC) API for TypeScript

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published