Supermetal Benchmark¶

What it is¶

Supermetal is a high-performance data movement and processing tool designed for low-latency synchronization between production databases and modern data lake formats. As of June 2026, it is recognized for its industry-leading Postgres-to-Iceberg synchronization speeds, outperforming traditional distributed computing frameworks.

What problem it solves¶

It addresses the latency and complexity bottlenecks in Change Data Capture (CDC) pipelines. Traditionally, moving data from production databases (like Postgres) to analytics platforms (like Apache Iceberg) required complex setups involving Flink, Kafka Connect, or Spark. Supermetal simplifies this by: - Reducing Latency: Benchmarks show Postgres-to-Iceberg synchronization in as little as 13 minutes for massive datasets, providing high-freshness data for Claude 4.8 RAG systems. - Simplifying Infrastructure: Replacing multi-component distributed stacks with a single, high-performance process. - Ensuring Consistency: Maintaining transactional integrity and data accuracy via Apache Arrow's type system.

Where it fits in the stack¶

Category: Benchmarking / Data Movement. It serves as the high-speed "plumbing" between the operational layer (Postgres) and the analytical layer (Iceberg), often used to provide real-time data for AI training and vLLM RAG pipelines.

Typical use cases¶

Real-time CDC: Synchronizing Postgres data to Iceberg for near-instant analytics.
Data Stack Consolidation: Simplifying the infrastructure required for reliable data pipelines.
AI Dataset Freshness: Ensuring that models like Claude 4.8 Opus have access to the most recent production data via high-speed ingestion.

Strengths¶

Speed: Optimized for modern hardware and cloud-native storage, achieving throughput that dwarfs open-source alternatives.
Simplicity: Designed to replace more complex distributed computing frameworks for specific data movement tasks.
Efficiency: Written in Rust and utilizing Apache Arrow for zero-copy read capabilities and efficient serialization.

Limitations¶

Niche Focus: Specifically optimized for high-speed data movement and specific target formats (Postgres, Iceberg, Snowflake).
Target Specificity: While expanding, its primary advantage is currently concentrated on a few high-value source-sink pairs.

When to use it¶

When you need low-latency synchronization between production databases and an analytical data lake.
When looking to reduce the operational overhead and cost of Kafka/Spark-based pipelines.
When the scale of data movement creates a bottleneck for real-time AI features.

When not to use it¶

For small datasets that don't justify the overhead of a dedicated CDC tool.
If you require complex in-flight data transformations (consider Fivetran or dbt for heavy T in ELT).
For unsupported source or target systems where traditional connectors remain the only option.

Getting started¶

Supermetal operates via an API-driven connector model. To get started, deploy the Supermetal service (often via Docker) and use the REST API to configure your source and sink connectors.

# Start the Supermetal service (example)
docker run -p 8080:8080 supermetal/service:latest

CLI examples¶

Management of Supermetal is typically performed via its REST API, which can be interacted with using curl.

# List all active connectors
curl "https://your-supermetal-instance/api/v1/connectors"

# Check the status of a specific synchronization task
curl "https://your-supermetal-instance/api/v1/tasks/my-sync-task"

# Trigger a manual snapshot of a source table
curl -X POST "https://your-supermetal-instance/api/v1/snapshot/source_table_name"

API examples¶

Connectors are defined and managed via a JSON API.

Create a new Postgres-to-Iceberg Connector¶

curl -X POST "https://your-supermetal-instance/api/v1/connectors/my-pg-to-iceberg" \
  -H "Content-Type: application/json" \
  -d '{
    "id": "my-pg-to-iceberg",
    "source": {
      "postgres": {
        "connection": {
          "host": "pg-host",
          "user": "sync_user",
          "password": "password",
          "database": "prod_db"
        },
        "replication_type": { "logical_replication": {} }
      }
    },
    "sink": {
      "iceberg": {
        "catalog_type": "glue",
        "database": "analytics"
      }
    }
  }'

Data Stack Consolidation — The movement towards simpler, faster data architectures.
Model Context Protocol — Used for discovery of Supermetal-managed datasets.
AirOps — For orchestrating the results of Supermetal data syncs.
Temporal — For managing long-running data workflow state.
Grafana Cloud — For monitoring Supermetal synchronization performance.
ClickHouse — A common high-speed analytical sink.
Snowflake — A common enterprise analytical sink.
Real-time Sync Engines — The ecosystem where Supermetal competes.
vLLM — Often the consumer of data moved by Supermetal.

Sources / references¶

Contribution Metadata¶

Last reviewed: 2026-06-30
Confidence: high