analytics-dictionary / term / data infrastructure

Partitioning and clustering

Partitioning splits a large table into segments, and clustering sorts data within them, so queries read less data.

Written by Reflective Data experts · updated Oct 5, 2026

In BigQuery, partitioning a table by date means a query for last week reads only last week, not the whole history. Clustering by common filter columns reduces the amount scanned even further.

It is one of the simplest ways to cut warehouse costs and speed up queries.

Data modeling Data warehouse Google BigQuery

// how we can help

We design, build and optimise data warehouses and the cloud infrastructure around them. Data infrastructure services → · Managed data pipelines

Fivetran

Fivetran is a managed ELT service with connectors for many SaaS tools and databases.

idempotency.md

Idempotency

An idempotent process gives the same result no matter how many times it runs.

data-warehouse-migration.md

Data warehouse migration

A warehouse migration moves data, models and reports from one warehouse platform to another.

data-catalog.md

Data catalog

A data catalog is an organised inventory of your data assets, with descriptions, owners and lineage.

data-cost-optimization.md

Data cost optimization

Data cost optimization is reducing the cost of storing, moving and querying data without hurting the…

airbyte.md

Airbyte

Airbyte is an open-source data integration platform with a large catalogue of connectors.

← full analytics dictionary