Data & AnalyticsTechnologyPlatinum

Optimizing large datasets in Google BigQuery for cost and performance.

BigQuery Analytics Expert

Google BigQuery, SQL Analytics, Dataform

expertv5.0

Best for

▸Optimizing BigQuery table partitioning and clustering for 10TB+ datasets to reduce query costs by 60-90%
▸Implementing BigQuery ML models with CREATE MODEL for customer segmentation and demand forecasting
▸Building Dataform data pipelines with dependency management and automated testing
▸Designing materialized views for real-time dashboards while managing BigQuery slot consumption

What you'll get

▸Detailed partitioning strategy with DATE partitioning on transaction_date and clustering on [customer_id, product_category] with cost impact analysis showing 75% scan reduction
▸Complete BigQuery ML implementation with CREATE MODEL statement for ARIMA_PLUS time series forecasting including feature engineering and evaluation metrics
▸Comprehensive Dataform pipeline architecture with SQLX transformations, assertion tests, and incremental table configurations for multi-TB daily processing

Expects

Data architecture details including table sizes, query patterns, current partitioning strategy, slot usage, and specific BigQuery performance or cost optimization challenges.

Returns

Detailed BigQuery optimization recommendations with specific SQL examples, partitioning strategies, cost projections, and implementation steps for scalable analytics architecture.

What's inside

“You are a BigQuery Analytics Expert. You design and optimize petabyte-scale data warehouses using columnar storage, distributed query execution, and advanced BigQuery features for cost-efficient, secure analytics. - Diagnose root causes of high costs and poor performance by analyzing storage archite...”

Covers

What You Do DifferentlyMethodologyWatch For

Not designed for ↓

×Non-Google Cloud data warehouse platforms like Snowflake or Redshift architecture
×Traditional on-premises ETL tools or database administration outside BigQuery
×Basic SQL query writing without BigQuery-specific optimization considerations
×Cloud infrastructure provisioning beyond BigQuery and related GCP services

SupaScore

88.65▼

Research Quality (15%)

9.1

Prompt Engineering (25%)

8.95

Practical Utility (15%)

8.65

Completeness (10%)

9.3

User Satisfaction (20%)

8.8

Decision Usefulness (15%)

8.5

Evidence Policy

Standard: no explicit evidence policy.

bigquerygoogle-cloudsql-analyticsdata-warehousebigquery-mlpartitioningclusteringdataformcost-optimizationdata-governancematerialized-viewsbi-enginestorage-apibigquery-dataframes

Research Foundation: 8 sources (4 official docs, 2 paper, 2 web)

This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.