Category: Cloud

  • How to Find What’s Driving BigQuery Bytes Billed

    How to Find What’s Driving BigQuery Bytes Billed

    Recently, I reduced BigQuery cost significantly by changing how we maintained a token index table used for keyword search. The original design updated the index during ingestion. Each small OCR batch triggered a MERGE into a chunk_terms table. That looked incremental, but it turned out to be expensive because BigQuery still needed to scan the…