WoW Lab

WoW Lab

Toolkit

Simulate

Quick SimBest in BagsDrop Optimizer

Rotations

BrowseNew Rotation

Plan

Traits
P

Developer

DocsBibleEngineHooksMCP ServerMetricsUI Showcase

Misc

AboutBlog

© 2025 WoW Lab

  1. Home
  2. Bible
  3. Data Pipeline

Data Pipeline

From DBC CSV files through Rust transformation to Postgres

February 13, 2026
Edit

End-to-end flow (DBC CSV → DbcData in-memory HashMaps → transform functions → flat structures → Postgres), CLI snapshot sync command, sqlx compile-time checked queries, atomic transaction (DELETE old patch → INSERT new), batch inserts with concurrent workers (10 concurrent, PG_BIND_LIMIT 65535 parameters), transform layer (spell.rs, trait.rs, item.rs, aura.rs, scaling.rs, global.rs, spec.rs), SpellDataFlat/ItemDataFlat/TraitTreeFlat/AuraDataFlat output types, patch_version tagging for multi-patch support, Supabase game schema tables (spells, items, specs_traits, auras, specs, classes, global_colors, global_strings, item_bonuses, curves, curve_points, rand_prop_points).

Next steps

Discrete Event Simulation
Spell Descriptions
Discrete Event Simulation

Navigation

IntroductionGlossaryReferences

Overview

Mechanics

Game Data

DBC OverviewSpell DataTalent TreesItems and ScalingSpell DescriptionsData Pipeline

Simulation

Infrastructure

Portal