Quick Start

On Databricks

from aef_bng.spark import process_with_spark
from aef_bng.config import AEFBNGConfig

config = AEFBNGConfig(
    years=[2025],
    bounds=(0, 0, 700000, 1300000),  # Full Great Britain
    table_name="catalog.schema.aef_embeddings_bng",
)

process_with_spark(config)

CLI (via Databricks python_wheel_task)

aef-bng spark-run \
  --bounds "0,0,700000,1300000" \
  --years "2025" \
  --table-name "catalog.schema.aef_embeddings_bng"

Databricks Asset Bundle

Amend one of the DAB bundles in the repo and run:

databricks bundle run aef_bng_pipeline -t dev \
    --params bounds=520830,170402,542137,187507 \
    --params years=2024,2025 \
    --params table_name=catalog.data.aef_embeddings_bng