Issues

• See if Ballista depend on Apache DataSketches (datasketches-rust) for shuffle column sketches?

  enhancement
  apache/datafusion-ballista#2783 · Filter by author coderfender opened on Nov 5, 2026
  2

  

• Python client: known gaps compared to DataFusion

  apache/datafusion-ballista#2781 · Filter by author milenkovicm opened on Nov 5, 2026

• Migrate Labeler workflow away from pull_request_target

  development-processenhancement
  apache/datafusion-ballista#2773 · Filter by author andygrove opened on Nov 4, 2026

• ballista.planner.propagate_empty.enabled has no effect: PropagateEmptyExecRule always runs

  bug
  apache/datafusion-ballista#2768 · Filter by author andygrove opened on Nov 3, 2026

• Executor's default work dir is deleted at startup and recreated without TempDir's permissions

  bug
  apache/datafusion-ballista#2767 · Filter by author andygrove opened on Nov 3, 2026

• Scheduler runs without event logs, and only warns, when it can't write event_log_dir

  bug
  apache/datafusion-ballista#2766 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: use exact stage row counts to simplify downstream operators (EliminateLimits / OptimizeOneRowPlan analog)

  enhancement
  apache/datafusion-ballista#2761 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: size output files for writes with a rebalance step (REBALANCE analog)

  enhancement
  apache/datafusion-ballista#2760 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: broaden skew-join applicability (dynamic filters, multi-join stages, default-on criteria)

  enhancement
  apache/datafusion-ballista#2759 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: guard replans with a cost check (SimpleCostEvaluator analog)

  enhancement
  apache/datafusion-ballista#2758 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: parallelism-aware coalesce policy and default-on criteria (parallelismFirst, min size, initial partition count)

  enhancement
  apache/datafusion-ballista#2757 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: coalesce shuffle partitions down to a single partition

  enhancement
  apache/datafusion-ballista#2756 · Filter by author andygrove opened on Nov 3, 2026
  

• Don't serve the unauthenticated REST API, including job cancel, on the scheduler's gRPC port by default

  enhancement
  apache/datafusion-ballista#2746 · Filter by author andygrove opened on Nov 2, 2026

• Compile the scheduler's event-log writer without the REST API

  enhancement
  apache/datafusion-ballista#2745 · Filter by author andygrove opened on Nov 2, 2026

• Add a typed SessionConfigExt setter for ballista.execution.mode

  apache/datafusion-ballista#2729 · Filter by author andygrove opened on Oct 31, 2026
  1

• Let custom operators declare that they tolerate a coalesced partition count

  enhancement
  apache/datafusion-ballista#2728 · Filter by author andygrove opened on Oct 31, 2026
  

• Run a stage once when several stages read it

  enhancement
  apache/datafusion-ballista#2727 · Filter by author andygrove opened on Oct 31, 2026
  

• Remove NormalizeInterleaveRule once DataFusion tolerates non-interleavable InterleaveExec children

  apache/datafusion-ballista#2719 · Filter by author andygrove opened on Oct 30, 2026

• Cancel jobs whose client process has gone away

  apache/datafusion-ballista#2717 · Filter by author andygrove opened on Oct 30, 2026

• Fair admission for pipelined jobs

  apache/datafusion-ballista#2716 · Filter by author andygrove opened on Oct 30, 2026

• Nightly Docker image build failed

  apache/datafusion-ballista#2712 · Filter by author github-actions opened on Oct 30, 2026

• [Roadmap] Distributed Runtime Filter Hub

  apache/datafusion-ballista#2700 · Filter by author wirybeaver opened on Oct 30, 2026

• Tasks bound in launch_tasks are orphaned when the executor metadata lookup fails

  apache/datafusion-ballista#2691 · Filter by author andygrove opened on Oct 29, 2026

• Bound the total hash join build memory of a pipelined job

  enhancement
  apache/datafusion-ballista#2690 · Filter by author andygrove opened on Oct 29, 2026

• feat: option to disable Python UDF decoding on BallistaScheduler and BallistaExecutor

  apache/datafusion-ballista#2688 · Filter by author andygrove opened on Oct 28, 2026
  1