# Changelog

## Score

- CAI 75 → 61 (-13.2)
- Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.

## Lenses

- Code Health 89 → 51 (-38.1)
- Architecture 95 → 95 (-0.2)
- Maturity 67 → 68 (+0.7)
- Readiness 77 → 65 (-12.0)
- Security 77 → 70 (-7.0)
- Performance 94 → 94 (+0.0)

## Resolved (503)

- AggregateExecNode::deserialize (cognitive 46) (datafusion/proto-models/src/generated/pbjson.rs)
- AggregateExecNode::deserialize (cyclomatic 43) (datafusion/proto-models/src/generated/pbjson.rs)
- AggregateExecNode::serialize (cognitive 28) (datafusion/proto-models/src/generated/pbjson.rs)
- AggregateExecNode::serialize (cyclomatic 29) (datafusion/proto-models/src/generated/pbjson.rs)
- AggregateUdfExprNode::deserialize (cognitive 25) (datafusion/proto-models/src/generated/pbjson.rs)
- AggregateUdfExprNode::deserialize (cyclomatic 22) (datafusion/proto-models/src/generated/pbjson.rs)
- AliasNode::deserialize (cognitive 16) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeExecNode::deserialize (cognitive 31) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeExecNode::deserialize (cyclomatic 28) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeExecNode::serialize (cognitive 18) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeExecNode::serialize (cyclomatic 19) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeNode::deserialize (cognitive 19) (datafusion/proto-models/src/generated/pbjson.rs)
- AnalyzeNode::deserialize (cyclomatic 16) (datafusion/proto-models/src/generated/pbjson.rs)
- ArrowType::deserialize (cognitive 127) (datafusion/proto-common/src/generated/pbjson.rs)
- ArrowType::deserialize (cyclomatic 124) (datafusion/proto-common/src/generated/pbjson.rs)
- AsOfJoinExecNode::deserialize (cognitive 25) (datafusion/proto-models/src/generated/pbjson.rs)
- AsOfJoinExecNode::deserialize (cyclomatic 22) (datafusion/proto-models/src/generated/pbjson.rs)
- AsOfJoinNode::deserialize (cognitive 28) (datafusion/proto-models/src/generated/pbjson.rs)
- AsOfJoinNode::deserialize (cyclomatic 25) (datafusion/proto-models/src/generated/pbjson.rs)
- AsOfJoinNode::serialize (cognitive 16) (datafusion/proto-models/src/generated/pbjson.rs)
- …and 483 more

## New (720)

- BitwiseSortMergeJoinStream::join (cognitive 16) (datafusion/physical-plan/src/joins/sort_merge_join/bitwise_stream.rs)
- Change coupling: avro.rs ↔ csv.rs (datafusion/core/src/datasource/physical_plan/avro.rs)
- Change coupling: csv.rs ↔ json.rs (datafusion/core/src/datasource/physical_plan/csv.rs)
- Change coupling: hash_table.rs ↔ heap.rs (datafusion/physical-plan/src/aggregates/topk/hash_table.rs)
- ClassTooLong: DictionaryGroupValuesColumn (datafusion/physical-plan/src/aggregates/group_values/multi_group_by/dictionary.rs)
- ClassTooLong: PushDownFilter (datafusion/optimizer/src/push_down_filter.rs)
- CoalesceFunc::invoke_with_args (cognitive 19) (datafusion/functions/src/core/coalesce.rs)
- CsvOpener::open (cognitive 23) (datafusion/datasource-csv/src/source.rs)
- Duplicated block (10 lines × 2) (datafusion/datasource-avro/src/source.rs)
- Duplicated block (10 lines × 2) (datafusion/expr-common/src/type_coercion/binary.rs)
- Duplicated block (10 lines × 2) (datafusion/expr/src/logical_plan/plan.rs)
- Duplicated block (10 lines × 2) (datafusion/ffi/src/proto/logical_extension_codec.rs)
- Duplicated block (10 lines × 2) (datafusion/functions-aggregate/src/average.rs)
- Duplicated block (10 lines × 2) (datafusion/functions-nested/src/array_scale.rs)
- Duplicated block (10 lines × 2) (datafusion/optimizer/src/push_down_filter.rs)
- Duplicated block (10 lines × 2) (datafusion/physical-expr-common/src/binary_view_map.rs)
- Duplicated block (10 lines × 2) (datafusion/physical-plan/src/aggregates/aggregate_hash_table/common.rs)
- Duplicated block (10 lines × 2) (datafusion/physical-plan/src/joins/proto.rs)
- Duplicated block (10 lines × 2) (datafusion/physical-plan/src/windows/bounded_window_agg_exec.rs)
- Duplicated block (10 lines × 2) (datafusion/proto-common/src/from_proto/mod.rs)
- …and 700 more

## Changes since last survey

- 244 commits — 161 feature/other, 83 fixes

## By area

- datafusion/physical-plan — 37 commits
- datafusion/sqllogictest — 29 commits
- datafusion/core — 23 commits
- (root) — 17 commits
- datafusion/physical-expr — 14 commits
- .github/workflows — 13 commits
- datafusion/optimizer — 12 commits
- docs/source — 11 commits
- datafusion/expr — 9 commits
- datafusion/functions — 8 commits
- datafusion/sql — 8 commits
- datafusion/common — 7 commits
- datafusion/physical-optimizer — 7 commits
- datafusion/functions-aggregate — 6 commits
- .github/actions — 4 commits
- benchmarks/sql_benchmarks — 4 commits
- datafusion/datasource-parquet — 4 commits
- datafusion/spark — 4 commits
- datafusion-cli/src — 3 commits
- datafusion/wasmtest — 3 commits

## Notable commits

- fix: Fix retained memory accounting for ExprIntervalGraph (#26487)
- fix: Revert #25790 (Decimal filter selectivity) due to TPC-H Q18 regression (#27145)
- fix: chore: update quinn-proto and quinn-udp to fix cargo audit (#27407)
- fix: fix(cli): preserve rows in non-table (`csv`, `json`, etc) output (#26755)
- fix: fix(cli): respect `sql_parser.recursion_limit` when parsing and validating input (#25807)
- fix: fix(physical-optimizer): show one-line operator in SanityCheckPlan error (#27208)
- fix: fix(smj): compare all key types across batch boundaries in semi/anti/mark joins (#26830)
- fix: fix(spark): accept STRING and TIMESTAMP start dates in next_day (#26127)
- fix: fix(spark): floor instead of truncate in unix_millis/unix_seconds for pre-epoch timestamp (#26129)
- fix: fix(spark): return NaN and -Infinity from `pow` where Spark does (#26382)
- fix: fix: Fix flaky sort fuzzer test (#26983)
- fix: fix: Preimage rewrites are not allowed for volatile arguments (#26995)
- fix: fix: Preserve column identifiers in DataFrame fill methods (#25857)
- fix: fix: Unify schema metadata merge logic in unions to "last one wins" (#26881)
- fix: fix: `SanityCheckPlan` error when a per-partition constant leads an ordering (#27191)
- fix: fix: `WITH ... AS MATERIALIZED` returns wrong rows under `ORDER BY ... LIMIT` (#27416)
- fix: fix: avoid lpad/rpad panic on out-of-range length arrays (#26958)
- fix: fix: avoid pruning timestamp-to-time casts (#26452)
- fix: fix: bound parallel batch sorting in SortExec (#26242)
- fix: fix: coerce time types with different units (#27377)
- …and 224 more

## Architecture

- Unchanged — 0 containers · 2 contexts · 0 edges
