Skip to content

Optimize pipe event batching and listener stop#17864

Merged
jt2594838 merged 1 commit into
apache:masterfrom
Caideyipi:optimize-pipe-flow-performance
Jun 9, 2026
Merged

Optimize pipe event batching and listener stop#17864
jt2594838 merged 1 commit into
apache:masterfrom
Caideyipi:optimize-pipe-flow-performance

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Summary

  • avoid copying table-model batch tablets when append preconditions do not match
  • reduce synchronization overhead in PipeTransferBatchReqBuilder internals
  • release PipeInsertionDataNodeListener global lock before closing the removed assigner

Tests

  • mvn -pl iotdb-core/datanode spotless:apply
  • mvn -Ddevelocity.off=true -pl iotdb-core/calc-commons,iotdb-core/datanode -DskipTests compile
  • mvn -Ddevelocity.off=true -pl iotdb-core/datanode -Dtest=PipeTabletEventPlainBatchTest test (blocked by unrelated QueryModificationLoaderTest testCompile error on current master)

@jt2594838 jt2594838 merged commit 6532d29 into apache:master Jun 9, 2026
40 of 41 checks passed
@jt2594838 jt2594838 deleted the optimize-pipe-flow-performance branch June 9, 2026 04:13
MileaRobertStefan pushed a commit to MileaRobertStefan/iotdb that referenced this pull request Jun 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants