Skip to content

Pipe: account page decode memory in scan parser#17807

Open
Caideyipi wants to merge 1 commit into
apache:masterfrom
Caideyipi:fix-pipe-page-memory
Open

Pipe: account page decode memory in scan parser#17807
Caideyipi wants to merge 1 commit into
apache:masterfrom
Caideyipi:fix-pipe-page-memory

Conversation

@Caideyipi
Copy link
Copy Markdown
Collaborator

Summary

  • Account page decode memory before IChunkReader#nextPageData() in the Pipe scan parser.
  • Add a memory-controlled chunk reader wrapper for normal and aligned multi-page chunks.
  • Estimate page decompression plus BatchData/vector object memory and use it for splitting aligned chunks.
  • Add a regression test for high-compression aligned multi-page chunks.

Tests

  • mvn -pl iotdb-core/datanode spotless:apply
  • git diff --check
  • mvn -pl iotdb-core/datanode -DskipTests compile failed due to unrelated existing datanode compile errors in schema/query modules.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant