Skip to content

DpWriter shrink container buffer after processing#4904

Open
kubiak-jpl wants to merge 10 commits intonasa:develfrom
kubiak-jpl:dev/dpwrite_proc_reprocess
Open

DpWriter shrink container buffer after processing#4904
kubiak-jpl wants to merge 10 commits intonasa:develfrom
kubiak-jpl:dev/dpwrite_proc_reprocess

Conversation

@kubiak-jpl
Copy link
Copy Markdown
Contributor

Related Issue(s) #4903
Has Unit Tests (y/n) y
Documentation Included (y/n) n
Generative AI was used in this contribution (y/n) n

Change Description

Updates DpWriter to shrink and re-serialize the container header if a processing step shrinks the container buffer.

Rationale

Necessary to develop data product compression processing components.

Testing/Review Recommendations

Testing with an external deployment to compress camera images into a PNG

Added unit tests to test the new behavior

Future Work

None.

AI Usage (see policy)

N/A

@LeStarch LeStarch requested a review from timcanham March 25, 2026 22:21
LeStarch
LeStarch previously approved these changes Mar 30, 2026
@LeStarch
Copy link
Copy Markdown
Collaborator

Looks ok to me, but I could really use @bocchino or @timcanham to review this.

@LeStarch LeStarch requested review from bocchino March 30, 2026 19:40
@kubiak-jpl kubiak-jpl marked this pull request as draft March 31, 2026 14:26
@kubiak-jpl kubiak-jpl marked this pull request as ready for review March 31, 2026 21:37
}
}

// Updated DpContainer object state with the returned value in the
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we check whether there was any call to procBufferSendOut_out and update the DpContainer only if there was a call? That way if there's no processing, we don't have to recompute the state.

@bocchino
Copy link
Copy Markdown
Collaborator

bocchino commented Apr 7, 2026

This PR is looking good! I just had two small comments on the revised code.

@kubiak-jpl
Copy link
Copy Markdown
Contributor Author

@bocchino I pushed an update to address your two comments

bocchino
bocchino previously approved these changes Apr 7, 2026
Copy link
Copy Markdown
Collaborator

@bocchino bocchino left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@thomas-bc
Copy link
Copy Markdown
Collaborator

CI can be fixed by:

  1. Fixing formatting
  2. Merging devel into this PR branch (devel now contains the spelling fixes)

@kubiak-jpl
Copy link
Copy Markdown
Contributor Author

@thomas-bc Done

@bocchino bocchino self-requested a review April 10, 2026 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants