enhance: make serialization be part of sync task to support file format change

[tedxu]

See #38945

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tedxu

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [tedxu]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 65.15679% with 100 lines in your changes missing coverage. Please review.

Project coverage is 81.10%. Comparing base (8165044) to head (d078858).
Report is 12 commits behind head on master.

Files with missing lines	Patch %	Lines
internal/flushcommon/syncmgr/pack_writer.go	58.41%	74 Missing and 15 partials ⚠️
internal/flushcommon/syncmgr/storage_serializer.go	57.14%	5 Missing and 1 partial ⚠️
internal/flushcommon/syncmgr/task.go	78.94%	2 Missing and 2 partials ⚠️
internal/flushcommon/syncmgr/meta_writer.go	75.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #38946      +/-   ##
==========================================
- Coverage   81.13%   81.10%   -0.04%     
==========================================
  Files        1388     1390       +2     
  Lines      196485   196480       -5     
==========================================
- Hits       159427   159362      -65     
- Misses      31462    31508      +46     
- Partials     5596     5610      +14     

Components	Coverage Δ
Client	79.53% <ø> (ø)
Core	69.53% <ø> (+<0.01%)	⬆️
Go	83.05% <65.15%> (-0.04%)	⬇️

Files with missing lines	Coverage Δ
internal/datanode/importv2/util.go	65.04% <100.00%> (-0.07%)	⬇️
internal/flushcommon/syncmgr/options.go	100.00% <100.00%> (ø)
internal/flushcommon/writebuffer/write_buffer.go	71.45% <100.00%> (-1.72%)	⬇️
internal/storage/data_codec.go	77.82% <100.00%> (+0.02%)	⬆️
pkg/metrics/datanode_metrics.go	100.00% <ø> (ø)
internal/flushcommon/syncmgr/meta_writer.go	79.16% <75.00%> (ø)
internal/flushcommon/syncmgr/task.go	92.92% <78.94%> (+10.55%)	⬆️
internal/flushcommon/syncmgr/storage_serializer.go	48.22% <57.14%> (-13.45%)	⬇️
internal/flushcommon/syncmgr/pack_writer.go	58.41% <58.41%> (ø)

... and 53 files with indirect coverage changes

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu cpp-unit-test check failed, comment rerun cpp-unit-test can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu cpp-unit-test check failed, comment rerun cpp-unit-test can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[tedxu]

rerun go-sdk

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[tedxu]

/run-cpu-e2e