[core] Introduce DataPagedOutputSerializer to limit memory in ManifestEntryCache

[JingsongLi]

Purpose

See:

/**
 * A paged output serializer that efficiently handles serialization of rows using memory pages.
 *
 * <p>This serializer uses a two-phase approach:
 *
 * <ol>
 *   <li><strong>Initial phase:</strong> Writes data to an initial buffer until it reaches the
 *       specified page size.
 *   <li><strong>Paged phase:</strong> Once the initial buffer exceeds the page size, switches to
 *       using {@link SimpleCollectingOutputView} with allocated memory segments for efficient
 *       memory management.
 * </ol>
 *
 * <p>The design ensures optimal performance for both small datasets (using single buffer) and large
 * datasets (using paged memory allocation).
 */

Tests

API and Format

Documentation