RATIS-1931. [DO-NOT-MERGE] Rebase gRPC zero-copy changes onto master.#1453

Draft

slfan1989 wants to merge 26 commits into

apache:masterfrom

slfan1989:RATIS-1931-grpc-zero-rebase-v2

Commits on May 7, 2026

RATIS-1925. Support Zero-Copy in GrpcClientProtocolService (#1007)

duongkame
authored and
slfan1989
committed
RATIS-1990. Refactor appendEntries processing to support reference count (#1011)

duongkame
authored and
slfan1989
committed
RATIS-2009. ReferenceCount should work for all LogEntry types. (#1021)

duongkame
authored and
slfan1989
committed
RATIS-1934. Support Zero-Copy in GrpcServerProtocolService (#1014)

duongkame
authored and
slfan1989
committed
RATIS-2007. Zero-copy buffers are not released (#1027)

duongkame
authored and
slfan1989
committed
RATIS-2018. Zero-copy buffers are not released - 2nd chunk (#1032)

duongkame
authored and
slfan1989
committed
RATIS-1978. Add tests assertions to verify all zero-copy messages are released properly (#1023)

duongkame
authored and
slfan1989
committed
RATIS-1997. Refactor StateMachine interface to use ReferenceCountedObject (#1036)

duongkame
authored and
slfan1989
committed
RATIS-2020. Refactor TransactionContext to supply LogEntryProto via a ReferenceCountedObject (#1042)

duongkame
authored and
slfan1989
committed
RATIS-2028. Refactor RaftLog to supply log as ReferenceCountedObject (#1045)

duongkame
authored and
slfan1989
committed
RATIS-2026. LogAppender to consume log entries with reference count (#1049)

duongkame
authored and
slfan1989
committed
RATIS-1979. Allow StateMachine.read to return a ReferentCountedObject (#1062)

duongkame
authored and
slfan1989
committed
RATIS-2059. Missing reference count when putting log entries to cache on follower. (#1067)

duongkame
authored and
slfan1989
committed
RATIS-2077. Timedout StateMachine retainRead is released twice (#1081)

duongkame
authored and
slfan1989
committed
RATIS-2092. Add metrics to expose number of zero-copy unclosed messages (#1095)

duongkame
authored and
slfan1989
committed
RATIS-2096. Add a conf to enable/disable zero copy. (#1099)

duongkame
authored and
slfan1989
committed
RATIS-2093. Decouple metadata and configuration entries from appendEntries buffer for stateMachineCache' (#1096)

duongkame
authored and
slfan1989
committed
RATIS-2094. Avoid corruptions from TransactionContext's stateMachineLogEntry and stateMachineContext. (#1106)

duongkame
authored and
slfan1989
committed
RATIS-2114. Corruption due to SegmentedRaftLogWorker queue LogEntry without reference counter (#1113)

duongkame
authored and
slfan1989
committed
RATIS-2151. TestRaftWithGrpc keeps failing with zero-copy. (#1164)

szetszwo
authored and
slfan1989
committed
RATIS-2164. LeakDetector has a race condition. (#1163)

szetszwo
authored and
slfan1989
committed
RATIS-2173. Fix zero-copy bugs for non-gRPC cases. (#1167)

szetszwo
authored and
slfan1989
committed
RATIS-2220. Skip further tests after leak detected (#1193)

adoroszlai
authored and
slfan1989
committed
RATIS-2225. RaftClientRequest leak in RaftServerImpl. (#1198)

szetszwo
authored and
slfan1989
committed
RATIS-2227. LogEntryProto leak in SegmentedRaftLog (#1199)

jianghuazhu
authored and
slfan1989
committed
RATIS-2414. Add leak detection for ZeroCopyMessageMarshaller. (#1355)
slfan1989
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RATIS-1931. [DO-NOT-MERGE] Rebase gRPC zero-copy changes onto master.#1453

RATIS-1931. [DO-NOT-MERGE] Rebase gRPC zero-copy changes onto master.#1453
slfan1989 wants to merge 26 commits into
apache:masterfrom
slfan1989:RATIS-1931-grpc-zero-rebase-v2

Commits on May 7, 2026

RATIS-1925. Support Zero-Copy in GrpcClientProtocolService (#1007)

RATIS-1990. Refactor appendEntries processing to support reference count (#1011)

RATIS-2009. ReferenceCount should work for all LogEntry types. (#1021)

RATIS-1934. Support Zero-Copy in GrpcServerProtocolService (#1014)

RATIS-2007. Zero-copy buffers are not released (#1027)

RATIS-2018. Zero-copy buffers are not released - 2nd chunk (#1032)

RATIS-1978. Add tests assertions to verify all zero-copy messages are released properly (#1023)

RATIS-1997. Refactor StateMachine interface to use ReferenceCountedObject (#1036)

RATIS-2020. Refactor TransactionContext to supply LogEntryProto via a ReferenceCountedObject (#1042)

RATIS-2028. Refactor RaftLog to supply log as ReferenceCountedObject (#1045)

RATIS-2026. LogAppender to consume log entries with reference count (#1049)

RATIS-1979. Allow StateMachine.read to return a ReferentCountedObject (#1062)

RATIS-2059. Missing reference count when putting log entries to cache on follower. (#1067)

RATIS-2077. Timedout StateMachine retainRead is released twice (#1081)

RATIS-2092. Add metrics to expose number of zero-copy unclosed messages (#1095)

RATIS-2096. Add a conf to enable/disable zero copy. (#1099)

RATIS-2093. Decouple metadata and configuration entries from appendEntries buffer for stateMachineCache' (#1096)

RATIS-2094. Avoid corruptions from TransactionContext's stateMachineLogEntry and stateMachineContext. (#1106)

RATIS-2114. Corruption due to SegmentedRaftLogWorker queue LogEntry without reference counter (#1113)

RATIS-2151. TestRaftWithGrpc keeps failing with zero-copy. (#1164)

RATIS-2164. LeakDetector has a race condition. (#1163)

RATIS-2173. Fix zero-copy bugs for non-gRPC cases. (#1167)

RATIS-2220. Skip further tests after leak detected (#1193)

RATIS-2225. RaftClientRequest leak in RaftServerImpl. (#1198)

RATIS-2227. LogEntryProto leak in SegmentedRaftLog (#1199)

RATIS-2414. Add leak detection for ZeroCopyMessageMarshaller. (#1355)