Repository navigation

[FIP-40] merge fluss-rust - #3401

Closed

fresh-borzoni wants to merge 323 commits into

apache:mainfrom

fresh-borzoni:fip-40-merge-rust

This pull request is big! We're only showing the most recent 250 commits

Commits on Jan 18, 2026
- feat: introduce KvWriteBatch and PutKvRequest (#176)
  luoyuxia
  authored
  86c7fe5
Commits on Jan 19, 2026
- feat: support all basic datatypes in compacted key encoder(continuation) (#175)
  fresh-borzoni
  authored
  350d5a9
Commits on Jan 20, 2026
- feat: Introduce UpsertWriter (#169)
  leekeiabstraction
  authored
  1d74c4a
- feat: Introduce Kv table example (#181)
  leekeiabstraction
  authored
  da9c112
Commits on Jan 21, 2026
- feat: KvWriteBatch wiring in Sender (#184)
  leekeiabstraction
  authored
  b4fad4b
- feat: Fix TableLookup so that SchemaId field bytes are not passed to CompactedRow::from_bytes(), these fields can be skipped as current rust client implementation does not check schema and already …
  leekeiabstraction
  authored
  eaf5a24
Commits on Jan 23, 2026
Commits on Jan 24, 2026
- test: add it test for put & get kv for all supported datatypes (#204)
  linguoxuan
  authored
  e09250c
Commits on Jan 25, 2026
Commits on Jan 26, 2026
- test: add it for produce & scan log for all supported datatypes (#205)
  linguoxuan
  authored
  1bc399b
- chore: introduce SecurityTokenManager to update token in the background (#213)
  luoyuxia
  authored
  9d3917c
Commits on Jan 27, 2026
- chore: Add blocking poll into python bindings (#154)
  fresh-borzoni
  authored
  7cc7bf6
- chore: Introduce PartitionGetter and Partition utils (#214)
  leekeiabstraction
  authored
  c1dfcee
Commits on Jan 28, 2026
Commits on Jan 29, 2026
- chore: support estimated_size_in_bytes for write batch (#219)
  luoyuxia
  authored
  0b53d37
Commits on Jan 30, 2026
- feat: support scan from oss (#217)
  luoyuxia
  authored
  00f4aca
- feat: Implement partitioning in Upsert / Lookup (#220)
  leekeiabstraction
  authored
  83fa0aa
- feat: support produce partitioned table (#228)
  luoyuxia
  authored
  81dd6e0
Commits on Feb 1, 2026
- feat: support list offset for partitioned table (#229)
  luoyuxia
  authored
  4d50eb2
Commits on Feb 3, 2026
Commits on Feb 4, 2026
Commits on Feb 5, 2026
Commits on Feb 6, 2026
- feat: support unsubscribe partition (#257)
  luoyuxia
  authored
  9af12ea
- feat: introduce list partitions in cpp binding (#260)
  luoyuxia
  authored
  8b583a8
Commits on Feb 7, 2026
Commits on Feb 8, 2026
Commits on Feb 9, 2026
Commits on Feb 10, 2026
- doc: add python docs and API reference (#291)
  fresh-borzoni
  authored
  e0b3dac
- doc: Add documentation for rust (#242)
  leekeiabstraction
  authored
  2f5c247
- feat: support projection by names in CPP (#294)
  fresh-borzoni
  authored
  79f16ac
Commits on Feb 11, 2026
- chore: Builder pattern, cleanup, consistent API (#296)
  fresh-borzoni
  authored
  10637b7
- chore: refacotr config for CPP and connect -> create in cpp binding(#298)
  fresh-borzoni
  authored
  a447db9
Commits on Feb 12, 2026
- chore: Verify API consistent across clients (#302)
  fresh-borzoni
  authored
  97b2e17
Commits on Feb 13, 2026
Commits on Feb 14, 2026
- chore: remove LATEST_OFFSET which isn't handle by server (#312)
  leekeiabstraction
  authored
  c6b63ed
- chore: allow propagating hostname as raw bootstrap address (#307)
  zuston
  authored
  fdfde8d
Commits on Feb 15, 2026
- [docs] introduce client doc website (#300)
  leekeiabstraction
  authored
  eaadb3f
Commits on Feb 16, 2026
Commits on Feb 17, 2026
Commits on Feb 18, 2026
Commits on Feb 19, 2026
- chore: make RowView shared_ptr (#353)
  fresh-borzoni
  authored
  4dff1cb
Commits on Feb 20, 2026
- chore: Scan results returned per bucket python/cpp (#351)
  fresh-borzoni
  authored
  ec4eb74
Commits on Feb 22, 2026
Commits on Feb 23, 2026
- chore: fix IT failure from additional table properties (#368)
  leekeiabstraction
  authored
  a37c5ba
Commits on Feb 24, 2026
- chore: rename BucketView to BucketRecords (#370)
  fresh-borzoni
  authored
  30206ef
Commits on Feb 25, 2026
- feat: Add round robin bucket assigner (#360)
  charlesdong1991
  authored
  094ff3e
Commits on Feb 27, 2026
Commits on Feb 28, 2026
Commits on Mar 1, 2026
Commits on Mar 2, 2026
- docs: add cpp build guides with examples (#376)
  zhaohaidao
  authored
  20601fc
- chore: update dependency list for release 0.1.0
  luoyuxia
  committed
  03dc367
- Bump version to 0.2.0
  luoyuxia
  committed
  c61e1ee
- ci: update verify tag version
  luoyuxia
  committed
  43879ce
Commits on Mar 3, 2026
- chore: update rust docs (#416)
  luoyuxia
  authored
  b419363
- chore: error handling fix CPP, for pointer returning methods (#409)
  fresh-borzoni
  authored
  257eb7d
- ci: fix ci build wheel issue for python (#419)
  luoyuxia
  committed
  cf3c359
- chore: fix mut schema builder public api (#420)
  fresh-borzoni
  authored
  5718d20
Commits on Mar 4, 2026
- [doc] Setup workflow for doc publish (#414)
  leekeiabstraction
  authored
  2ceb512
- doc: update create a release doc (#421)
  luoyuxia
  authored
  b9357f7
Commits on Mar 5, 2026
- feat: Add getter/setter property for writer_bucket_no_key_assigner config in python (#397)
  charlesdong1991
  authored
  dd10579
- chore: update testing fluss image to 0.9.0 (#426)
  aicontentcreate2023-star
  authored
  ee8beee
Commits on Mar 7, 2026
- chore: Remove config duplication in examples (#427)
  charlesdong1991
  authored
  65a8ad4
Commits on Mar 8, 2026
Commits on Mar 9, 2026
- ci: check tablet server availabitility (#437)
  charlesdong1991
  authored
  7b3015b
Commits on Mar 11, 2026
Commits on Mar 12, 2026
- feat: allow configuring scanner fetch parameters (#417)
  pbanakar
  authored
  8642ea4
Commits on Mar 15, 2026
- [client] Add LookupResult::to_record_batch() (#411)
  pbanakar
  authored
  3ad3119
- feat: introduce idempotent writes (#404)
  fresh-borzoni
  authored
  7d4bfd6
Commits on Mar 19, 2026
- chore: no-op .asf.yaml change to attempt trigger gh page setup
  leekeiabstraction
  authored
  984e22c
- troubeshooting test commit
  clambertus
  committed
  427a317
- INFRA-27705 - infrastructure test commit
  clambertus
  committed
  0d1559d
- INFRA-27705 - remove test label
  clambertus
  committed
  4b3b5a8
Commits on Mar 20, 2026
- doc: optimize pyfluss description in pypi (#439)
  luoyuxia
  authored
  7666af0
- Revert "Bump version to 0.2.0"
  luoyuxia
  committed
  3c763d0
- [doc] Update fluss-rust readme markdown (#415)
  luoyuxia
  authored
  6740719
Commits on Mar 21, 2026
- chore: Idempotency bug: OOO loop when response is lost but subsequent batches succeed (#448)
  fresh-borzoni
  authored
  e26702e
Commits on Mar 23, 2026
- chore: added check to get_admin() before creating new admin (#369)
  toxicteddy00077
  authored
  3bd6b1b
- chore: make get admin sync (#450)
  luoyuxia
  authored
  da021ad
- chore: update dependency list for release 0.1.0
  zhengyunhong.zyh
  committed
  42e82e8
- Bump version to 0.2.0
  zhengyunhong.zyh
  committed
  de1644d
Commits on Mar 28, 2026
- feat: Add array data type support (#433)
  charlesdong1991
  authored
  f0e17a4
- [BUG] Fix possible TOCTOU race between leader discovery and server lookup in Lookuper (#451)
  fresh-borzoni
  authored
  51bd65a
Commits on Mar 30, 2026
- [TASK-470] Optimize null append in Arrow builder (#471)
  fresh-borzoni
  authored
  e05a3f0
Commits on Apr 1, 2026
- chore: fix annoying python CI/CD errors due to unsuported action (#473)
  
  fresh-borzoni
  and
  leekeiabstraction
  authored
  0d4956c
- feat: [TASK-315] Proto + RPC for LimitScan (#472)
  fresh-borzoni
  authored
  1fc28c0
Commits on Apr 3, 2026
- ci: fix release rust issue
  luoyuxia
  committed
  308560c
- ci: pin pypi publish action to ASF-approved SHA
  luoyuxia
  committed
  f1e1ea6
- ci: improve read me for python
  luoyuxia
  committed
  10f23c6
Commits on Apr 5, 2026
Commits on Apr 9, 2026
- feat: add async 'for' loop support to LogScanner (#424) (#438)
  qzyu999
  authored
  b8a66b0
- [test][infra] Unify IT infrastructure for all clients (#476)
  fresh-borzoni
  authored
  7399529
Commits on Apr 10, 2026
- fix python 3.11 bug in tests with async wait_for (#488)
  fresh-borzoni
  authored
  6b997e6
Commits on Apr 11, 2026
- chore: fix docusaurus (#486)
  fresh-borzoni
  authored
  cecab69
- [ci] use swatinem/rust-cache (#485)
  fresh-borzoni
  authored
  74d88cd
Commits on Apr 13, 2026
Commits on Apr 16, 2026
- feat: Elixir bindings initial PR (#452)
  fresh-borzoni
  authored
  6881f2c
Commits on Apr 17, 2026
- [ci/cd] fix python tests with more strict scoping (#494)
  fresh-borzoni
  authored
  be4e2d1
- feat: support batch lookup (#216)
  
  authored
  95ad757
Commits on Apr 19, 2026
Commits on Apr 23, 2026
- [c++] Add c++ support for Array data type (#501)
  charlesdong1991
  authored
  85b3a3c
Commits on Apr 25, 2026
- build(deps): bump actions/download-artifact from 4 to 8 (#408)
  dependabot[bot]
  authored
  9212b26
Commits on Apr 26, 2026
- feat: [metrics] Create metrics framework and add connection metrics (#407)
  charlesdong1991
  authored
  2009592
- feat: Basic CI/CD for elixir (#497)
  fresh-borzoni
  authored
  69941d5
Commits on Apr 29, 2026
- feat: [elixir] fine-grained errors (#507)
  fresh-borzoni
  authored
  012ec4f
Commits on Apr 30, 2026
- feat: (Python) Add async context manager (#487)
  qzyu999
  authored
  88c2ee5
Commits on May 2, 2026
- chore: regenerate Cargo.lock for declared metrics deps (#518)
  fresh-borzoni
  authored
  116dc25
Commits on May 3, 2026
Commits on May 6, 2026
- chore: Add validation for numeric config fields (#449)
  pbanakar
  authored
  db824d7
Commits on May 8, 2026
- [c++] Add nullability support for data type in c++ (#525)
  charlesdong1991
  authored
  860be9e
Commits on May 9, 2026
- [rust] Support API_VERSION in rust client. (#531)
  loserwang1024
  authored
  dbbaf9b
- Support FixedSizeBinary in python (#538)
  charlesdong1991
  authored
  90d7f72
Commits on May 10, 2026
Commits on May 13, 2026
- feat: add end-to-end ROW (nested struct) column serialization support
  
  hemanthsavasere
  authored and
  fresh-borzoni
  committed
  d4a0bb6
- fixes and improvements
  fresh-borzoni
  committed
  2b719f1
Commits on May 14, 2026
- feat: Add RecordBatchLogReader for bounded log reading (#446)
  charlesdong1991
  authored
  350d936
Commits on May 15, 2026
- feat: implement MAP data type support
  
  qzyu999
  authored and
  fresh-borzoni
  committed
  d88df5d
- fix: close Arrow read-path gaps for MAP
  fresh-borzoni
  committed
  c475f89
- chore: fix main broken due to new clippy useless_conversion (#548)
  fresh-borzoni
  authored
  97231ea
Commits on May 19, 2026
- [metrics] Add scanner fetch and remote download metrics (#553)
  charlesdong1991
  authored
  3bbfa95
Commits on May 23, 2026
- docs: add documentation for MAP dtype (#556)
  
  qzyu999
  authored and
  fresh-borzoni
  committed
  b090e50
- [chore] improve ergonomics for MAP dt, docs additions
  fresh-borzoni
  committed
  15bf742
- [ci] scope rust integration job to test_fluss target only (#561)
  fresh-borzoni
  authored
  a1712bb
Commits on May 25, 2026
- [rust] integration tests for MAP dt + restructure ITs for complex dts (#560)
  fresh-borzoni
  authored
  840a41a
- [test] Add Rust integration coverage for RecordBatchLogReader bounded reads. (#559)
  slfan1989
  authored
  4a836ea
Commits on May 26, 2026
- [metrics] Add scanner poll-timing metrics (#555)
  charlesdong1991
  authored
  4ca24ea
- feat: [metrics] Add database and table labels for scanner metrics (#565)
  charlesdong1991
  authored
  9eee500
Commits on May 27, 2026
- [elixir] feat: Extend Fluss.Config with writer tuning options (#566)
  nicolazar
  authored
  2e664e1
Commits on May 28, 2026
Commits on May 31, 2026
- [elixir] chore: Add dialyzer and tighten Fluss.Config setter guards (#582)
  nicolazar
  authored
  7848aaa
Commits on Jun 1, 2026
Commits on Jun 2, 2026
- [rust] Support paimon key encoder. (#579)
  loserwang1024
  authored
  9f3e877
Commits on Jun 3, 2026
- [elixir] feat: Add get_database_info admin call (#586)
  nicolazar
  authored
  4e64847
Commits on Jun 4, 2026
- [elixir] Optimize CI/CD with proper actions, reusing compiled deps (#598)
  fresh-borzoni
  authored
  fa80f69
Commits on Jun 6, 2026
- docs: comprehensive README update (#600)
  gnuhpc
  authored
  6242b99
Commits on Jun 7, 2026
- [python] map and row complex types support (#601)
  fresh-borzoni
  authored
  0d24bdd
- [c++] add prefix lookup (#606)
  fresh-borzoni
  authored
  63638ec
Commits on Jun 8, 2026
- [metrics] Add writer pipeline metrics (#609)
  charlesdong1991
  authored
  87303ea
Commits on Jun 9, 2026
- [python] Split examples in Python and enforce executability in CI for python examples (#610)
  
  charlesdong1991
  and
  cursoragent
  authored
  470c3c6
Commits on Jun 10, 2026
Commits on Jun 12, 2026
Commits on Jun 14, 2026
- [c++] Limit batch scanner (#614)
  fresh-borzoni
  authored
  8e3ed75
Commits on Jun 17, 2026
- chore: [metrics] Add client metrics and prometheus example (#617)
  charlesdong1991
  authored
  3187eb4
- chore: fix(test-cluster): manage containers via testcontainers' Docker client so start/stop share one runtime (#624)
  beryllw
  authored
  b98ab9c
Commits on Jun 18, 2026
- chore: fix tighten test cluster cleanup matching (#627)
  beryllw
  authored
  9bf1f4b
Commits on Jun 19, 2026
- [rust] Sync Fluss 1.x proto definitions and ApiKey registry (#628)
  
  authored
  8c108ba
- [client] Allow bootstrap endpoint with unknown server type (#622)
  
  fxbing
  and
  claude
  authored
  bf94c1c
- [rust] Add RPC message wrappers for core DB/table operations
  
  authored and
  fresh-borzoni
  committed
  6c1c534
- tighten pub visibility for protos
  fresh-borzoni
  committed
  9d682e3
Commits on Jun 21, 2026
- feat: [c++] Add MAP/ROW types, unify complex types under Value handle (#611)
  fresh-borzoni
  authored
  452a8aa
Commits on Jun 23, 2026
- [rust] Replace raw i64/i32 with TableId/PartitionId/BucketId type aliases in write path (#635)
  
  authored
  ee6a5ac
Commits on Jun 24, 2026
- [rust] Add RPC message wrappers for extended operations (#630)
  
  authored
  669cec7
Commits on Jun 26, 2026
- [elixir] feat: Add get_table_info admin call (#640)
  nicolazar
  authored
  936f534
- [rust] Add Fluss 1.x protocol support to the admin client (#631)
  
  authored
  0dae316
Commits on Jun 29, 2026
- [feat] Support subscribing to primary-key table changelog (#639)
  fresh-borzoni
  authored
  81e9494
- [elixir] ci: bump OTP to 28.5.0.2 (#646)
  nicolazar
  authored
  4292426
Commits on Jul 3, 2026
- [elixir] feat: Support full table descriptor options in create_table (#647)
  nicolazar
  authored
  5ac69f3
Commits on Jul 4, 2026
- Add 'fluss-rust/' from commit '5ac69f38fe0500d68d603167fce67acde5e3f261'
  fresh-borzoni
  committed
  19f119c
- [FIP-40] Adapt imported fluss-rust to the monorepo (proto, CI, docs, release)
  fresh-borzoni
  committed
  c577ee3

Commits

Commits on Jan 18, 2026

Commits on Jan 19, 2026

Commits on Jan 20, 2026

Commits on Jan 21, 2026

Commits on Jan 23, 2026

Commits on Jan 24, 2026

Commits on Jan 25, 2026

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Jan 28, 2026

Commits on Jan 29, 2026

Commits on Jan 30, 2026

Commits on Feb 1, 2026

Commits on Feb 3, 2026

Commits on Feb 4, 2026

Commits on Feb 5, 2026

Commits on Feb 6, 2026

Commits on Feb 7, 2026

Commits on Feb 8, 2026

Commits on Feb 9, 2026

Commits on Feb 10, 2026

Commits on Feb 11, 2026

Commits on Feb 12, 2026

Commits on Feb 13, 2026

Commits on Feb 14, 2026

Commits on Feb 15, 2026

Commits on Feb 16, 2026

Commits on Feb 17, 2026

Commits on Feb 18, 2026

Commits on Feb 19, 2026

Commits on Feb 20, 2026

Commits on Feb 22, 2026

Commits on Feb 23, 2026

Commits on Feb 24, 2026

Commits on Feb 25, 2026

Commits on Feb 27, 2026

Commits on Feb 28, 2026

Commits on Mar 1, 2026

Commits on Mar 2, 2026