You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
feat(avro): support LARGE_STRING, LARGE_BINARY, and LARGE_LIST in Avro datum writer #1103
The Avro datum writer in src/iceberg/avro/avro_data_util.cc currently handles arrow::Type::STRING, arrow::Type::BINARY, and arrow::Type::LIST but not their large variants. If an Arrow array with one of these large types is passed to the writer, it hits an unhandled case and fails.
The affected lines are:
avro_data_util.cc:751 — TODO(gangwu): support LARGE_STRING
avro_data_util.cc:759 — TODO(gangwu): support LARGE_BINARY
avro_data_util.cc:838 — TODO(gangwu): support LARGE_LIST
The fix is to add case ::arrow::Type::LARGE_STRING, case ::arrow::Type::LARGE_BINARY, and case ::arrow::Type::LARGE_LIST handling, mirroring the existing non-large implementations but casting to arrow::LargeStringArray, arrow::LargeBinaryArray, and arrow::LargeListArray respectively.
changed the title [-]Title: feat(avro): support LARGE_STRING, LARGE_BINARY, and LARGE_LIST in Avro datum writer[/-][+]feat(avro): support LARGE_STRING, LARGE_BINARY, and LARGE_LIST in Avro datum writer[/+]on Nov 7, 2026
Activity
[-]Title: feat(avro): support LARGE_STRING, LARGE_BINARY, and LARGE_LIST in Avro datum writer[/-][+]feat(avro): support LARGE_STRING, LARGE_BINARY, and LARGE_LIST in Avro datum writer[/+]