GH-50859: [C++][Parquet] Move JsonWriter to simdjson utilities by rok · Pull Request #50990 · apache/arrow

rok · 2026-08-25T15:20:34Z

Rationale for this change

Parquet uses JsonWriter when ARROW_JSON=OFF, but its implementation was only built with Arrow JSON, causing link failures.

What changes are included in this PR?

Move JsonWriter to the simdjson utilities and update its callers and CMake/Meson builds.

Are these changes tested?

Yes. CMake shared/static and Meson Parquet builds pass with JSON disabled. Unit tests and pre-commit checks also pass.

Are there any user-facing changes?

No. This only fixes the affected build configuration.

AI disclosure - this was AI generated to test alternative approach to #50900.

GitHub Issue: [C++] parquet tools: linking error when ARROW_JSON=OFF with undefined reference to `arrow::json::JsonWriter::GetString() const' #50859

pitrou · 2026-08-25T16:06:57Z

The CI failures need fixing.

rok · 2026-08-25T16:55:01Z

@pitrou done.

Reranko05

@rok Since simdjson_internal.cc now exists, shouldn't all the non-template functions currently in simdjson_internal.h be moved into simdjson_internal.cc, leaving only declarations in the header?

rok · 2026-08-25T17:55:38Z

@rok Since simdjson_internal.cc now exists, shouldn't all the non-template functions currently in simdjson_internal.h be moved into simdjson_internal.cc, leaving only declarations in the header?

Done

Reranko05

LGTM!

rok · 2026-08-25T18:01:45Z

Again, this PR is purely AI generated. I will mark as ready for review once I review myself.

pitrou · 2026-08-27T12:27:37Z

@rok Are you willing to prioritize this?

rok · 2026-08-27T12:58:20Z

@pitrou I'll review this in about an hour and ping again

tadeja · 2026-08-27T13:35:19Z

@github-actions crossbow submit example-cpp-tutorial

github-actions · 2026-08-27T13:37:45Z

Revision: 973b4d2

Submitted crossbow builds: ursacomputing/crossbow @ actions-5765e8701c

Task	Status
example-cpp-tutorial

Parquet uses JsonWriter independently of the Arrow JSON module. Move the writer into the simdjson utilities so it is available whenever simdjson is enabled, including ARROW_JSON=OFF builds. Preserve the writer files as renames and update CMake, Meson, callers, and tests.

rok · 2026-08-27T15:25:59Z

+                 SOURCES
+                 json_writer_internal_test.cc
+                 EXTRA_LINK_LIBS
+                 simdjson::simdjson)


Should we use arrow::simdjson here instead? Both should work, but arrow alieas would hide the vendored/system simdjson.

if(SIMDJSON_VENDORED) add_library(arrow::simdjson ALIAS simdjson) else() add_library(arrow::simdjson ALIAS simdjson::simdjson) endif()

It seems better to use arrow::simdjson based on the above statements? cc @kou

Agreed, changed to arrow::simdjson.

rok · 2026-08-27T15:36:47Z

@github-actions crossbow submit example-cpp-tutorial

github-actions · 2026-08-27T15:40:36Z

Revision: 86e85bd

Submitted crossbow builds: ursacomputing/crossbow @ actions-e4578321bd

Task	Status
example-cpp-tutorial

rok · 2026-08-27T16:17:34Z

@pitrou this is ready for humans!

rok · 2026-08-27T17:17:04Z

@github-actions crossbow submit test-ubuntu-24.04-cpp-minimal-with-formats test-ubuntu-24.04-cpp-gcc-13-bundled test-ubuntu-24.04-cpp example-cpp-tutorial

Copilot

Pull request overview

Copilot reviewed 27 out of 28 changed files in this pull request and generated 1 comment.

wgtmac · 2026-08-28T06:47:41Z

 #include "arrow/json/object_parser.h"
+#include "arrow/util/json_writer_internal.h"
 #include "arrow/util/secure_string.h"


This seems to be a blocking issue.

Now if ARROW_WITH_SIMDJSON is enabled json/object_parser.cc will be included. ARROW_PARQUET enables ARROW_WITH_SIMDJSON, so this should now be handled. Previously it required ARROW_JSON.

github-actions · 2026-08-27T17:19:30Z

Revision: 4d93dff

Submitted crossbow builds: ursacomputing/crossbow @ actions-fca50b3ffc

Task	Status
example-cpp-tutorial
test-ubuntu-24.04-cpp
test-ubuntu-24.04-cpp-gcc-13-bundled
test-ubuntu-24.04-cpp-minimal-with-formats

rok · 2026-08-27T17:22:59Z

#50912 switched flight ODBC from RapidJSON to simdjson JsonWriter, but did not enable ARROW_WITH_SIMDJSON for ODBC-only builds. This PR now (4d93dff) makes JsonWriter available independently of ARROW_JSON, so it's possible to build ARROW_FLIGHT_SQL_ODBC=ON with ARROW_JSON=OFF.

wgtmac · 2026-08-28T06:26:08Z


+if needs_simdjson
+    arrow_util_srcs += [
+        'util/json_writer_internal.cc',


Meson can still compile Parquet encryption with JSON disabled, but json/object_parser.cc remains excluded because needs_json is false. Please build ObjectParser under the same simdjson gate, otherwise this configuration still fails to link.

wgtmac · 2026-08-28T06:44:03Z

+                 SOURCES
+                 json_writer_internal_test.cc
+                 EXTRA_LINK_LIBS
+                 simdjson::simdjson)


if(SIMDJSON_VENDORED) add_library(arrow::simdjson ALIAS simdjson) else() add_library(arrow::simdjson ALIAS simdjson::simdjson) endif()

It seems better to use arrow::simdjson based on the above statements? cc @kou

wgtmac · 2026-08-28T06:47:41Z

 #include "arrow/json/object_parser.h"
+#include "arrow/util/json_writer_internal.h"
 #include "arrow/util/secure_string.h"


This seems to be a blocking issue.

Copilot

Pull request overview

Copilot reviewed 29 out of 30 changed files in this pull request and generated no new comments.

…ties Fully qualify simdjson utility calls so CMake unity builds do not resolve internal to arrow::json::internal.

Copilot

Pull request overview

Copilot reviewed 29 out of 30 changed files in this pull request and generated no new comments.

rok · 2026-08-28T11:37:54Z

@github-actions crossbow submit test-ubuntu-24.04-cpp-minimal-with-formats test-ubuntu-24.04-cpp-gcc-13-bundled test-ubuntu-24.04-cpp example-cpp-tutorial

github-actions · 2026-08-28T11:40:15Z

Revision: ab2c41a

Submitted crossbow builds: ursacomputing/crossbow @ actions-af7350541b

Task	Status
example-cpp-tutorial
test-ubuntu-24.04-cpp
test-ubuntu-24.04-cpp-gcc-13-bundled
test-ubuntu-24.04-cpp-minimal-with-formats

Copilot

Pull request overview

Copilot reviewed 29 out of 30 changed files in this pull request and generated no new comments.

Copilot

Pull request overview

Copilot reviewed 29 out of 30 changed files in this pull request and generated no new comments.

rok · 2026-08-28T13:22:37Z

@pitrou This is ready for review. CI failures appear unrelated and are present on main (JNI issue).

github-actions Bot added Component: Parquet Component: C++ Component: FlightRPC awaiting committer review Awaiting committer review labels Aug 25, 2026

rok mentioned this pull request Aug 25, 2026

GH-50859: [C++] Build JsonWriter when Parquet is enabled without JSON #50900

Open

Reranko05 reviewed Aug 25, 2026

View reviewed changes

Reranko05 approved these changes Aug 25, 2026

View reviewed changes

pitrou mentioned this pull request Aug 27, 2026

GH-51013: [C++] Replace RapidJSON in JSON test utilities #51014

Open

rok force-pushed the gh-50859-parquet-without-json branch from 973b4d2 to 5a1f424 Compare August 27, 2026 14:51

rok commented Aug 27, 2026

View reviewed changes

github-actions Bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels Aug 27, 2026

simplify meson change

86e85bd

github-actions Bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Aug 27, 2026

rok marked this pull request as ready for review August 27, 2026 15:50

rok requested review from lidavidm, pitrou and wgtmac as code owners August 27, 2026 15:50

rok added the CI: Extra: C++ Run extra C++ CI label Aug 27, 2026

set ARROW_JSON for odbc build

4d93dff

Copilot AI review requested due to automatic review settings August 27, 2026 17:14

Copilot started reviewing on behalf of rok August 27, 2026 17:14 View session

Copilot AI reviewed Aug 27, 2026

View reviewed changes

wgtmac reviewed Aug 28, 2026

View reviewed changes

Copilot AI review requested due to automatic review settings August 28, 2026 10:09

Copilot started reviewing on behalf of rok August 28, 2026 10:11 View session

Copilot AI reviewed Aug 28, 2026

View reviewed changes

apacheGH-50859: [C++][Parquet] Build ObjectParser with simdjson utili…

ab2c41a

…ties Fully qualify simdjson utility calls so CMake unity builds do not resolve internal to arrow::json::internal.

Copilot AI review requested due to automatic review settings August 28, 2026 10:51

rok force-pushed the gh-50859-parquet-without-json branch from bdee2b8 to ab2c41a Compare August 28, 2026 10:51

Copilot started reviewing on behalf of rok August 28, 2026 10:51 View session

Copilot AI reviewed Aug 28, 2026

View reviewed changes

github-actions Bot added awaiting changes Awaiting changes and removed awaiting change review Awaiting change review labels Aug 28, 2026

rok requested a lite review from Copilot August 28, 2026 12:55

Copilot started reviewing on behalf of rok August 28, 2026 12:56 View session

Copilot AI reviewed Aug 28, 2026

View reviewed changes

rok requested a balanced review from Copilot August 28, 2026 13:04

Copilot started reviewing on behalf of rok August 28, 2026 13:04 View session

Copilot AI reviewed Aug 28, 2026

View reviewed changes

rok requested a review from wgtmac August 28, 2026 20:12

Uh oh!

Conversation

rok commented Aug 25, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

pitrou commented Aug 25, 2026

Uh oh!

rok commented Aug 25, 2026

Uh oh!

Reranko05 left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rok commented Aug 25, 2026

Uh oh!

Reranko05 left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rok commented Aug 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pitrou commented Aug 27, 2026

Uh oh!

rok commented Aug 27, 2026

Uh oh!

tadeja commented Aug 27, 2026

Uh oh!

github-actions Bot commented Aug 27, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rok commented Aug 27, 2026

Uh oh!

github-actions Bot commented Aug 27, 2026

Uh oh!

rok commented Aug 27, 2026

Uh oh!

rok commented Aug 27, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions Bot commented Aug 27, 2026

Uh oh!

rok commented Aug 27, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

rok commented Aug 28, 2026

Uh oh!

github-actions Bot commented Aug 28, 2026

Uh oh!

rok commented Aug 25, 2026 •

edited by github-actions Bot

Loading

Reranko05 left a comment •

edited

Loading

Reranko05 left a comment •

edited

Loading

rok commented Aug 25, 2026 •

edited

Loading

rok commented Aug 28, 2026 •

edited

Loading