Skip to content

Add Filesystem datastore support #53

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
leighmcculloch merged 11 commits into from
Jan 8, 2026
Merged

Add Filesystem datastore support #53

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
6c50781
add filesystem datastore support to config and update sdk dependency
leighmcculloch Jan 6, 2026
35e9b81
typo
leighmcculloch Jan 6, 2026
ba13515
update stellar go-sdk dependency and filesystem storage docs
leighmcculloch Jan 6, 2026
2b0b155
add filesystem datastore integration tests
leighmcculloch Jan 6, 2026
b96192f
update go-stellar-sdk to v0.0.0-20260106213347-6dbbccc633b8
leighmcculloch Jan 6, 2026
d78a7a4
update go-stellar-sdk to v0.0.0-20260106221911-f8fc5adebaaa
leighmcculloch Jan 6, 2026
cfe4e57
add filesystem storage type to test matrix
leighmcculloch Jan 6, 2026
a69c184
Merge branch 'main' into add-filesystem-datastore-support
leighmcculloch Jan 6, 2026
0ac51b9
convert filesystemDataPath to method
leighmcculloch Jan 8, 2026
e580261
Merge branch 'main' into add-filesystem-datastore-support
leighmcculloch Jan 8, 2026
a72da4e
update stellar go-sdk dependency and remove replace directive
leighmcculloch Jan 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 7 additions & 1 deletion config/config.example.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ admin_port = 6061

# Datastore Configuration
[datastore_config]
# Specifies the type of datastore. Currently, Google Cloud Storage (GCS) and s3-compatible storage (S3) are supported.
# Specifies the type of datastore. Currently, Google Cloud Storage (GCS), s3-compatible storage (S3), and Filesystem.
Comment thread
leighmcculloch marked this conversation as resolved.
Outdated
type = "GCS"

[datastore_config.params]
Expand All @@ -25,6 +25,12 @@ destination_bucket_path = "your-bucket-name/<optional_subpath1>/<optional_subpat
# The below example is for Cloudflare R2, but you can replace it with your S3-compatible storage endpoint.
#endpoint_url = "https://00000000000000000000000000000000.cloudflarestorage.com"

# params required for Filesystem storage
# The local filesystem path for storing data.
#destination_path = "/path/to/local/storage"
# Optional: disable metadata sidecar files (default: true)
#write_metadata = "false"

[datastore_config.schema]
# Configuration for data organization
ledgers_per_file = 1 # Number of ledgers stored in each file.
Expand Down
2 changes: 2 additions & 0 deletions go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,3 +143,5 @@ require (
gopkg.in/yaml.v3 v3.0.1 // indirect
gotest.tools/v3 v3.5.2 // indirect
)

replace github.com/stellar/go-stellar-sdk => github.com/stellar/go-stellar-sdk v0.0.0-20260106063441-d1379c717539
4 changes: 2 additions & 2 deletions go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -380,8 +380,8 @@ github.com/spf13/pflag v1.0.5 h1:iy+VFUOCP1a+8yFto/drg2CJ5u0yRoB7fZw3DKv/JXA=
github.com/spf13/pflag v1.0.5/go.mod h1:McXfInJRrz4CZXVZOBLb0bTZqETkiAhM9Iw0y3An2Bg=
github.com/spf13/viper v1.17.0 h1:I5txKw7MJasPL/BrfkbA0Jyo/oELqVmux4pR/UxOMfI=
github.com/spf13/viper v1.17.0/go.mod h1:BmMMMLQXSbcHK6KAOiFLz0l5JHrU89OdIRHvsk0+yVI=
github.com/stellar/go-stellar-sdk v0.0.0-20251210093830-27970a00c2d7 h1:vzKfpTTcwQNojsDG+qClvt1oh7P1mLxdmhAnFlvP8No=
github.com/stellar/go-stellar-sdk v0.0.0-20251210093830-27970a00c2d7/go.mod h1:fZPcxQZw1I0zZ+X76uFcVPqmQCaYbWc87lDFW/kQJaY=
github.com/stellar/go-stellar-sdk v0.0.0-20260106063441-d1379c717539 h1:3l9yzZgdXccup5+Zq23GCwg48qG8AoqWxeznnrEYXUM=
github.com/stellar/go-stellar-sdk v0.0.0-20260106063441-d1379c717539/go.mod h1:4osSHRDfb/D7zE2iNjmPdg2Gmbx0M/JLhTM4YcwPW5s=
github.com/stellar/go-xdr v0.0.0-20231122183749-b53fb00bcac2 h1:OzCVd0SV5qE3ZcDeSFCmOWLZfEWZ3Oe8KtmSOYKEVWE=
github.com/stellar/go-xdr v0.0.0-20231122183749-b53fb00bcac2/go.mod h1:yoxyU/M8nl9LKeWIoBrbDPQ7Cy+4jxRcWcOayZ4BMps=
github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
Expand Down