Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
96 commits
Select commit Hold shift + click to select a range
6cafed7
migrate to firehoseV2 (many flags changed)
sduchesneau Sep 1, 2022
0a6ba10
/cmd/firecosmos/... -> /cmd/firecosmos/cli/...
emiliocramer Sep 19, 2022
d0bc966
package main -> cli
emiliocramer Sep 19, 2022
a44ab74
flag standardizing
emiliocramer Sep 19, 2022
fb64455
firehose-cosmos bin -> firecosmos
emiliocramer Sep 19, 2022
f8052e3
firehose -> Firehose & changed deepmind -> firehose (test)
emiliocramer Sep 19, 2022
9f91a9d
console_reader -> consolereader
emiliocramer Sep 19, 2022
28be900
update gitignore
emiliocramer Sep 19, 2022
ed4952d
rename ingestor to reader
sduchesneau Oct 26, 2022
2edf9f6
Merge branch 'feature/firehoseV2' into develop
sduchesneau Oct 26, 2022
434f558
fix reader missing flag and error handling, add tools firehose-client
sduchesneau Oct 26, 2022
a624b6a
add metricsAndReadinessManager for reader
sduchesneau Oct 26, 2022
f457876
fix metricsUpdater blocking the pipeline, fix devel bootstrap flags
sduchesneau Oct 27, 2022
a3aa848
remove intense debugging print
sduchesneau Oct 27, 2022
d1e8ca1
add CHANGELOG, remove 'forked'-related flags, fix indexes
sduchesneau Oct 27, 2022
22d4ea4
New firehose cosmos implementation
billettc Mar 25, 2024
72cb9bc
initial project structure and proto files
billettc Mar 25, 2024
dddc56a
add missing file
billettc Mar 25, 2024
f308f45
make go.mod compatible with injective-cosmos-core
billettc Mar 26, 2024
2a104e0
wip
billettc Mar 26, 2024
a71b6d9
Snapshot
abourget Mar 27, 2024
4bccd05
First attempt at reading the storage of Injective using cometbft's la…
abourget Mar 27, 2024
a8f5ed3
We'll need to rebuild a RequestFinalizeBlock, which holds all the ori…
abourget Mar 27, 2024
5dfc65a
Stub, work in progress.
abourget Apr 4, 2024
a5a06de
wip
billettc Apr 11, 2024
045a49b
git ignore idea
billettc Apr 11, 2024
6e8734c
Implement injective poller
ArnaudBger Apr 12, 2024
4225311
fix block extraction
billettc Apr 15, 2024
97c3181
fix fetcher compilation error
billettc Apr 15, 2024
a74f08e
fix Misbehavior from evidences array size issue
billettc Apr 16, 2024
9db3022
cleanup and refactoring
billettc Apr 16, 2024
5738e37
fix utf error. change loader to use new transaction conversion
billettc Apr 18, 2024
a25a5cf
github workflow
billettc Apr 18, 2024
3db8a65
fix github workflow
billettc Apr 18, 2024
0875347
fix dockerfile
billettc Apr 18, 2024
89d737e
fix github action test
billettc Apr 19, 2024
b653393
fix compilation issue
billettc Apr 19, 2024
b862bfd
remove dummy tests
billettc Apr 19, 2024
487ec4d
new code structure and github action
billettc Apr 24, 2024
6c62907
add missing files
billettc Apr 24, 2024
2719040
fix Dockerfile
billettc Apr 24, 2024
c9856da
remove useless Dockerfile.injective
billettc Apr 24, 2024
896797d
added endpoint fall over
billettc Apr 26, 2024
e62746e
fix go mod
billettc Apr 26, 2024
992c814
remove solana from readme
billettc Apr 26, 2024
e56cec3
adjust proto file path structure
billettc May 2, 2024
a9c14ae
adjust proto file path structure
billettc May 2, 2024
47102b6
fix compilation issue
billettc May 2, 2024
94db6a4
fix proto path structure
billettc May 2, 2024
c23b28f
remove uppercase from block id and parent id
billettc May 14, 2024
ed38033
fix parent block id
billettc May 14, 2024
ef5d5a6
Add rpc client into logs
ArnaudBger Jul 9, 2024
4b70388
add endpoints
ArnaudBger Jul 9, 2024
09fa7f7
add unmarshall discard unknown option when unmarshalling event to cus…
Eduard-Voiculescu Aug 8, 2024
daf7213
update gitignore and adding script to start up poller
Eduard-Voiculescu Aug 8, 2024
066c955
adding tools fix unknown type blocks
Eduard-Voiculescu Aug 8, 2024
9f0a708
fix tool
Eduard-Voiculescu Aug 8, 2024
3509f83
handle eof error
Eduard-Voiculescu Aug 9, 2024
f97629c
Update dependencies and refactor event handling
billettc Aug 14, 2024
e70bd3c
adding comebft
Eduard-Voiculescu Aug 14, 2024
e3975f0
renaming module from v03810 to 03810
Eduard-Voiculescu Aug 14, 2024
71d899a
adding commands
Eduard-Voiculescu Aug 14, 2024
91c7f2d
update fireinjective
Eduard-Voiculescu Aug 14, 2024
f148a45
renaming of injective -> poller module name
Eduard-Voiculescu Aug 14, 2024
1c0e4ab
update description for fireinjective and firemantra binaries
Eduard-Voiculescu Aug 14, 2024
176d87e
fix git workflow
Eduard-Voiculescu Aug 14, 2024
1a83b45
fixing docker build
Eduard-Voiculescu Aug 14, 2024
cdd6ea5
adding firemantra to cosmos binary
Eduard-Voiculescu Aug 14, 2024
dd69d02
adding mantra and injective poller scripts
Eduard-Voiculescu Aug 14, 2024
da0abb6
wip
billettc Aug 19, 2024
4ab9a6e
Refactor packages and update build paths
billettc Aug 19, 2024
5e33c31
added missing file and fix github action
billettc Aug 19, 2024
112f58b
git github action
billettc Aug 19, 2024
b08bd87
fix github binary path
billettc Aug 19, 2024
e493bfd
fix github binary path ++
billettc Aug 19, 2024
c864f4e
wip
billettc Aug 19, 2024
249906b
fix block hashes tool
billettc Aug 19, 2024
40a80eb
fix block hashes tool
billettc Oct 8, 2024
fc40bec
Update .gitignore to exclude additional IDE configuration files
billettc Oct 8, 2024
a68f7c0
Update README.md with Vara Firehose details
billettc Oct 8, 2024
82033d2
Update README.md
Giuliano-1 Oct 30, 2024
e4e02ec
bump firecore to fix starting with last block in cursor instead of th…
sduchesneau Jan 10, 2025
e08ad1e
bump firehose-core to 1.7.3 and format readme
Eduard-Voiculescu Feb 5, 2025
03c73d2
wrap comet http client and remove retry as it is handled in the fireh…
Eduard-Voiculescu Feb 6, 2025
9e8b626
adding firehose banner
Eduard-Voiculescu Feb 6, 2025
e14a0a4
Introduced a new flag for maximum block fetch duration in `cmds.go`.
billettc Mar 24, 2025
9350c61
bump firecore to v1.12.4
sduchesneau Jan 6, 2026
79bd6c2
adjust build step in github for mantra-v* and injective-v*
sduchesneau Jan 6, 2026
630a00f
bump github runner version to 24.04
sduchesneau Jan 6, 2026
5850339
increase max-block-fetch-duration to 60s
sduchesneau Jul 2, 2026
1e07ede
Keep CometBFT v1 consensus params and BLS keys on cosmos blocks
billettc Aug 31, 2026
218fbf2
Add CometBFT v1 FinalizeBlock converter for cosmos blocks
billettc Aug 31, 2026
0b32428
Merge pull request #7 from streamingfast/wrangler/cometbft-v1-converter
billettc Sep 1, 2026
3825a93
Put the CometBFT v1 converter in cometbft/101 so Go can fetch it
billettc Sep 1, 2026
f21f3e3
Merge pull request #9 from streamingfast/wrangler/rename-cometbft-101…
billettc Sep 1, 2026
e4a0121
Split ConvertBlock into cometbft/101/convert so chain nodes can impor…
billettc Sep 1, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions .dockerignore

This file was deleted.

34 changes: 0 additions & 34 deletions .github/workflows/build.yml

This file was deleted.

105 changes: 105 additions & 0 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
---
name: Build docker image

on:
push:
tags:
- "mantra-v*"
- "injective-v*"
branches:
- "*"
workflow_dispatch:

env:
REGISTRY: ghcr.io
IMAGE_NAME: ${{ github.repository }}

jobs:
build:
runs-on: ubuntu-24.04

permissions:
contents: read
packages: write

strategy:
matrix:
go-version: [1.22.x]

outputs:
tags: ${{ steps.meta.outputs.tags }}

steps:
- uses: actions/checkout@v3

- name: Set up Go
uses: actions/setup-go@v2
with:
go-version: ${{ matrix.go-version }}

- uses: actions/cache@v3
id: cache-go
with:
path: |
~/.cache/go-build
~/go/pkg/mod
key: ${{ runner.os }}-go-${{ hashFiles('**/go.sum') }}
restore-keys: |
${{ runner.os }}-go-

- name: Branch name
id: extract_branch
shell: bash
run: |
echo "##[set-output name=branch;]$(echo ${GITHUB_REF#refs/heads/})"
echo "##[set-output name=release_train;]$(echo ${GITHUB_REF#refs/heads/release/})"

- name: Build Injective
working-directory: ./fireinjective
run: go build -v -ldflags "-X main.version=${{ github.event.ref }} -X main.commit=${{ github.sha }} -X main.date=$(date -u +%Y-%m-%dT%H:%MZzs)" -o ./fireinjective .

- name: Build Mantra
working-directory: ./firemantra
run: go build -v -ldflags "-X main.version=${{ github.event.ref }} -X main.commit=${{ github.sha }} -X main.date=$(date -u +%Y-%m-%dT%H:%MZ)" -o ./firemantra .

- name: Log in to the Container registry
uses: docker/login-action@f054a8b539a109f9f41c372932f1ae047eff08c9
with:
registry: ${{ env.REGISTRY }}
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}

- name: Generate docker tags/labels from github build context
id: meta
uses: docker/metadata-action@98669ae865ea3cffbcbaa878cf57c20bbf1c6c38
with:
images: ${{ env.REGISTRY }}/${{ env.IMAGE_NAME }}
tags: |
type=ref,event=tag
type=sha,prefix=,enable=true
type=raw,enable=${{ github.ref == 'refs/heads/main' }},value=main
type=raw,enable=${{ github.ref == 'refs/heads/develop' }},value=develop
type=raw,enable=${{ github.ref == 'refs/heads/devnet' }},value=devnet
type=raw,enable=${{ startsWith(github.ref, 'refs/heads/release/v') }},value=${{ steps.extract_branch.outputs.release_train }}
flavor: |
latest=${{ startsWith(github.ref, 'refs/tags/') }}

- name: Build and push Docker image
uses: docker/build-push-action@ad44023a93711e3deb337508980b4b5e9bcdc5dc
with:
context: .
push: true
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}

slack-notifications:
needs: [build]
runs-on: ubuntu-24.04
steps:
- name: Slack notification
env:
SLACK_WEBHOOK: ${{ secrets.SLACK_WEBHOOK }}
uses: Ilshidur/action-slack@2.0.2
with:
args: |
:done: *${{ github.repository }}* Success building docker images from ${{ github.ref_type }} _${{ github.ref_name }}_ (${{ github.actor }}) :sparkling_heart: ```${{ join(needs.build.outputs.tags, ' ') }}```
58 changes: 58 additions & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,58 @@
name: Build and Test

on:
push:
branches:
- master
- develop
pull_request:
branches:
- "**"

jobs:
test:
name: Test
runs-on: ${{ matrix.os }}
strategy:
matrix:
go-version: [1.22.x]
os: [ubuntu-latest, macos-latest]
steps:
- name: Set up Go
uses: actions/setup-go@v2
with:
go-version: ${{ matrix.go-version }}

- name: Check out code
uses: actions/checkout@v3

- name: Cache Go modules
uses: actions/cache@v3
with:
# In order:
# * Module download cache
# * Build cache (Linux)
# * Build cache (Mac)
path: |
~/go/pkg/mod
~/.cache/go-build
~/Library/Caches/go-build
key: ${{ runner.os }}-go-${{ hashFiles('**/go.sum') }}
restore-keys: |
${{ runner.os }}-go-

- name: Run Poler tests
working-directory: ./fireinjective
run: go test ./...

- name: Build Poller binaries
working-directory: ./fireinjective
run: go build .

- name: Run Poler tests
working-directory: ./firemantra
run: go test ./...

- name: Build Poller binaries
working-directory: ./firemantra
run: go build .
58 changes: 0 additions & 58 deletions .github/workflows/release.yml

This file was deleted.

24 changes: 15 additions & 9 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,9 +1,15 @@
.DS_Store
tmp
devel/**/tmp
fh-data
dist/
build/
firehose.yml
firehose-*.yml
.vscode/
*.lz4
/.idea
/fireinjective/.idea/
/fireinjective/devel/.env
/fireinjective/devel/data
/cometbft/03811/.idea/.gitignore
/cometbft/03811/.idea/03811.iml
/cometbft/03811/.idea/modules.xml
/cometbft/03811/.idea/vcs.xml
/firemantra/.idea/.gitignore
/firemantra/.idea/firemantra.iml
/firemantra/.idea/modules.xml
/firemantra/.idea/vcs.xml
/firemantra/devel/data
/devel/data
1 change: 0 additions & 1 deletion CHANGELOG.md

This file was deleted.

1 change: 0 additions & 1 deletion CODEOWNERS

This file was deleted.

33 changes: 11 additions & 22 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,29 +1,18 @@
# ------------------------------------------------------------------------------
# Go Builder Image
# ------------------------------------------------------------------------------
FROM golang:1.18 AS build
# syntax=docker/dockerfile:1.2

ENV CGO_ENABLED=0
FROM ghcr.io/streamingfast/firehose-core:v1.12.4 as core

WORKDIR /build
COPY . .
FROM ubuntu:24.04

RUN go mod download
RUN make build
# gettext-base is used for envsubst
RUN apt-get update && apt-get -y install ca-certificates htop iotop sysstat strace lsof curl jq tzdata file gettext-base && rm -rf /var/cache/apt /var/lib/apt/lists/*
RUN rm /etc/localtime && ln -snf /usr/share/zoneinfo/America/Montreal /etc/localtime && dpkg-reconfigure -f noninteractive tzdata

# ------------------------------------------------------------------------------
# Target Image
# ------------------------------------------------------------------------------
FROM alpine AS release
ADD /fireinjective/fireinjective /app/fireinjective
ADD /firemantra/firemantra /app/firemantra

ARG USER_ID=1234
ENV PATH "$PATH:/app"

WORKDIR /app/
COPY --from=core /app/firecore /app/firecore

COPY --from=build /build/build/firehose-cosmos /app/firehose

RUN addgroup --gid ${USER_ID} firehose && \
adduser --system --uid ${USER_ID} firehose && \
chown -R firehose:firehose /app

USER ${USER_ID}
ENTRYPOINT [""]
Loading
Loading