Skip to content

Data ingestion pipeline that extracts raw event data from EigenLayer subgraphs via GraphQL, transforms it, and loads it into the primary PostgreSQL database for further processing.

Notifications You must be signed in to change notification settings

EigenWatch/subgraph-pipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

subgraph_pipeline

Getting started

Installing dependencies

Option 1: uv

Ensure uv is installed following their official documentation.

Create a virtual environment, and install the required dependencies using sync:

uv sync

Then, activate the virtual environment:

OS Command
MacOS source .venv/bin/activate
Windows .venv\Scripts\activate

Option 2: pip

Install the python dependencies with pip:

python3 -m venv .venv

Then active the virtual environment:

OS Command
MacOS source .venv/bin/activate
Windows .venv\Scripts\activate

Install the required dependencies:

pip install -e ".[dev]"

Running Dagster

Start the Dagster UI web server:

dg dev

Open http://localhost:3000 in your browser to see the project.

Learn more

To learn more about this template and Dagster in general:

About

Data ingestion pipeline that extracts raw event data from EigenLayer subgraphs via GraphQL, transforms it, and loads it into the primary PostgreSQL database for further processing.

Resources

Code of conduct

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published