Arkiver Private Beta : A Platform to Simply Manage Web3 Data Pipelines for Full Stack Developers

As we get ready for our public launch of Arkiver we’ll be opening up private Beta for Web3 developers looking to streamline their data pipeline.

But first, what is Arkiver ?

Introducing Arkiver

Arkiver is a platform designed to make indexing, managing data pipelines & integrating blockchain data with Web3 applications as simple as possible.

Why We Built Arkiver

As previous DeFi developers we experienced the pain points of developing & maintaining Web3 applications. With the current tools leading to a number of pain points for users due to a number of key issues.

The fact that both deploying & maintaining Web3 apps is overly complex leads to times over allocating resources here. Our goal is to provide Web3 developers with the needed tools to streamline this process so they can speed up their development cycles.

How It Works

Arkiver provides a state of the product to easily manage data pipelines for Web3 developers while solving key problems with existing products. This is done by providing a product that is scalable & production ready, maintainable & developer friendly by following a modern development flow, modular & flexible enabling additional use cases for developers.

For teams using Arkiver this means faster developer cycles with more time spent building & innovating.

Arkiver is built by devs for devs. Creating and accessing a custom web3 API’s for integration into applications consists of 2 Simple Steps

Getting started (prerequisites for writing index jobs locally)

To start your Arkiver project simply run the below command once you have the Arkiver SDK set up locally.

Writing Arkive Jobs

Arkiver jobs are written in TypeScript allowing users to easily specify how both on & off chain data can be combined / transformed. Arkive jobs consist of three components

Entities : Entities are classes that describe the structure of your database schema. Entities are created by utilising Arkivers simple Factory functions to create entities that represent tables in your database.

Manifest : The Manifest class serves as the central configuration for your Arkive, allowing you to define data sources from various blockchains, map them to their respective handler functions, and set up your database schema using entity classes. By chaining method calls, you can create a comprehensive, easy-to-read manifest that outlines your entire Arkive configuration.

Handlers : Handlers are the functions responsible for processing incoming data from the data sources defined in the manifest. They transform the data, ensuring it conforms to the desired format, and store it in the database. With full end-to-end typesafety, handlers provide a powerful way to customise how data is processed and stored.

Example Arkive Jobs

• Indexing ERC20 Events
• Tracking ERC20 Historical Balances
• Vault Snapshots
• CRV LP Returns & Swaps
• Velodrome LP Returns & Swaps

Deploying Arkive Jobs

Arkive jobs can deployed from the command line with one line of code

Additionally to make the development flow simpler Arkiver jobs can first be run & tested locally.

Arkiver App

The Arkiver App allows users to track & manage their deployed jobs in a simple to use application. The app also provides a number of integrations to various developer tools to provide users with a modern developer experience for building Web3 applications.

Each Arkive Job that is deployed provides a friendly interface to monitor the Arkive jobs progress & activity, access relevant endpoints, integration with Github to provide a seamless experience for developers.

The Data Sources tab allows you track which Data Sources are being used for your Arkive job in addition to tracking their progress.

The Activity Section allows users to track API usage of their specific Arkive job

Use Cases

We’ve built Arkiver to serve various use cases with a number of teams already using Arkiver to manage their data pipeline. Some of the early use cases include

• Production ready end points for front ends of DeFi projects displaying key live & historical statistics for users such as APY’s, TVL, Volume
• Backtesting performance for various DeFi strategies including our custom backtesting library built on top of Arkiver
• BI & User Behaviour analysis tracking interactions for specific protocols to better understand user behaviour
• Internal Security Monitoring for protocols by tracking live metrics

Beta Testers

Interested in being an early user of Arkiver and paricipating in our Private Beta Feel free to get in touch with us

E : matt@robolabs.biz

TG : @degenRobot

Twitter : twitter.com/degenRobot

Discord : https://discord.gg/robovault-865495351175282708

About Us

In July 2021 we launched the DeFi product RoboVault becoming one the first DeFi protocols to successfully operate delta neutral strategies which protected against Impermanent Loss. Since its launch until RoboVault was sunsetted as a product in January 2023 it’s strategies generated over $2M for users.

While developing & operating RoboVault we immediately saw a number of major gaps in the available tools & infrastructure needed to successfully operate a Web3 protocol. As a result considerable resources were devoted to developing custom state of the art off chain tooling & infrastructure to reliably operate the advanced Delta Neutral Strategies utilised by RoboVault.

As a company we saw the majority of the value of our technology not in the DeFi protocol RoboVault but instead in the tooling & infrastructure we had developed that allowed us to operate RoboVault. Based on this as we decided to focus on building Arkiver & other tools

Source