Web3 Data Engineer

💡 CryptoQuant operates an easy and standardized Web3 data analysis service to provide institutional and retail investors in 150 countries around the world with the data analysis tools necessary for investing in Web3 assets.

CryptoQuant Tech team collects, processes, and analyzes data on transactions of blockchain assets such as BTC and ETH, as well as various types of financial activities (e.g., DeFi) that take place on the blockchain, and makes it easy for investors to understand the data.

We are looking for a data engineer who wants to work with a large amount of real-time blockchain transaction data and experience the fascination of blockchain data at a deeper level than anyone else.

Roles & Responsibilities

1. Develop data pipelines to collect and process blockchain data
   1. Extract raw data from various data sources
   2. Build data pipelines to process and load data
   3. Manage cloud infrastructure for data pipeline operation
   4. Develop CI/CD and monitoring system for building automated pipelines
2. Build a data warehouse for blockchain data analysis
   1. Develop blockchain domain data mart
   2. data quality management such as data consistency verification
3. Possible data engineering works are the following:
   1. Build data pipeline of Bitcoin / EVM (e.g. Ethereum) / Non-EVM series blockchains
   2. develop blockchain data analysis data mart
   3. develop data API for serving blockchain data

While carrying out these tasks, you can expect the following growth

1. You can accumulate experience in operating large-scale data warehouses while developing TB-scale or greater web3 data.
2. You can directly participate in the design and implementation of large-scale parallel processing and efficient workflow design while designing high throughput batch processing and low latency real-time streaming ETL infrastructure.
3. You can quickly increase your overall understanding of the crypto and web3 ecosystem by collaborating with global leading web3 data scientists and analysts.
4. With a customer-centric mindset, you can actively execute projects with project ownership.

Requirements

• Fits well with CryptoQuant culture. (https://bit.ly/3r4TH1v)
• Experience with data processing using Python, SQL.
• Experience with workflow management platforms (e.g. Apache Airflow)
• Experience building and operating data marts for various purposes
• Experience with Docker Containers or Kubernetes
• Experience in building CI / CD
• Experience with Git / GitHub
• Experience with Python web frameworks (e.g. Flask, FastAPI)

Nice to have

• Experience in designing, building, and operating real-time data processing (e.g. Kafka) or micro-batch data processing pipelines in a lead role
• Experience building, developing, and operating Kubernetes clusters at work
• Experience working with data warehousing solutions (e.g. Hadoop, Spark)
• Experience working with data discovery platforms (e.g DataHub, Amundsen)
• At least 3 years of relevant experience with RDB, NoSQL, etc.
• Experience in using and managing cloud services (e.g. AWS, GCP) / data platform (e.g. Snowflake)
• Knowledge of various blockchain concepts and structures
• Experience with blockchain node (e.g. Bitcoin, Ethereum) operations or on-chain data
• Strong communication skills and good written and spoken English ability.

Work location and working hours

Location: Remote

Working hours: 40 Hours per week (required for 1~3 core hours for collaboration)

Hiring Process

Review application > Take Home Assignment > Technical Interview > Cultural-fit Interview > Reference check > Job offer > Hiring

Other Notices

• Individual notifications regarding the results of each stage and interview schedule will be sent via email.
• Results of document submissions will be communicated within a week after submission.
  • If there is any delay compared to the results announced in the advertisement, we will also contact you individually.
• Pre-tasks will be notified through a passing email upon document approval and must be submitted within 7 days.
• Procedures following the pre-tasks will be conducted through schedule coordination.
• Job interviews will be based on the information provided in your submitted documents and the results of pre-tasks.
• Cultural fit interviews are interviews to assess the cultural fit of applicants based on the corporate culture of Cryptoquant.