Open Source with Databend - IPFS Storage Backend Support

[PsiACE]

Mentor

@Xuanwo

Overview

Adding IPFS storage backend support to OpenDAL and Databend. IPFS stands for InterPlanetary File System, the storage cornerstone for many Web3 applications. The addition of IPFS support to Databend allows Databend to analyze the vast amount of data held on IPFS in a native application. Completion of this project will improve understanding and knowledge of Databend's storage layer and IPFS and will be useful in the future, whether in the direction of database or decentralized storage.

Output Requirements

• Complete support for IPFS in OpenDAL, passing behavior tests
• Databend supports IPFS as a STAGE location

COPY INTO mytable
  FROM 'ipfs://QmPK1s3pNYLi9ERiq3BDxKa4XosgWwFRQUydHUtz4YgpqB/data.csv'
  FILE_FORMAT = (type = "CSV" field_delimiter = ','  record_delimiter = '\n' skip_header = 1)

Technical Requirements

• Familiar with Rust
• Familiar with Git, GitHub-related operations

Community Rewards

• A beautiful gift x 1
• Prize: 8000RMB (before tax)
• Proof of completion of project/internship x 1

How to Participate

The project will be open for applications from 28 June and we will be tracking the progress of the project in this discussion.

Final proposals need to be commented on under this Discussion, in one of the following ways.

• Online documents with public access
• A file uploaded as an attachment
• A link to the proposal Discussion

One applicant will be selected to participate in and complete this project.

---

Open Source with Databend is an open source program initiated and long supported by Datafuse Labs. Its aim is to encourage students to actively participate in the development and maintenance of Databend and its surrounding projects, to identify and nurture more talented contributors and maintainers, and to contribute to the development of a thriving community.

Students can apply for the projects they are interested in at the "Project Communication and Application Submission" stage, and will be personally guided by a community mentor on a one-to-one basis after being selected. Students who complete the project and pass the assessment will receive a beautiful gift from the community, activity prizes, and proof of completion of the project/internship.