2024-10-24

Published on Thursday, October 24, 2024

By PermaDAO

In The ArFleet Debate Arweave

Tags The ArFleet Debate, Arweave

The ArFleet Debate: Breakthrough Innovation or Departure from Arweave's Permanent Storage Vision?

Abstract

ArFleet is a decentralized temporary storage protocol that establishes a trustless storage marketplace, allowing users to purchase time-limited storage services on demand. The protocol leverages RSA encryption and a random verification mechanism to effectively prevent Sybil attacks and ensure providers behave honestly. Together, ArFleet and Arweave form a dual storage system, offering users flexible short-term and permanent storage solutions to meet various data storage needs. Potential use cases of the ArFleet protocol include collaborative document editing, game state synchronization, and large-scale data migration. ArFleet collaborates with Arweave and AO to build a truly fullstack decentralized network, laying a solid foundation for the future of a decentralized internet.

Author：Kyle

Translator: Kyle

Reviewer: Marshal Orange

Source: Content Guild - Research

The release of ArFleet has sparked significant debate. Some see it as a departure from Arweave's vision of storage, while others view it as an important technical breakthrough — a step forward for decentralized storage. But before taking a side, it's important to understand what ArFleet is all about.

This article provides an in-depth analysis of how ArFleet operates, evaluates the effectiveness of its mechanisms, and explores its impact on the Arweave ecosystem.

Introduction to the ArFleet Protocol

ArFleet is a decentralized protocol for temporary storage, creating a marketplace without intermediaries. In simple terms, it allows users to purchase on-demand, time-limited storage services. Using the AO decentralized computing environment, ArFleet automates transactions and storage verification across multiple nodes, eliminating the need for third-party intermediaries or central servers.

This decentralized “storage rental marketplace” involves two types of participants:

Providers: Nodes that offer storage space for a specified period, renting out their local storage.
Clients: Entities that need storage and are willing to pay for it, such as individuals or companies purchasing temporary storage services.

Payments can be made using any method both parties agree on, without being limited to specific tokens. The funds are stored within the ArFleet protocol, while providers must submit collateral and periodically provide proof of storage to ensure data integrity. This mechanism eliminates the need for third-party involvement, creating a trustless system that fairly protects both providers and clients.

The internal workings of ArFleet are complex, covering aspects like data redundancy and the process of validating storage proofs. In the following sections, we’ll explore these details to provide a comprehensive understanding of how the ArFleet protocol functions.

How ArFleet Operates: A Step-by-Step Breakdown

ArFleet's operation works like an automated storage contract. It ensures that data is securely stored, from matching storage requests to verifying the data’s presence. Let’s view the key steps!

1. Client Assignment: Completing Task Allocation

When users need storage, they create a Storage Assignment using the ArFleet client software, specifying details like:

Amount they are willing to pay.
Storage duration (e.g., 30 days).
Redundancy level (e.g., the number of data replicas required).

The client software searches for providers that match these criteria. If the redundancy requirement is three replicas, the software matches the user with three suitable providers. This process is known as Storage Placement.

2. Market Query: Finding Providers

ArFleet includes a global AO process called the Marketplace, where clients can search for providers and their services. Providers post, update, and delete Announcements, which include the following details:

The version of the ArFleet protocol they are using.
Contact information, such as their Arweave wallet address, IP address, and port pairs.
The prices they offer for storage.
The duration limits placed on new deals.
The verification challenge duration limits placed on new deals.

While the Marketplace allows clients to filter providers based on price, duration, and proof submission frequency, it cannot guarantee:

A provider’s online status.
Available storage space.
Whether advertisements reflect the most recent information.

Clients are still responsible for contacting providers directly to confirm their availability. Once a provider meets the client's requirements, the Storage Placement process begins.

3. Executing Deal: Storage Placement

The storage matching process unfolds as follows:

Creation and Initialization: The client sends a request to the selected provider, who confirms it.
Encryption and Process Spawning: Data is encrypted and fragmented into chunks, forming a Merkle tree to verify data integrity. An AO process records the contract details.
Funding and Deal Acceptance: The client deposits the payment into an AO process called “Deal.” Once the provider confirms the transaction, the deal is officially initiated.
Data Transfer and Deal Completion: Encrypted data blocks are transmitted to the provider, who finalizes the transaction setup. Simultaneously, the agreed collateral is staked in the “Deal” AO process, marking the official conclusion of the deal.

Upon completion, the system transitions into the proof-of-storage verification phase. Before diving into the verification process, however, let’s address a key security risk—Sybil attacks.

Mitigating Sybil Attacks with RSA Encryption

As an open decentralized network, ArFleet faces the risk of Sybil attacks, where malicious providers create multiple fake nodes to gain control. To prevent this, ArFleet employs RSA encryption, ensuring that providers cannot impersonate multiple nodes or falsify storage.

In ArFleet’s approach, RSA encryption operates in reverse:

Private keys encrypt data (similar to signing).
Public keys decrypt it (similar to verification).

Each data replica is encrypted using different private keys provided by the client. Providers must decrypt the replicas using the corresponding public keys to make the data accessible. This setup ensures:

Only clients can generate legitimate replicas using their private keys, preventing providers from creating fake replicas.
Providers can't bypass verification, as each replica must be properly decrypted and stored to pass future checks.

4. Verification Challenges: Preventing Cheating

Once the Deal begins, ArFleet initiates verification challenges at regular intervals. Providers must submit valid verification proofs to demonstrate that the data remains intact. These challenges involve:

Merkle paths: The hash sequence from the Merkle tree’s root to the target leaf node (data block).
The chunk data: The specific data corresponding to the leaf node.

The goal is to prove that the data block exists and matches the root hash stored on the network. Depending on the outcome, the provider faces the following scenarios:

Valid proof: The provider receives rewards.
Invalid or missed proof: A portion of the collateral is forfeited.
Repeated failures: The entire collateral is lost.

While only small portions of data (e.g., 4 KB blocks) are checked at a time, ArFleet’s randomized challenges ensure that providers are highly likely to be caught if they attempt to delete or neglect stored data.

Why Is the Verification Mechanism Effective?

Let’s explore why ArFleet’s verification mechanism works through an example. Suppose a provider deletes 25% of the stored data to save space. The probability of avoiding detection decreases with each challenge:

This example shows how repeated verification significantly increases the risk for providers attempting to cheat. The system’s effectiveness lies in:

Randomization: Providers cannot predict which data blocks will be checked.
Accumulating risk: The probability of being caught increases with each challenge.
Severe penalties: The financial consequences of failure far outweigh the benefits of cheating.

How ArFleet Complements the Arweave Ecosystem

ArFleet works with Arweave to create a dual-storage system, offering users both temporary and permanent storage options. This allows users to flexibly adjust their storage strategies based on the importance and use cases of their data, enabling more efficient management.

For developers, ArFleet's temporary storage solution helps cut costs, especially for data that doesn't need to be kept long-term. This flexibility reduces storage pressure and cuts associated costs. Regular users can also manage their data based on their needs. When long-term storage is needed, temporary data can be moved to Arweave with a single click, ensuring permanent access.

ArFleet’s temporary storage offers faster access speeds and higher data exchange efficiency, making it ideal for scenarios involving frequent data transfers. Through the dual-storage system, ArFleet complements the Arweave ecosystem, excelling in the following use cases:

Collaborative Document Editing: During real-time collaborative editing, only the final version needs to be saved. Temporary data from the editing process can be stored on ArFleet without requiring permanent storage.
GameFi: Arweave can store essential assets, code, and player data, while ArFleet handles temporary game states and player interaction data, improving game performance and responsiveness.
Decentralized Video Platforms: Arweave ensures the permanent availability of video content, while ArFleet functions like a CDN, caching popular videos to reduce bandwidth consumption from repeated access.
Large-Scale Data Migration: ArFleet’s temporary storage serves as an intermediate layer for migrating large datasets to Arweave incrementally. It’s particularly useful for short-term storage of large files, ensuring a smooth migration process.
Application Settings Synchronization: User preferences, such as app settings, can be stored on ArFleet for synchronization across multiple devices, without the need for permanent storage of each change.
DID Management: Arweave stores user data, such as identity information, certificates, and credentials. Meanwhile, ArFleet stores temporary data like access tokens and session information.

Combining ArFleet and Arweave boosts storage flexibility and efficiency while providing strong support for building a variety of applications, empowering developers to create diverse and effective solutions.

Conclusion

The launch of ArFleet isn't a step back or a compromise for Arweave; it's a thoughtful response to the growing demand for diverse storage solutions. ArFleet seamlessly complements Arweave and works in tandem with AO to build a truly full-stack decentralized network.

In this ecosystem, ArFleet provides flexible short-term storage, Arweave ensures reliable permanent storage, and AO powers decentralized computation. Together, they form an efficient, scalable solution, creating a well-rounded storage ecosystem that integrates both temporary and permanent options — paving the way for the future of a decentralized internet.

🏆 Spot typos, grammatical errors, or inaccuracies in this article? Report and Earn !

Disclaimer: This article does not represent the views of PermaDAO. PermaDAO does not provide investment advice or endorse any projects. Readers should comply with their country's laws when engaging in Web3 activities.