Blockchain-based storage network, Filecoin Network has announced the launch of its proprietary Filecoin Web Service (FWS) a cloud-based decentralized alternative to tech giants like the Amazon Web Service (AWS), and Microsoft Azure amongst others.
Filecoin Launches Filecoin Web Service (FWS) Decentralized Alternative to AWS
Filecoin Network, a blockchain-based storage network, has launched its proprietary cloud-based Filecoin Web Service (FWS), providing a decentralized alternative to major tech companies such as Amazon Web Service (AWS) and Microsoft Azure.
This launch represents a significant achievement for the engineering team of Filecoin, as the new protocol is based on the Filecoin protocol and designed to operate in a peer-to-peer manner.
Filecoin recognizes the benefits of cloud computing in terms of developer experience and aims to achieve these benefits while maintaining the transparent and open-source incentivization layers that decentralized networks provide.
While cloud services such as Google Cloud, AWS, and Microsoft Azure are dominant, they rely on centralized data centers that can be vulnerable to crashes, causing inconvenience to users globally.
How Filecoin Describe FWS?
What is FWS?
Filecoin Web Services (FWS) is a suite of storage and compute technologies that have been built on top of the decentralized Filecoin Network. The Filecoin Network has been designed to offer revenue and incentivization mechanisms that are integrated into the network.
FWS aims to provide the benefits of cloud computing developer experience while leveraging the transparent and open-source incentivization layers that decentralized networks can offer.
The technology stack offered by FWS includes various components such as computing, networking, and storage resources that can be utilized by developers to create decentralized applications. The components have been developed with scalability, flexibility, and security in mind, ensuring that they are well-suited for a broad range of use cases.
The FWS lineup includes two offerings: Estuary and Delta Technology Stack.
Estuary is a combination of various components, including the Estuary Node, which is a deployable and easy-to-manage Filecoin storage node. Estuary Dashboard, which provides a user-friendly interface for monitoring and managing storage deals on the network. It also offers developer tools and APIs, such as the Estuary API that lets developers build storage applications on top of Filecoin, and the Estuary SDK that provides several libraries and tools for network integration.
The Delta Technology Stack is a collection of open-source tools that facilitate the creation and management of Filecoin storage network deals. This includes the Delta Deal Making Engine, Delta Dataset Manager for handling large datasets, and Edge-UR Gateway for storing and serving unsealed copies.
Explaining Delta
Delta can be used to simplify the process of preparing and managing storage deals on the Filecoin Network. Delta can be used to manage data, include versioning, manage metadata, and track storage deal status, al1 of which makes it easier for users to publish their data on the Fîlecoin Network.
The Delta Deal Making Engine enables users to specify the terms of the storage deal, such as the amount of storage space needed, the price, and the conditons for the exchange. The platform then uses smart contracts on the Fïlecoin Network to enforce the terms of the storage deal and facilitate the transaction.
Delta can be used to wrap the complexities of preparing a storage deal on the Filecoin Network and provide a seamless experience for users looking to replicate their data on a decentralized storage network.
Features:
- Deal proposal preparation and announcement
- Piece commitment computation and optimization
- E2E/import support (online/offline)
- Auto/manual repair and deal renewal
- Wallet assignment
- Storage provider assignment and selection
- Blockstore cleanup
- Deal status management
- Replication management
Delta Dataset Manager
Delta Dataset Manager (Delta DM) is a tool to manage deal replication tracking for onboarding datasets to the Filecoin Network via import storage deals (otherwise known as out-of-band workflow). This provides a solution to quickly make deals for massive amounts of data, where the transfer is better handled out-of-band.
The Delta DM platform enables the streamlined management of datasets through an intuitive web-based interface. It tracks replication and DataCap and offers self-service for Client Service Providers through a pull mechanism for deals, It is agnostic of data prep and data transfer and can run independently of Boost or Lotus, allowing Delta DM + Delta to operate as a fully standalone solution.
Delta Importer
Delta Importer is a stand-alone binary designed to be run on a Storage Provider infrastructure. It automates importing CAR files into Boost from the filesystem. By integrating with Delta DM to request deals from the self-service API, Delta Importer facilitates a fully automated deal-making and deal ingestion pipeline. Delta DM has multiple modes of operation, covering a variety of different data ingestion strategies.
Coming Soon:
- Failed deal auto-repair
- Retrieval-SP – designate a single location for unsealed copy
- SP Metadata – detailed replication parameters
Edge-UR
Edge-UR is a dedicated node that enables customers to upload and retrieve user content on Estuary using the same APIkeys.
Each customer is assigned their own node, which switches the upload protocol for a seamless experience.
While data still needs to be uploaded via HTTP, the Edge-UR node facilitates the transfer of the file to a Delta node for making storage deals.
Overall, Edge-UR simplifies the process ofuploading and retrieving data on Estuary, while maintaining security and control over user content.
Features:
- Lightweight IPFS node that can peer with other IPFS nodes.
- Upload and retrieve – users will be able to upload and retrieve the file
- immediately after.
- Asynchronous deal making process using Delta.
- Keeps track of the content and its associated deals.
Ptolemy
Ptolemy is designed to function as an orchestration engine to process large datasets typically confined to S3 buckets or contiguous filesystems.
Ptolemy can package an entire filesystem structure in CAR files for deal making purposes. The goal of Ptolemy is to remove the effort around data preparation for storage providers and end users alike.
FWI
Filecoin Web Infrastructure represents a step towards decentralization and pushes the Filecoin Network forwards by being a blueprint for low cost, reliable compute and storage for deal making engines and other Filecoin technologies and services. Iťs an expandable compute cluster, storage system, and virtualization cluster and it includes high availability and Kubernetes.
FWI is also an open set of automation tools and infrastructure-as-code which can be used to build your own “”FWI-alikes”” and run your own enterprise grade Filecoin client infrastructure on your own hardware and on your own terms. It is adaptable to different hardware, different software and everything is pluggable and open source.
Among other things, FWI enables the provisioning of Customer Provisioned Infrastructure, allowing the engineering team to run infrastructure on behalf of clients in exchange for FIL for the first time.
Storage Market
Storage.market serves as an information hub for data storage products, providing users with analytics on the storage market and up-to-date news related to data storage. This platform can be particularly helpful for businesses and individuals looking to stay informed on industry trends and make informed decisions about storage products and services.
Client Engagement
To onboard data to the Filecoin Netork, users need to use specific tools and applications that enable them to interact with the network and perform various operations, such as uploading, retrieving, and managing data. This is where the Filecoin ecosystem comes in – our engineering team has been working with several clients who are building solutions to onboard data to the Filecoin Network, using the tools and expertise that our team provides.
Working with multiple clients on such projects can be challenging, as each client has unique requirements, use cases, and technical capabilities. However, by leveraging our knowledge of the Filecoin Networks architecture, protocols, and features, as well as the clients’ needs and expectations, we can develop customized solutions that meet their requirements and help them leverage the benefits of decentralized storage.
Working with Radiant Earth
Radiant Earth is an innovative organization that is dedicated to promoting positive global impact through the use of machine learning and Earth observation (EO) technologies. They offer a range of high-quality, open resources that are trusted by professionals and researchers around the world.
One of Radiant Earth’s core missions is to cultivate acommunity of practice that can develop standards around machine learning on EO. This involves bringing together experts in the fields of machine learning, EO, and related areas to collaborate, share knowledge, and develop best practices for using these technologies in a responsible, effective way.
As part of our work with Radiant Earth, we used our technology stack to onboard a small portion oftheir machine learning and EO data to the Filecoin Network. We understand the necessary steps to achieve this and with our tooling, we ensure that their data is appropriately formatted, securely stored, and easily accessible.
Tools we used:
- Ptolemy
- Delta Dataset Manager
- Delta Deal Making Engine
- Delta Importer
Working with SUCHO
SUCHO is an impressive initiative driven by over 1,500 volunteers from around the world who are working together online to digitize and safeguard Ukraine’s cultural heritage. In response to the ongoing conflict in Ukraine, SUCHO has taken action to preserve more than 5,000 websites and 40TB of data belonging to Ukrainian cultural institutions, with the goal of preventing these valuable resources from being lost or going offline with 5 different storage providers globally.
Tools we used:
- Ptolemy
- Delta Dataset Manager
- Delta Deal Making Engine
- Delta Importer
Working with Encloud
Encloud specializes in data security and they know the importance of using Filecoin to further their security features while providing the freedom of access to their users, We are working with Encloud on this initiative and we provided them access to our live Edge-UR node to test their proof-of-concept.
Tools we used:
- Delta
- Edge-UR
To access more crypto news: cryptodataspace.com
References
Leave a comment