🤖ByteAI Core Systems Roadmap (I)
The future of Web3 journalism. Decentralized by layered P2P networks and powered by open-source AI.
Going to the Source (Partially Implemented)
It begins with each channel aggregator ingesting hundreds of articles daily via a vast network of proprietary RSS feeds. Reuters/Assoc Press are choice partners; the nature of their business is to sell news facts to media outlets, who go on to bake in their own biases when reporting.
At ByteAI, we cut the noise from the start by going to the source.
Processing with Decentralised, Open-Source LLMs (Implemented)
Utilizing a proprietary ordinal ranking method and similarity scoring, we process each news piece into a large database of all received instances with ranked scores.
In this step, utilizing an open source autoregressive LLM like a fine-tuned Llama model ensures greater transparency in the modular technology powering the backend.
More importantly, we are building on PETALS, a novel Bittorent-style P2P network of compute with fragments of the model provided by each peer. Such decentralization guarantees safety from censorship and model “alignment”/"correction" updates, our ultimate goal.
Data Security (Implemented)
By storing its database logs on Filecoin’s decentralized file storage system, ByteAI is effectively placing the recovery of its databases out of reach of centralized parties. Filecoin, built atop the InterPlanetary File System (IPFS), is a decentralized storage network that enables users to store and retrieve data securely and efficiently, free from corporate control or censorship.
Read our medium on ByteAI's integration with Filecoin here
Lowering the Cost of Compute (Not Implemented)
To distribute compute across providers and locations, we use CUDOS Intercloud. CUDOS Intercloud is an innovative VM service that allows users to access computing resources permissionlessly in a Web3 environment. It is built upon a PoS layer 1 that combines both high cryptographic security and blockchain security.
In this stage, all of our internal processes will be spun up onto the Intercloud and integrated with the other aforementioned decentralized systems.
The CUDOS Intercloud integration not only achieve the goal of decentralization, but will also provide cheaper VM compute power than centralized cloud providers.
Online LLM (TBC)
The above will set us on the path towards truly decentralized provision of un-censorable news, the ultimate goal of our pursuits.
Last updated
