create account

A Decentralized Database for Decentralized Internet by eponomarev

View this thread on: hive.blogpeakd.comecency.com
· @eponomarev · (edited)
$4.69
A Decentralized Database for Decentralized Internet
![Fluence decentralized database](https://cdn-images-1.medium.com/max/1600/1*rPxjzCqPF9waC3gSDVKURA.jpeg)

In our [previous post](https://steemit.com/ico/@eponomarev/introducing-fluence-a-blockchain-secured-decentralized-database) we have discussed how various data leaks are exposing our personal data to potential wrongdoers. However, not only “evil hackers” hunt that data, various government structures or regulators would also be happy to get their hands on it. We think that the best way to minimize negative consequences of such breaches is to start acting as if the data is already exposed to everyone on the Internet. In this case the data just has to be encrypted first before uploading to anywhere.

By decentralizing data storage and giving private keys of data to its owners, we can reduce leaks practically to zero. Removing centralized servers also imposes significant demands: total encryption and flexible access management.

Let’s define a database that meets all the requirements.

## Disintermediation
What is a real decentralization for a database? It means that the database stores data on nodes that are controlled by anyone. A node, run by private owners, can join or leave the network at any moment of time and should not affect data accessibility and integrity. Simultaneously, because nodes can be located geographically anywhere, decentralization design gives fault tolerance and censorship resistance by default.

![Network architecture](https://cdn-images-1.medium.com/max/1600/1*ro9HO0YkH1d5qmloIOHwwg.png)

## Confidentiality
Since the database relies on a trustless environment, there should not be a way for nodes or any third parties to read data uploaded by the owner. This can be achieved by encryption techniques when only the owner of a private key associated with particular data can decrypt a piece of data. Nodes store data itself and metadata, but are not able to extract anything valuable from it. In such architecture no data leaks are possible until a private key is revealed by the owner to the public.

## Structured data
All mentioned above is achievable with decentralized file storages: Storj, Sia, Swarm. They provide accessibility, replication, and ability to store private files on trustless nodes by rewarding them with crypto tokens. The problem is that these projects are designed to store only files, but not the structured data. However, we can build a database index layer on top of a decentralized storage. We could create encrypted B-Tree indexes to represent the data structure without data deciphering. This approach allows to upload structured data, run queries, full-text search — all properties of traditional databases but without disclosing nature of data.

## Consensus
In a trustless environment it is essential to protect data from attacks and counterfeits. Each data update or select should be confirmed by the network to guarantee truth. Using blockchain for this task will reduce speed, so we aim to use multi-signature responses and proof-of-retrievability algorithm. Our solution doesn’t require all nodes in the network to participate in consensus for each request: it’s enough to wait for a confirmation only from a subset of nodes responsible for a particular database.

![Query consensus](https://cdn-images-1.medium.com/max/1600/1*RzBgACr74Pwj4o3Wzy2WrA.png)

## Access management
Modern applications are usually designed in a way that data uploaded by different users can be shared, merged, analyzed and obtained by a variety of ways. Enterprises need flexible permissions mechanism to manage granular data access, to grant or revoke permissions without excessive frictions. Via smart contracts and proxy re-encryption we can design such key management that is compliant with [HIPAA](https://www.hhs.gov/hipaa/for-professionals/security/laws-regulations/index.html), GDPR, HITECH, PCI and other regulations.

![Data sharing workflow](https://cdn-images-1.medium.com/max/1600/1*5KHguyjvtYXOStVUFFht2Q.png)

What about other solutions? Is Fluence unique? Let’s take a look at the market:

- **BigchainDB.** This is a great attempt to combine blockchain with traditional databases to get immutability, scalability, and performance. However, BigchainDB is more focused on private intranets and doesn’t provide real decentralization and encryption. BigchainDB is suitable for organizations or associations who want to eliminate mediators from business processes but keep a centralized control.
- **Swarm, Filecoin, Storj, Sia.** All these projects propose different ways to utilize world computers’ storage capacities. Storj, Sia are in fact “a decentralized Dropbox” with underlying p2p storage protocol. They solve lots of difficulties: data partitioning, retrievability, nodes motivation and content delivery. However, to analyze the data one has to download it first. Fluence, on the other hand is able to run queries on the miner nodes that doesn’t require expensive network data transfers.
- **Proprietary encrypted databases.** There are many solutions for traditional databases that provide data regulations compliance and limited access management to enterprises. But usually, when a company needs to share data for any joint venture or move data between locations, it becomes too complicated and integratively expensive.

## Final notes
Ubiquitous decentralization trend that we observe these days has risen due to economic advantages that the removal of a central party provides. Blockchain removes excessive manual verification work by employing the whole network to make a consensus. Storage and computational markets that are built with blockchains significantly reduce the storage price by putting unused resources back to work.

Fluence aims to create a market for structured data. Any data owner can store, share or monetize her data transparently with cryptographically guaranteed privacy. The immense scale gives the ability to aggregate and handle really big data, leading to new insights and opportunities for humanity.

## Read more about the technical architecture in our [Tech Whitepaper](http://static.fluence.ai/Tech_Whitepaper.pdf)
## [Join our Pre-ICO](http://fluence.ai/preico) as an early investor.
## Join our community on [Twitter](https://www.twitter.com/@FluenceAI), [Telegram](https://t.me/FluenceAI) or [Medium](https://medium.com/fluenceai)
👍  , , , , , , , , , , , , , , , , , , , ,
properties (23)
authoreponomarev
permlinka-decentralized-database-for-decentralized-internet
categoryico
json_metadata{"tags":["cryptocurrency","ico","blockchain","bitcoin","crypto"],"image":["https://cdn-images-1.medium.com/max/1600/1*rPxjzCqPF9waC3gSDVKURA.jpeg","https://cdn-images-1.medium.com/max/1600/1*ro9HO0YkH1d5qmloIOHwwg.png","https://cdn-images-1.medium.com/max/1600/1*RzBgACr74Pwj4o3Wzy2WrA.png","https://cdn-images-1.medium.com/max/1600/1*5KHguyjvtYXOStVUFFht2Q.png"],"links":["https://steemit.com/ico/@eponomarev/introducing-fluence-a-blockchain-secured-decentralized-database","https://www.hhs.gov/hipaa/for-professionals/security/laws-regulations/index.html","http://static.fluence.ai/Tech_Whitepaper.pdf","http://fluence.ai/preico","https://www.twitter.com/@FluenceAI","https://t.me/FluenceAI","https://medium.com/fluenceai"],"app":"steemit/0.1","format":"markdown"}
created2017-08-09 20:14:24
last_update2017-08-09 20:15:00
depth0
children8
last_payout2017-08-16 20:14:24
cashout_time1969-12-31 23:59:59
total_payout_value4.561 HBD
curator_payout_value0.126 HBD
pending_payout_value0.000 HBD
promoted15.000 HBD
body_length6,355
author_reputation35,611,355,673
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,322,516
net_rshares1,350,959,375,437
author_curate_reward""
vote details (21)
@decebal2dac ·
how about a comparison with Iota and its's tangled blockchain .. looks to me you would find some more similarities there and solutions to problems you might be facing .
properties (22)
authordecebal2dac
permlinkre-eponomarev-a-decentralized-database-for-decentralized-internet-20170814t103621150z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-14 10:36:21
last_update2017-08-14 10:36:21
depth1
children0
last_payout2017-08-21 10:36:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length168
author_reputation13,975,053,566,819
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,767,369
net_rshares0
@decentralization ·
$4.66
Do you think Oracle or Salesforce will make an offer in the future?
👍  ,
properties (23)
authordecentralization
permlinkre-eponomarev-a-decentralized-database-for-decentralized-internet-20170809t205229521z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-09 20:52:30
last_update2017-08-09 20:52:30
depth1
children1
last_payout2017-08-16 20:52:30
cashout_time1969-12-31 23:59:59
total_payout_value3.499 HBD
curator_payout_value1.164 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length67
author_reputation15,878,828,459,662
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,325,191
net_rshares1,344,375,296,911
author_curate_reward""
vote details (2)
@eponomarev ·
Not sure. These are the companies that focused on deep enterprise solutions. We hope that someday enterprises come to decentralization, but it is too far away from now.
properties (22)
authoreponomarev
permlinkre-decentralization-re-eponomarev-a-decentralized-database-for-decentralized-internet-20170810t133422153z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-10 13:34:18
last_update2017-08-10 13:34:18
depth2
children0
last_payout2017-08-17 13:34:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length168
author_reputation35,611,355,673
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,394,063
net_rshares0
@shahriar27 ·
agreed and upvoted!!!!
properties (22)
authorshahriar27
permlinkre-eponomarev-a-decentralized-database-for-decentralized-internet-20170812t104632405z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-12 10:46:06
last_update2017-08-12 10:46:06
depth1
children0
last_payout2017-08-19 10:46:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length22
author_reputation11,197,919,957
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,588,063
net_rshares0
@steemitboard ·
Congratulations @eponomarev! You have completed some achievement on Steemit and have been rewarded with new badge(s) :

[![](https://steemitimages.com/70x80/http://steemitboard.com/notifications/firstpayout.png)](http://steemitboard.com/@eponomarev) You got your First payout
[![](https://steemitimages.com/70x80/http://steemitboard.com/notifications/firstcomment.png)](http://steemitboard.com/@eponomarev) You made your First Comment

Click on any badge to view your own Board of Honor on SteemitBoard.
For more information about SteemitBoard, click [here](https://steemit.com/@steemitboard)

If you no longer want to receive notifications, reply to this comment with the word `STOP`

> By upvoting this notification, you can help all Steemit users. Learn how [here](https://steemit.com/steemitboard/@steemitboard/http-i-cubeupload-com-7ciqeo-png)!
properties (22)
authorsteemitboard
permlinksteemitboard-notify-eponomarev-20170811t014906000z
categoryico
json_metadata{"image":["https://steemitboard.com/img/notifications.png"]}
created2017-08-11 01:49:06
last_update2017-08-11 01:49:06
depth1
children0
last_payout2017-08-18 01:49:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length849
author_reputation38,975,615,169,260
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,454,959
net_rshares0
@steemitboard ·
Congratulations @eponomarev! You received a personal award!

<table><tr><td>https://steemitimages.com/70x70/http://steemitboard.com/@eponomarev/birthday2.png</td><td>Happy Birthday! - You are on the Steem blockchain for 2 years!</td></tr></table>

<sub>_You can view [your badges on your Steem Board](https://steemitboard.com/@eponomarev) and compare to others on the [Steem Ranking](https://steemitboard.com/ranking/index.php?name=eponomarev)_</sub>


###### [Vote for @Steemitboard as a witness](https://v2.steemconnect.com/sign/account-witness-vote?witness=steemitboard&approve=1) to get one more award and increased upvotes!
properties (22)
authorsteemitboard
permlinksteemitboard-notify-eponomarev-20190614t053247000z
categoryico
json_metadata{"image":["https://steemitboard.com/img/notify.png"]}
created2019-06-14 05:32:48
last_update2019-06-14 05:32:48
depth1
children0
last_payout2019-06-21 05:32:48
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length628
author_reputation38,975,615,169,260
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id86,600,849
net_rshares0
@storcogato ·
$0.09
I love checking out ICOs , this seems interesting
👍  
👎  
properties (23)
authorstorcogato
permlinkre-eponomarev-a-decentralized-database-for-decentralized-internet-20170816t035958745z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-16 04:00:00
last_update2017-08-16 04:00:00
depth1
children0
last_payout2017-08-23 04:00:00
cashout_time1969-12-31 23:59:59
total_payout_value0.085 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length49
author_reputation3,970,897,173,220
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,944,862
net_rshares24,233,458,933
author_curate_reward""
vote details (2)
@trefifund ·
Thank you for your information. (UpVote)
👍  
properties (23)
authortrefifund
permlinkre-eponomarev-a-decentralized-database-for-decentralized-internet-20170809t202613546z
categoryico
json_metadata{"tags":["ico"],"app":"steemit/0.1"}
created2017-08-09 20:26:09
last_update2017-08-09 20:26:09
depth1
children0
last_payout2017-08-16 20:26:09
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length40
author_reputation4,022,507,058
root_title"A Decentralized Database for Decentralized Internet"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id11,323,318
net_rshares610,227,200
author_curate_reward""
vote details (1)