best data store for write heavy and buck reporting query application
I have a use case as follows
1)I get messages and corresponding to a entity and i need to update the
entity properties by reading values from messages.
2)No of messages per day 180 million
3)No of new entities created per day 10 million
4)No of enntities deleted per day 10 million
Now i need to support queries as follows 1)Find all entities with prop1=
val1 and prop2=val2
Not query SLA are not very strict . 5 minutes will do.But there are many
write operations continuously.so cannot run etl in data warehouse.
Also no of read operations are very less. (example is query 1)
Possible choises of data store
1)Oracle (RDBMS)
index on enityId only ,partision on entity creation date
Pros :Easy to implement
Cons :I dont think it will scale. For example query mentioned above will
take long time and eventually timeout. I am not a DB expert
2)DynamoDB
Should not be used for such kind of queries
3)Casandra
Not sure
4)MongoDB
Not sure.
5)Elastic search
Not sure.
What will be the best datastore for my use case?Any open source db will do.
No comments:
Post a Comment