nosql - Stream data aggregation sorted by timestamp -


i have use case receiving events client , of these events logically related (belong single session), , there definite ordering among events based on timestamp.

now, want build solution should continue aggregating events until last 1 of particular group received in increasing order of timestamp. so, if event not in order received, should held on until events before them, received. , then, go ahead storing in data store such hbase based on key of particular group.

the problem number of such incomplete groups @ time can in millions, , need can support fast appending incomplete group , holding events received unordered. how should go this?

you use event stream processing or complex event processing frameworks http://en.wikipedia.org/wiki/complex_event_processing. write query/pattern, load in engine, feed engine events , query being continually updated or fires when time comes.

i codehaus esper, it's open source, restricted in unpaid version, had implement storing of events , reloading them on application start example. option drools fusion, found buggy when tried out 5 years ago. looking wso2 cep thing underdocumented.


Comments

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

javascript - jQuery date picker - Disable dates after the selection from the first date picker -