阿里巴巴实时计算平台_JStorm_Turbo（24页）.pdf

1、TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD TRADE PLATFORM 署名：封仲淹(Longda)职称：资深专家 Large-Scale Stream Processing inside AlibabaLarge-Scale Stream Processing inside Alibaba TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD TRADE PLATFORM 自我介绍 自我介绍 JStorm/Storm evangelist in China Our duties:Application Develop

2、ment JStorm Platform Evolving JStorm/Storm Support Cluster Management Community Commitment TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD TRADE PLATFORM 目录 目录 User Scenario Architecture Enhancements Performance Stability Features TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD TRADE PLATFORM JStorm Milestone

3、 JStorm Milestone 2013/4/30 0.7.1 Java core Scheduler 1.0 2013/12/30 0.9.0 Nimbus HA 1.0 Backpressure 1.0 Scheduler 2.0 2015/10/27 0.9.8.1 Koala 2.0 Scheduler 4.0 Backpressure 2.0 Topology Master 2015/11/12 2.1.0 Donate to apache Support Storm 0.10 binary Metrics Redesign Koala 3.0 Release 25 Jstorm

4、 version from 2013/4/30 0.7.1/0.9.0/0.9.1/0.9.2/0.9.3/0.9.3.1/0.9.4/0.9.4.1/0.9.5/0.9.5.1/0.9.6/0.9.6.1/0.9.6.2/0.9.6.3/0.9.7/0.9.7.1/0.9.7.2/0.9.8/0.9.8.1/0.9.8.2/2.0.4/2.1.0/2.1.1/2.2.0/2.2.12014/10/11 0.9.6.3 Koala 1.0 Scheduler 3.0 User Defined Log User Defined Metrics 1.0 2016/5/31 2.2.0 Improv

5、e performance Exactly Once Sliding Window Shade Dependency Backpressure 3.0 TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD TRADE PLATFORM 当前 当前 Everywhere 4000+machines Standalone JStorm-on-yarn JStorm-on-docker 1500+applications,2000+topologies 2+PB every day TECHNOLOGIES CONSTRUCTING ELECTRONIC WORLD

6、TRADE PLATFORM 应用场景 应用场景 Fraud Detection:Nut/Velocity Auditing:Alimama Ads auditing,Alimama P4P auditing,AMG repository auditing,Statistics:Eagleeye,AE pv?uv statistics,BI statistics Monitoring:Tlog,Rds-monitor,Oceanbase-monitor,Cainiao Raidar,QuaMonitor,YunOSMonitor,Data Transport:RDS-log-sync,Unif