发布于 2015-06-03 00:32:30 | 188 次阅读 | 评论: 0 | 来源: 网友投递
Spring XD
Spring XD是一个统一的,分布式,可扩展的系统用于 data ingestion,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。
Spring XD 1.2 RC1 发布,此版本现已提供下载,也可以通过 rpm 安装。
此版本主要包括 bug 修复,一些新特性和改进:
Apache Ambari plugin to automate the deployment of Spring XD to a Hadoop cluster.
A new Analytics tab in the UI that allows you to easily view gauges, counters, field-value counters and aggregate counters.
Performance improvements for the Kafka Message Bus that places it on par with the performance benchmark applications that ship with Kafka.
Improved HA support for the Rabbit Message Bus, XD containers connect to the Rabbit Broker that hosts the queue that is being consumed
Support for the Sqoop metastore and other Sqoop integration improvements
Support for multiple topics in the Kafka source.
Add rolloverTime option to HDFS sink
Support incremental data import with jdbchdfs job
Ability to tap Spark streaming processors
Support arbitrary JavaMail properties in the mail source
Several new source/sink modules
Video Capture source (community contributed)
FTP source and sink (community contributed)
load-generator source and throughput sink
xslt-transformer (community contributed)
The gpfdist sink is now included in the XD distribution
Performance improvements for reactor based processor
Support for Oracle as a batch repository
Change from log4j to Logback logging framework
完整列表请看 issues fixed for 1.2 RC1,更多内容请看发行说明。
Spring XD是一个统一的,分布式,可扩展的系统用于 data ingestion,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。