发布于 2015-11-03 00:24:30 | 185 次阅读 | 评论: 0 | 来源: 网友投递
Apache Slider YARN 应用
Apache Slider 是一个 YARN 应用,用于发布已有的分布式应用到 YARN 上,并对这些应用进行监控以及根据需要调整规模。
Apache Slider 0.81.1-incubating 发布,此版本现已提供下载:
http://www.apache.org/dyn/closer.cgi/incubator/slider/0.81.1-incubating/
[SLIDER-872] - Fix description for destroy command in slider usage
[SLIDER-873] - Fix accumulo test failures
[SLIDER-877] - Move SLIDER_HOME assignment to slider.py
[SLIDER-878] - Slider cannot support jdk 1.8 for command slider registry --getconf hbase-site --name hb1
[SLIDER-883] - Remove app-package LICENSE.txt and NOTICE.txt file
[SLIDER-884] - Change branch-2.7 profile dependency version to 2.7.0
[SLIDER-887] - Rename command-logger appConfig and resources file names
[SLIDER-891] - Add ability to set Slider AM launch environment during cluster create/start
[SLIDER-895] - Slider Unit Test Cases Failing on Windows
[SLIDER-897] - ApplicationWithAddonPackagesIT fun test failing on Windows
[SLIDER-902] - AMClientCertStoreRetrievalIT#testRetrieveCertificateStores failing on Windows
[SLIDER-904] - Resource leak reported by coverity scan results
[SLIDER-905] - Container request fails when Slider requests container with node label and host constraints
[SLIDER-912] - x-insecure rest API should be off by default
[SLIDER-916] - Fix Docker related bugs
[SLIDER-923] - switch to TryOnceThenFail retry policy
[SLIDER-927] - Slider should not use multiple versions of jackson jars
[SLIDER-928] - Expose SliderClient methods to retrieve list of applications
[SLIDER-929] - Fix test_signal_handler failure
[SLIDER-931] - Security permissions on set up ZK path are too lax
[SLIDER-934] - changes in list Action broke return codes from `list` action
[SLIDER-898] - coalesce use of assumeWindows/assumeNotWindows test assumptions
[SLIDER-910] - add Hadoop 2.7.1 profile, move branch-2 version to 2.8.0-SNAPSHOT
[SLIDER-911] - remove surplus jax rs jsr311-api JAR
[SLIDER-777] - Provide slider dependencies as a self contained versioned tarball
[SLIDER-812] - Making component configurations in appConfig available on the SliderAgent side
[SLIDER-890] - Bundle Solr as an app-package include with the Slider distribution
文档:http://slider.incubator.apache.org/docs/getting_started.html
详细发行说明请看:https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315422&ve
rsion=12332386
Regards,
The Slider Team
Apache Slider 是一个 Yarn 应用,它可以用来在 Yarn 上部署并监控分布式应用。Slider 可以在应用运行期随意扩展或者收缩应用。目前它是 Apache 的孵化项目。
Yarn 上的应用在停止之后可以重新被启动,并且 Yarn 上的应用的分布是持久化的,重启之后的位置会尽量接近之前的位置,借助该特性,应用可以记住数据存放位置,所以启动时间也会加快。
Yarn可以监控“Yarn容器”的健康状态,当容器挂掉时,它会通知Slider。同时,Slider会请求Yarn创建一个新容器,Slider会创建一个失败容器的替代组件。Slider可以保证配置文件中指定数量的应用正常运行。
Yarn的特性包括:
支持用户在Yarn集群中创建随需应变的应用
支持不同的用户/应用运行不同版本的应用
支持用户配置不同的应用实例
按需停止/暂停/恢复应用实例
按需扩展/收缩应用实例
Slider工具是一个Java的命令行应用,它会把信息持久化为JSON文档并存储到HDFS。当集群启动后,我们可以使用命令扩展或者收缩集群。集群也可以被停止或者重启。对Slider感兴趣的朋友可以看看Yu Liu在一个Meetup上的演讲PPT。