zhousi 发表于 2015-11-29 03:45:59

Apache Lens 2.4.0

欢迎加入运维网交流群:263444886  
  Apache Lens 2.4.0-beta 发布,此版本更新内容如下:
子任务
  

[*]   - Document how to document a feature in contributor guide
[*]   - TestRewriting test is failing with powermock incompatibility with jdk8
[*]   - Test Failures on java8
[*]   - Bump version in master to 2.4
[*]   - exclude patchprocess directory from licence check.
[*]   - Change version number to 2.4.0-beta-SNAPSHOT in master
[*]   - UI Module failing if maven version is < 3.1
[*]   - Merge master with current-release-line for 2.4
[*]   - Bump version in master to 2.5
[*]   - Verify Lens 2.4 issues
[*]
   - Update 2.4>
[*]   - Update gpg keys in dist repo
Bug 修复
  

[*]   - FinishedLensQuery is not storing selectedDriver
[*]   - server params should not be passed to session and drivers
[*]   - Cannot retrieve query results on lens server restart
[*]   - Query output files should have the query name
[*]   - Drop partition is assigning latest=null if latest partition is being dropped
[*]   - Example query on customer_city_name failing
[*]   - Partition Created for querystats is not honouring "lens.server.statistics.warehouse.dir"
[*]   - null Error Message on Lens Server logs
[*]   - Unable to override "lens.server.session.expiry.service.interval.secs" because of spelling mistake
[*]   - NPE on closing HadoopFileFormatter
[*]   - Query remains in queue even when driver is free
[*]   - StatusPoller logs are useless
[*]   - Look ahead is failing with partition not found if any process time partitions are absent
[*]   - ThreadSafeEstimatedQueryCollection is ignoring driver argument in getQueries and getQueryCount
[*]   - lens.client.query.poll.interval needs doc update
[*]   - Columnar JDBC Rewriter in incorrectly pushing filter against wrong alias when fact columns map to a single dimension
[*]   - lens-ship-jars in current-release-line branch should have parent version 2.4.0-beta-SNAPSHOT instead of 2.5.0-beta-SNAPSHOT
改进

[*]   - Lens is not building against on JAVA-8
[*]   - Look ahead timerange should not look for all finer granularity partitions to be present
[*]   - Critical metrics for lens
[*]   - Add inline values to be specified for XDimAttribute in xsd
[*]   - A new, improved web client.
[*]   - Queries get purged to DB as soon as they finish
[*]   - Allow column name mapping for few/all columns in underlying storage tables
[*]   - Support for !=, in and not in predicates in elastic search driver
[*]   - Enhance cube.xsd to accept Hierarchical dimattribute and inline dimattribute
[*]   - Throw single error out with LensMultiException
[*]   - Generate udf jar for lens-regression
[*]   - Queue number for queries
[*]   - rename LogicalTableCrudCommand to ConceptualTableCrudCommand and PhysicalTableCrudCommand to LogicalTableCrudCommand
[*]   - Examples should continue to run in case submission failures
[*]
   - Both time and>
[*]   - UI support for the saved, parametrized query feature.
[*]   - Slow response times for /metastore/nativetables API
[*]   - Improve CLI documentation to mention the helpful role of pressing tab while writing commands
[*]   - Create a single jar for shipping with hive queries
新特性

[*]   - Saved query and parameterization
[*]
   - Support flattening of columns selected through bridge-tables(many-to-many>
任务

[*]   - Improve developer documentation
[*]   - Move cube specific error message codes from InMobi's Hive code to Lens
[*]   - Remove feather logo from the repository, use already existing image to display on website
[*]   - setup build job with java8 on jenkins
[*]
   ->
  更多内容请看发行说明。
  
  Lens 提供了一个统一数据分析接口。通过提供一个跨多个数据存储的单一视图来实现数据分析任务切分,同时优化了执行的环境。无缝的集成 Hadoop 实现类似传统数据仓库的功能。
  该项目主要特性:

[*]  简单元数据层为数据存储提供抽象视图层
[*]  单一的共享模式服务器,基于 Hive 元存储。模式通过数据管道 HCatalog 和分析应用进行共享:

[*]  OLAP Cube QL 类似 SQL 的高级语言用来查询和描述存放在不同数据立方体 (Cubes) 中的数据集
[*]  JDBC 驱动和 Java 客户端库来处理查询
[*]  Lens 应用服务器 - 这是一个 REST 服务器允许用户查询数据,更改数据模型,调度查询和查询的配额限制
[*]  基于驱动的架构 允许在报表系统中进行嵌入,例如 Hive、列数据存储、Redshift 等
[*]  基于成本算法的引擎选择 - 该算法可优化资源的使用,通过对查询的复杂度自动选择最佳执行引擎

  Apache Lens 的架构如下:
页: [1]
查看完整版本: Apache Lens 2.4.0