Greater Flexibility with Query Engines
Prior to the 3.1 release, a single SQL-on-Hadoop engine was used for all Gluent operations, whether related to orchestration (Offload/Present) or transparent queries (end-user queries that invoke Gluent Query Engine). However, a single SQL engine might not be suited to all user query workloads, therefore Gluent Query Engine has been re-architected to allow end-users to select a SQL engine to use for transparent queries and no longer be restricted to the engine chosen for Gluent orchestration activities. As of Gluent’s 3.1 release, users can choose between Impala, Hive, Hive (LLAP) and Spark, depending on the Hadoop distribution.
Gluent’s 3.1 release introduces a new offload transport engine, utilizing Spark, to be used as a configurable alternative to Sqoop. Gluent’s offload product continues to support Sqoop as an industry-recognized data transport engine, but users can now select the Spark-based offload transport engine as a high-performance alternative, supporting greater concurrency. By utilizing Spark for offload transport, Gluent has reduced the time it takes to offload data at all volumes, with considerable time savings in process startup and the data transport itself.
Gluent Query Engine introduces support for Spark SQL
Gluent Advisor Portal Improves Usability with Pre-Configured Reports
Gluent Advisor Portal was released in 3.0 and provides customers with a simple-to-use web application for generating, viewing and downloading rich HTML Advisor reports. The 3.1 release further improves the usability of Gluent Advisor Portal by highlighting key statistics and metrics to provide an instant and comparable view of each database’s offload potential. A new set of pre-configured reports further summarize the findings of each Advisor report in tabular form, providing a simple view of offloadability, database size, database environment and Advisor parameters. This summary data complements the drill-down information presented in the Advisor report itself.
Functional and Performance Improvements Provide Better Control
Gluent’s 3.1 release continues to deliver functional improvements across the product set. For example, diagnose now supports the collection of Hive and Spark diagnostic information in addition to Impala. Gluent’s multitenancy feature now caters fully for tables offloaded from multitenant Oracle databases and Offload/Present both support the Amazon EMR S3 driver for data stored on Amazon S3 storage accessed through EMR.
Operational improvements continue to be provided with each Gluent release. For example, many new checks have been added to our Connect utility to validate the configuration of Gluent software. In addition, the 3.1 release certifies Gluent’s products on SLES-based systems.
As with previous releases, the 3.1 release includes several performance improvements. For example, Join Filter Pulldown (JFPD) has been improved to cater for more complex query execution plans and predicate optimizations. The performance of SQLMon has been improved, particularly for large, complex SQL statements and as described earlier, the new Spark-based offload transport enables data to be offloaded faster and with greater concurrency.
Security continues to be at the forefront of all Gluent software and the 3.1 release continues to harden the product set. For example, support has been added for Oracle Wallet authentication during offload transport and Gluent’s Result Cache architecture now supports Hadoop Secure Mode.
About Gluent Data Platform
Gluent Data Platform keeps enterprise RDBMS relevant in the new hybrid world and provides a data virtualization layer between traditional databases, cloud storage and Hadoop that accelerates time to insight and eliminates data duplication and sprawl. Gluent allows customers to preserve their investments in their RDBMS platforms while leveraging the power, scalability, and elasticity of private and public clouds.
Enabling true data virtualization has been a cornerstone of Gluent software from the beginning. Our product allows companies the opportunity to reduce their overall investment while expanding the ability of the existing applications. If you are interested in learning more about how Gluent Data Platform can help virtualize your enterprise data, contact us at email@example.com.
An opportunity to work with your team on a pilot based upon your data components will solidify what the Gluent product line can do for your existing infrastructure.