IBM Db2 Analytics Accelerator (IDAA) v7 Announced #IBMz #zAnalytics

Posted by Frank Fillmore on October 17, 2017 under BLU Acceleration, DB2 for Linux Unix Windows, HTAP, IBM Pure Systems, IDAA, Mako, Netezza. Tags: , , , .

On July 23, 2010 I attended the announcement of the IBM Smart Analytics Optimizer (ISAO).  This was IBM’s first iteration of heterogeneous scale-out to enable mixed OLTP and OLAP workloads to run on the same platform.  Subsequently IBM acquired Netezza and the Netezza appliance became the foundation for the IBM Db2 Analytics Accelerator (IDAA).  In IDAA workshops I would refer to the ISAO as IDAA v0.5.

Fast forward to today when IBM announced IDAA v7.1.  “What is old is new again.”  Think of this delivery of IDAA as “ISAO v4.0” (there was some good-natured debate about the numbering).  Why do I frame it those terms?

  1. IDAA has received a “brain transplant”.  Instead of Postgres, the database engine for IDAA will be Db2 Warehouse.  This will give IDAA greater compatibility with Db2 for z/OS, including broader SQL and datatype support, TIMESTAMP consistency, and more.  By exploiting Db2 with BLU Acceleration features such as in-memory columnar (rather than row-organized) data, Single Instruction, Multiple Data (SIMD) chips, actionable compression, and “data skipping” (avoiding extents that don’t contain data of interest) IDAA v7.1 provides a robust platform for better performance with a roadmap for continuous improvement and enhancement.  IBM has also consolidated its data repository development efforts by focusing on fewer, higher-value initiatives.
  2. IDAA has received a “heart transplant”.  The IBM Integrated Analytics System (IIAS) appliance on which IDAA v7.1 is based, no longer depends on Field Programmable Gate Arrays (FPGA) that were the “secret sauce” of the Netezza (aka PureData System for Analytics – PDA).  FPGAs might be reintroduced at a later time.

So, a few questions – and a fewer answers.

  • How long will the legacy Netezza/PDA “Mako” N3001 be supported?  Until 2023.  So the installed base of existing IDAAs will be protected for five years.
  • Will the Database Partitioning Feature (DPF) – IBM’s MPP shared-nothing data warehouse scaling technology – be exploited by IDAA v7.1?  Dunno.
  • Wither the IDAA cloud deployment introduced in v6?  Nary a mention today.

Topics for a future blog post:

  • “True HTAP” – Hybrid Transaction / Analytic Processing
  • IDAA deployment on IBM z – using Docker images sitting on Integrated Facility for Linux (IFL) specialty processors.

Frank Fillmore to Present at Heart of America #DB2 Users Group #zIBM #IDAA #HTAP

Posted by Frank Fillmore on February 26, 2016 under BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, IBM Champion, IDAA. Tags: , , , , , .

On Monday, March 14, 2016 DB2 Gold Consultant and IBM Champion Frank Fillmore will present on Hybrid Analytic/Transaction Processing (HTAP) at the Heart of America DB2 Users Group in Overland Park, KS.

A complete agenda, presentation abstracts, and speaker biographies can be found here.

IBM Data Retrieval Technologies: #RDBMS, #BLU, #Netezza and #Hadoop

Posted by Frank Fillmore on July 28, 2015 under BigInsights, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, IDAA, Sidecar. Tags: , , , , , .

In this session I described and compared the four distinct data retrieval technologies available from IBM.

Choices are good to have, but how do you choose which technology to apply to a particular business use case? Learn how these techniques differ, including their relative strengths and weaknesses.
– The traditional RDBMS, relying primarily on indexes to speed access
– The new BLU Acceleration columnar compression and memory-optimized database
– IBM PureData System for Analytics (Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse data
– IBM InfoSphere BigInsights,  the IBM distribution of Hadoop

Click here for the recording of the webinar.  The presentation materials: IBM Data Retrieval Technologies RDBMS BLU Netezza and Hadoop

IBM Hybrid Transaction/Analytic Processing #HTAP #IDAA #BLU #IBMz Webinar Materials

Posted by Frank Fillmore on July 21, 2015 under BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, IDAA, MQT's, Netezza, Sidecar. Tags: , , , , , .

The concept of Hybrid Transaction/Analytic Processing was coined by Gartner. IBM implements HTAP in two ways:
– IBM DB2 Analytics Accelerator (IDAA) for DB2 for z/OS data (using Netezza hardware)
– DB2 BLU Acceleration – DB2 for Linux, Unix, Windows (a software-only implementation)

Click here for the recording of the webinar.  The presentation materials: Hybrid Transaction Analytic Processing – HTAP

Frank Fillmore’s Insight Conference Presentation

Posted by admin on July 14, 2015 under Big Data, BigInsights, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, Hadoop, IBM Champion, IDAA, Insight 2015, Mako, Netezza, TFG Blog. Tags: , , , , , .

Congratulations to Frank on the selection of his 2015 Insight Conference presentation!  Frank’s presentation (session #3584 for those of you already  working on your schedules) is titled, “DB2 ^ (Netezza | BLU) = Hybrid Transaction and Analytics Processing (HTAP)”.

As soon as the Insight schedule is released I will update this post with the session date and time.  Stay tuned!

In his session Frank will describe and compare the four distinct data retrieval technologies available from IBM, including two Hybrid Transaction and Analytics Processing (HTAP) platforms. Choices are good to have, but how do you choose which technology to apply to a particular business use case? Learn how these techniques differ, including their relative strengths and weaknesses.

– The traditional RDBMS, relying primarily on indexes to speed access

– The new BLU Acceleration columnar compression and memory-optimized database

– IBM PureData System for Analytics (Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse data

– IBM InfoSphere BigInsights, the IBM distribution of Hadoop

Bio
DB2 Gold Consultant and IBM Champion Frank C. Fillmore, Jr. is the Founder and President of The Fillmore Group, Inc., a Premier IBM Business Partner that specializes in IBM Analytics software sales, consulting, and training. Frank has been providing IBM Information Management solutions to government, industry, and not-for-profit enterprises as varied as The World Bank, J.P. Morgan Chase, Northrop Grumman, and the FBI for over 28 years. Frank’s current practice centers on Hybrid Transaction and Analytic Processing (HTAP) and Oracle to DB2 migrations as well as information governance and integration. Frank kayaks and cheers for the Baltimore Orioles.

 

IBM DB2 Analytics Accelerator v4 PTF 5 Enhancements #IDAA #IBMz

Posted by Frank Fillmore on June 21, 2015 under Big Data, DB2 for z/OS, Mako. Tags: , , .

Abstract: An update on the latest IBM DB2 Analytic Accelerator (IDAA) PTF released in May, 2015. This PTF delivers new functionality to extend IDAA utilization for DB2 for z/OS users including:

  • Improved Incremental Update reliability and performance
  • Accelerated dynamic query statement caching
  • Additional scalar function support
  • In-database transformation with Accelerator Only Tables (AOTs)

Click here for the recording of the webinar.  The presentation materials: IDAA v41 PTF5 TFG

IBM DB2 Analytics Accelerator #IDAA #DB2z Hands-on Workshop Returns in 2015

Posted by Frank Fillmore on February 26, 2015 under Data Studio, DB2 for z/OS, IDAA, Mako, Sidecar. Tags: , , .

Thanks to Kim May and Saghi Amirsoleymani of IBM for the successful two-day IBM DB2 Analytics Accelerator (IDAA) Workshop with hands-on lab exercises.  Five large financial services enterprises sent attendees.  Thanks as well to Al, Allan, Dave, Ed, Jim, Lori, Warren, and Steve for the lively discuss and deep technical questions.

The presentation is attached here: IDAA Workshop 2015-02

IDAA Use Cases – Session #IDZ-6691B at Insight

Posted by Kim May on September 9, 2014 under DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, IBM Champion, IDAA, Insight 2014, TFG Blog. Tags: , , , , , .

Frank Fillmore will be delivering a session on IDAA use cases at the IBM Insight Conference in Las Vegas (formerly IOD) on Tuesday, October 28th, from 10am-11am.

The IBM DB2 Analytics Accelerator (IDAA) speeds analytic queries that currently run on DB2 for z/OS.

IBM DB2 Analytics Accelerator can:

  • Help with operational data store reconsolidation on IBM System z.
  • Reduce extract, transform and load (ETL) costs and latency to make OLTP data available for analysis faster and less expensively.
  • Speed up batch reporting and offload System z processor consumption.
  • Archive original data by using the high performance storage saver (HPSS).
  • Enable analysis of VSAM and Information Management System (IMS) data along with DB2 for z/OS by using the DB2 Analytics Accelerator Loader.

In Frank’s session, attendees will learn about these functions and more, and gain an understanding of possible, interesting, and valuable IDAA use cases.

I hope we will see you there!

IBM DB2 Analytics Accelerator (#IDAA) Workshop a Success!

Posted by Frank Fillmore on April 14, 2014 under Data Studio, DB2 Education, DB2 for z/OS, IDAA, Optim, Sidecar. Tags: , .

Last week in Baltimore The Fillmore Group conducted a deep-dive technical workshop on IBM DB2 Analytics Accelerator.  We covered Basic and Advanced hands-on labs with the support of the IBM Poughkeepsie Demo Center.  Saghi Amirsoleymani and Mike Hood, both of IBM, presented on the Tools Ecosystem supporting the Accelerator including:

The presentation I gave outlining the topics covered in the Basic and Advanced lab exercises is here: IDAA Workshop 2014-04  Additional presentations will be posted soon.

Demo videos of the Tools include:

Database Magazine and Articles on Accelerating Analytics Queries

http://ibmdatamag.com/2013/12/accelerating-analytics-queries/

http://www.ibm.com/developerworks/data/library/techarticle/dm-1403queryaccel/index.html

Attending zIM Bootcamp at IBM Silicon Valley Lab Next Week @IBMDB2

Posted by Frank Fillmore on January 25, 2014 under Big Data, DB2 for z/OS, DB2 Gold Consultants, IBM Champion, IBM Information Management Software Sales, IDAA. Tags: , , .

Each year IBM assembles their Client Technical Professionals (CTPs) for System z Information Management software at Silicon Valley Lab.  For the past three years IBM has invited DB2 Gold Consultants to participate.  The 4 ½ day conference is rich with lectures and hands-on labs covering such diverse topics as DB2 for z/OS tools and utilities and IMS.  I am particularly interested in:

During the week I’ll blog and Tweet.  I look forward to your comments and questions.