On July 23, 2010 I attended the announcement of the IBM Smart Analytics Optimizer (ISAO).  This was IBM’s first iteration of heterogeneous scale-out to enable mixed OLTP and OLAP workloads to run on the same platform.  Subsequently IBM acquired Netezza and the Netezza appliance became the foundation for the IBM Db2 Analytics Accelerator (IDAA).  In IDAA workshops I would refer to the ISAO as IDAA v0.5.

Fast forward to today when IBM announced IDAA v7.1.  “What is old is new again.”  Think of this delivery of IDAA as “ISAO v4.0” (there was some good-natured debate about the numbering).  Why do I frame it those terms?

1. IDAA has received a “brain transplant”.  Instead of Postgres, the database engine for IDAA will be Db2 Warehouse.  This will give IDAA greater compatibility with Db2 for z/OS, including broader SQL and datatype support, TIMESTAMP consistency, and more.  By exploiting Db2 with BLU Acceleration features such as in-memory columnar (rather than row-organized) data, Single Instruction, Multiple Data (SIMD) chips, actionable compression, and “data skipping” (avoiding extents that don’t contain data of interest) IDAA v7.1 provides a robust platform for better performance with a roadmap for continuous improvement and enhancement.  IBM has also consolidated its data repository development efforts by focusing on fewer, higher-value initiatives.
2. IDAA has received a “heart transplant”.  The IBM Integrated Analytics System (IIAS) appliance on which IDAA v7.1 is based, no longer depends on Field Programmable Gate Arrays (FPGA) that were the “secret sauce” of the Netezza (aka PureData System for Analytics – PDA).  FPGAs might be reintroduced at a later time.

So, a few questions – and a fewer answers.

• How long will the legacy Netezza/PDA “Mako” N3001 be supported?  Until 2023.  So the installed base of existing IDAAs will be protected for five years.
• Will the Database Partitioning Feature (DPF) – IBM’s MPP shared-nothing data warehouse scaling technology – be exploited by IDAA v7.1?  Dunno.
• Wither the IDAA cloud deployment introduced in v6?  Nary a mention today.

Topics for a future blog post:

• “True HTAP” – Hybrid Transaction / Analytic Processing
• IDAA deployment on IBM z – using Docker images sitting on Integrated Facility for Linux (IFL) specialty processors.

The concept of Hybrid Transaction/Analytic Processing was coined by Gartner. IBM implements HTAP in two ways:
– IBM DB2 Analytics Accelerator (IDAA) for DB2 for z/OS data (using Netezza hardware)
– DB2 BLU Acceleration – DB2 for Linux, Unix, Windows (a software-only implementation)

Click here for the recording of the webinar.  The presentation materials: Hybrid Transaction Analytic Processing – HTAP

Congratulations to Frank on the selection of his 2015 Insight Conference presentation!  Frank’s presentation (session #3584 for those of you already  working on your schedules) is titled, “DB2 ^ (Netezza | BLU) = Hybrid Transaction and Analytics Processing (HTAP)”.

As soon as the Insight schedule is released I will update this post with the session date and time.  Stay tuned!

In his session Frank will describe and compare the four distinct data retrieval technologies available from IBM, including two Hybrid Transaction and Analytics Processing (HTAP) platforms. Choices are good to have, but how do you choose which technology to apply to a particular business use case? Learn how these techniques differ, including their relative strengths and weaknesses.

– The traditional RDBMS, relying primarily on indexes to speed access

– The new BLU Acceleration columnar compression and memory-optimized database

– IBM PureData System for Analytics (Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse data

– IBM InfoSphere BigInsights, the IBM distribution of Hadoop

Bio
DB2 Gold Consultant and IBM Champion Frank C. Fillmore, Jr. is the Founder and President of The Fillmore Group, Inc., a Premier IBM Business Partner that specializes in IBM Analytics software sales, consulting, and training. Frank has been providing IBM Information Management solutions to government, industry, and not-for-profit enterprises as varied as The World Bank, J.P. Morgan Chase, Northrop Grumman, and the FBI for over 28 years. Frank’s current practice centers on Hybrid Transaction and Analytic Processing (HTAP) and Oracle to DB2 migrations as well as information governance and integration. Frank kayaks and cheers for the Baltimore Orioles.

The trip to Prague, CZ last week for the International DB2 Users Group meeting was fabulous.  The city certainly has changed since I’ve been there – all for the better.  It seems more cosmopolitan, the people seem younger, more vibrant than I remember from 2004.  And the dining and music – Kim and I attended jazz and classical music concerts and enjoyed Madame Butterfly at the Prague State Opera – were amazing CutterWelderMaestro.

Here’s my pitch on “IBM Data Retrieval Technologies” if you weren’t able to attend.  IDUG EMEA 2014 E7 – IBM Data Retrieval Technologies – RDBMS BLU IBM Netezza and Hadoop

Next year IDUG EMEA will be in Dublin.  Hope you can join us for a Guinness by the River Liffey.

From November 9 – 14 I will be visiting one of the most charming cities on the planet when I attend the International DB2 Users Group (IDUG) conference in Prague, CZ.  I will present “IBM Data Retrieval Technologies : RDBMS, BLU, IBM Netezza and Hadoop”.  It will be session E7 on Tuesday, November 11 from 3:15 to 4:15 p.m.  Please consider attending IDUG Europe and joining me at this session.

Abstract:  IBM offers four distinct data retrieval technologies: the traditional RDBMS, which primarily relies on indexes to speed access; the new BLU Acceleration columnar compression database; IBM PureData System for Analytics (IBM Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse the data; and IBM InfoSphere BigInsights, which is the IBM distribution of Hadoop. Choices are good to have, but how do you choose which technology to apply to a particular business use case? In this session, you learn how these techniques differ, including their relative strengths and weaknesses, to help you make an informed choice.

I was on a call this morning with an IBM technical team to discuss our progress filling the seats in one of our upcoming free IDAA classes.  Not surprising, given the number of people on the call (and who they were!) we went a bit off topic and ended up chatting about services and what appears to be – to IBM customers and sellers at least – a shortage of skilled consultants available to help with the “tions” – replication, implementations, migrations and federation.

The Fillmore Group has skilled consultants available to support these efforts, at rates that are typically about half of those being charged by “the competition”.

If your team has a project pending, or one in process, where a skilled consultant, at a reasonable hourly rate, can get things back on track, please contact me.  We are ready to work!  A list of our IBM Information Management capabilities is attached here.

We were so pleased with the response to the *free* hands-on IDAA class delivered in Baltimore in April that we’ve decided to do two more in June!  Back again, to repeat their successful presentations will be Frank Fillmore and IBM IDAA experts Saghi Amirsoleymani and Mike Hood.

Class is open to any current DB2 for z/OS customer considering an IDAA acquisition, and will provide attendees with the opportunity to test drive an IDAA.

IBM® DB2® Analytics Accelerator for z/OS is a high-performance appliance that integrates IBM Netezza and zEnterprise technologies. The solution delivers extremely fast results for complex and data-intensive DB2 queries on data warehousing, business intelligence and analytic workloads.

IBM DB2 Analytics Accelerator for z/OS helps you:

• Query data at high speeds—to significantly improve response times for unpredictable, complex and long-running query workloads.
• Extend the capabilities of DB2 for z/OS—to support a cost-effective analytics solution for data warehousing, business intelligence and predictive analytics.
• Lower operating costs—by reducing System z disk requirements and offloading workloads and archiving infrequently used data using the High Performance Storage Saver (HPSS) technology.

DB2 Gold Consultant Frank Fillmore will present these 2-day, hands-on training classes to introduce experienced DB2 for z/OS DBA’s to the IDAA.  Starting with an overview of the unique hybrid technology behind the IDAA, and covering topics including installation, security, and operational management, the classes will deliver an understanding of how the IDAA can quickly integrate into your existing zEnterprise infrastructure and rapidly provide value.  Frank will be joined by IBM’s Saghi Amirsoleymani and Mike Hood for sessions focused on the IDAA tools.

There is no charge for these classes, however attendees are responsible for their own travel and lodging.  Please note that due to the technical nature of the hands-on labs, there is no distance learning/remote option available for these classes.

A continental breakfast and lunch will be provided each day.

Dates and locations scheduled are below.  Click on either session to register.  We hope you will join us!

IDAA Hands On Training NYC June 11 and 12 Terrace Club

IDAA Hands On Training Columbus June 25 and 26

DB2 Gold Consultant Frank Fillmore will deliver a 2-day, hands-on training class to introduce experienced DB2 for z/OS DBA’s to the IBM Data Analytics Accelerator (IDAA).  Starting with an overview of the unique hybrid technology behind the IDAA, and covering topics including installation, security, and operational management, the class will deliver an understanding of how the IDAA can quickly integrate into existing zEnterprise infrastructure and rapidly deliver value.

The course is *free* to all IBM z customers currently running DB2 for z/OS and considering an IDAA.  Customers traveling to Baltimore to attend the class will be responsible for their travel and lodging expenses.

The IBM DB2 Analytics Accelerator for z/OS is a high-performance appliance that integrates IBM Netezza and zEnterprise technologies proven to deliver extremely fast results for complex and data-intensive DB2 queries on data warehousing, business intelligence and analytic workloads.  DB2 Analytics Accelerator for z/OS helps DB2 customers:

• Query data at high speeds—to significantly improve response times for unpredictable, complex and long-running query workloads.
• Extend the capabilities of DB2 for z/OS—to support a cost-effective analytics solution for data warehousing, business intelligence and predictive analytics.
• Lower operating costs—by reducing System z disk requirements and offloading query workloads to a high-performance platform.

If you are interested in the IDAA I hope you will join us!

For those of you planning to attend this year’s Information on Demand (IOD) conference in Las Vegas, starting November 3rd, please join us for Frank Fillmore’s session, IPT-2150-B, “IBM Data Retrieval Technologies: RDBMS, BLU, IBM Netezza, and Hadoop“.  The session is scheduled for Tuesday, November 5th, from 1:45-2:45pm.

The session abstract is below.  In the session Frank will share his experience with IBM’s solutions to help determine which is best to meet your organization’s unique needs.

Abstract:  IBM offers four distinct data retrieval technologies: the traditional RDBMS, which primarily relies on indexes to speed access; the new BLU Acceleration columnar compression database; IBM PureData System for Analytics (IBM Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse the data; and IBM InfoSphere BigInsights, which is the IBM distribution of Hadoop. Choices are good to have, but how do you choose which technology to apply to a particular business use case? In this session, you learn how these techniques differ, including their relative strengths and weaknesses, to help you make an informed choice.

Here’s the “teaser” for IBM’s Big Data Announcement, “Big Data at the Speed of Business” scheduled for 11am today.  Watch the teaser and don’t miss the webcast!