IBM Db2 Analytics Accelerator (IDAA) v7 Announced #IBMz #zAnalytics

Posted by Frank Fillmore on October 17, 2017 under BLU Acceleration, DB2 for Linux Unix Windows, HTAP, IBM Pure Systems, IDAA, Mako, Netezza. Tags: , , , .

On July 23, 2010 I attended the announcement of the IBM Smart Analytics Optimizer (ISAO).  This was IBM’s first iteration of heterogeneous scale-out to enable mixed OLTP and OLAP workloads to run on the same platform.  Subsequently IBM acquired Netezza and the Netezza appliance became the foundation for the IBM Db2 Analytics Accelerator (IDAA).  In IDAA workshops I would refer to the ISAO as IDAA v0.5.

Fast forward to today when IBM announced IDAA v7.1.  “What is old is new again.”  Think of this delivery of IDAA as “ISAO v4.0” (there was some good-natured debate about the numbering).  Why do I frame it those terms?

  1. IDAA has received a “brain transplant”.  Instead of Postgres, the database engine for IDAA will be Db2 Warehouse.  This will give IDAA greater compatibility with Db2 for z/OS, including broader SQL and datatype support, TIMESTAMP consistency, and more.  By exploiting Db2 with BLU Acceleration features such as in-memory columnar (rather than row-organized) data, Single Instruction, Multiple Data (SIMD) chips, actionable compression, and “data skipping” (avoiding extents that don’t contain data of interest) IDAA v7.1 provides a robust platform for better performance with a roadmap for continuous improvement and enhancement.  IBM has also consolidated its data repository development efforts by focusing on fewer, higher-value initiatives.
  2. IDAA has received a “heart transplant”.  The IBM Integrated Analytics System (IIAS) appliance on which IDAA v7.1 is based, no longer depends on Field Programmable Gate Arrays (FPGA) that were the “secret sauce” of the Netezza (aka PureData System for Analytics – PDA).  FPGAs might be reintroduced at a later time.

So, a few questions – and a fewer answers.

  • How long will the legacy Netezza/PDA “Mako” N3001 be supported?  Until 2023.  So the installed base of existing IDAAs will be protected for five years.
  • Will the Database Partitioning Feature (DPF) – IBM’s MPP shared-nothing data warehouse scaling technology – be exploited by IDAA v7.1?  Dunno.
  • Wither the IDAA cloud deployment introduced in v6?  Nary a mention today.

Topics for a future blog post:

  • “True HTAP” – Hybrid Transaction / Analytic Processing
  • IDAA deployment on IBM z – using Docker images sitting on Integrated Facility for Linux (IFL) specialty processors.

Another Oracle Attack Webinar? You Bet!

Posted by Kim May on May 2, 2017 under BLU Acceleration, DB2 Education, DB2 for Linux Unix Windows, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM DB2 Services, IBM Mid Market Customers, Oracle, pureScale, TFG Blog.

With IBM’s announcement this week of super-aggressive discounting being offered to current Oracle customers considering a move to DB2, and with the deadline looming for many Oracle customers faced with another year of bloated “investment” in Oracle support, we’ve decided to deliver updated material on the benefits of moving to DB2.

Our upcoming webinar, “Oracle Renewal Looming?  Consider DB2!” will be delivered on Tuesday, May 16th, from 11:30am to 12:30pm EDT.

DB2 Gold Consultant Frank Fillmore will join me for the session, as will IBM’s Tony Mancini, Worldwide Competitive Team Executive.  Tony will give us a brief overview of IBM’s recent announcement, and Frank and I will deliver a fast-paced, interactive 60-minute session that will (we hope!) provide current Oracle customers with an understanding of both the cost savings and incredible database functionality available with DB2.

Please register HERE to join us!

Calling All IDAA Users!

Posted by Kim May on April 18, 2017 under DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IDAA, TFG Blog.

The next IBM-sponsored DB2 Analytics Accelerator Users’ Group meeting was announced this week.  The Fillmore Group’s Frank Fillmore will be presenting one of the sessions, along with BNY/Mellon Pershing’s Al DiGiovanni, whose support and promotion of the IDAA enabled Pershing to acquire their first IDAA.

Al and Frank will be presenting the meeting’s final session titled, “Increasing Utilization of the Accelerator by your Lines of Business”, a session whose topic has been a core issue for System z customers trying to persuade their colleagues to consider investing in the IDAA.

As many technical teams promoting IDAA adoption have learned (the hard way!), most organizations adopted the circa-Y2K best practice of running OLTP and analytic workloads separately, and are therefore reluctant to re-integrate the two, in spite of the cost, latency and simplicity advantages.  This session is designed to surface the issue and discuss options to address and overcome it.

Information on the DAAUG meeting is below.  Please be advised that membership in this group is limited to current IDAA customers and registration to attend is managed by IBM.  If you own an IDAA and would like to attend, and have not received an email invitation from IBM, please email me (kim.may@thefillmoregroup.com) and I will connect you to the IBM team coordinating the meeting.

I hope you will join us May 9th.

Session Details
Increasing Utilization of the Accelerator by your Lines of Business
Frank Fillmore and Al DiGiovanni, BNY/Mellon Pershing

The IDAA is a powerful tool for performing real-time analytics on z/OS transactional data.  In many cases it is left to the managers of an enterprise’s mainframe to “sell” an IDAA to lines of business (LOBs).

  • The audience for the sales pitch: CFOs, CTOs, Enterprise IT Architects, Data Scientists
  • The objections:
    o existing infrastructure (ETL processes, enterprise data warehouses)
    o mainframe marginalization (“The mainframe is too expensive”; “The mainframe is not a strategic platform”)
  • The advantages:
    o reduced complexity
    o reduced latency
    o cost savings (e.g. inexpensive data archiving of all System z data)
  • New opportunities:
    o in-database transformation (i.e. AOTs for MicroStrategy)
    o in-database analytics (i.e. INZA-IDAA 3.2.2.1)
    o cloud deployment (Public/Private/Hybrid)
    o Machine Learning
    o R support

DB2 Analytics Accelerator Users’ Group (DAAUG) Meeting

Date:           Tuesday, May 9, 2017
Location:     IBM Offices, NYC or via web conference
Time:           9:30am – 2:00pm EDT

During this meeting, Ute Baumbach, subject matter expert from the Analytics on z Systems Center of Excellence out of Boeblingen, Germany, will cover the most recently introduced Accelerator features, functions and fixes. Tim Willging, Distinguished Engineer, will discuss how you can expand your Accelerator use cases with new functionality in the Accelerator Loader Tool. Jonathan Sloan, Business Analytics Executive Consultant, will present ways the Accelerator complements IBM Machine Learning. Frank Fillmore, DB2 Gold Consultant of the Fillmore Group, and a customer presenter will share their successful experiences to help you promote the value of the Accelerator to your Lines of Business.

We encourage you to join the meeting in person if you are local. Web Meeting details will be provided for remote attendees.

Agenda:

09:30 – 10:00       Registration
10:00 – 10:15        Welcome
10:15 – 10:45         Developer’s Update: DB2 Analytics Accelerator Features, Functions and Fixes
10:45 – 11:30         Expanding Accelerator use cases with new DB2 Analytics Accelerator Loader
functionality
11:30 – 12:00         Lunch Break
12:00 – 01:00        Complementing IBM Machine Learning with the DB2 Analytics Accelerator
01:00 – 02:00       Increasing Utilization of the Accelerator by your Lines of Business

Oracle Renewal Looming? Consider DB2! @IBMAnalytics

Posted by Frank Fillmore on April 6, 2017 under BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/Linux, DB2 Migrations, HTAP, IBM DB2 Services, MQT's, Oracle, pureScale. Tags: .

Thanks to Kim May for a fabulous job stepping customers and IBMers through the rewards and challenges of converting Oracle databases to DB2.  The recording of the webinar is found here.  The presentation materials: Oracle Customers Consider DB2 4.5.17

Finally, The Fillmore Group’s White Paper on Oracle to DB2 migrations: SmarterQuestions White Paper – Oracle to DB2 Migration Lessons Learned – Final

Please reach out to Kim or me if you have any questions.

Webinar: Oracle Renewal Looming? Consider DB2!

Posted by Kim May on March 13, 2017 under BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/Linux, DB2 Gold Consultants, DB2 Migrations, Frank Fillmore, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, Oracle, pureScale, TFG Blog.

The Fillmore Group is inviting organizations frustrated with rising Oracle costs to join us for a webinar focusing on the two primary motivations behind DB2 migrations: cost and functionality. Session attendees will perform a self-analysis to compare similar version license costs, and gain an understanding of the technical features included in DB2 for on-premise use – BLU, pureScale, and the Data Partitioning Feature – as well as a brief overview of cloud deployment and SaaS options.

Date:   Thursday, April 6th

Time:  11:00am – 12:00pm EDT

The session also includes an overview of the migration process, as anyone considering a move needs to understand the time and effort involved.

Sound boring? It won’t be! The session will be delivered by IBM Champions Frank Fillmore and Kim May. Frank has participated in IBM’s annual “Break Free Forum” and Kim has worked with several Oracle customers exploring migrations to DB2. We understand this is a complicated comparison but will do our best to make the session entertaining without including too much Oracle bashing. But maybe a bit.

Registration is required to attend. Register HERE.

It was 30 years ago today… The Fillmore Group “Founder’s Day” @ffillmorejr @KimMayTFG #IBMAnalytics #IBMz

Posted by Frank Fillmore on January 13, 2017 under DB2 for Linux Unix Windows, DB2 for VSE&VM, DB2 for z/Linux, DB2 for z/OS, DB2 Gold Consultants, DB2 Migrations, Federation, HTAP, IBM Champion, IDAA, International DB2 Users Group (IDUG), Q-Replication. Tags: , .

On Tuesday, January 13, 1987 I sat in the kitchen of my 11 foot wide rowhouse in the Highlandtown section of Baltimore and typed out on a manual typewriter the Articles of Incorporation for The Fillmore Group.  My son, Nathaniel, was five weeks old.

Some back-of-the-envelope metrics across the past 30 years:

  • approximately 300 clients
  • about 60 consultants have helped train these customers and implement their IBM Analytics software
  • As a consultant, instructor, and/or presenter at technical conferences I have traveled to approximately 20 countries.  Prague is my favorite foreign city; I’ve been there three times and look forward to returning.

I have had two consultants, Ray and Jim, tell me that working for The Fillmore Group “has changed [their] life”.  In the beginning it was a common occurrence that an employment verification form from a mortgage underwriter would arrive shortly after a consultant started with TFG.  I know of several consultants that purchased their first home while working with us.

My favorite work environment was The World Bank.  The cosmopolitan atmosphere – working with colleagues from all over the planet – was delightful.  I helped implement a telephone billing system there using SQL/DS.

My most satisfying project was the Oracle to DB2 migration at JP Morgan Chase.  It was a tough, demanding environment with a timeline that was half of the 18 months originally estimated.  But we got it done with the help of Jim, Joe G., Joe L., John, Rebecca, and Teresa.  The customer had an equally talented, hard-working team.  Our contribution to that project was recognized by IBM SVP Steve Mills at the Insight conference that year.

As a small business owner, my favorite question from an IBMer (Scott): “Since the deadline can’t change, if money were no object what would you do?”  The answer: supply five more consultants to the project.  It was completed on time – if not under budget.

As a technician, my favorite question from an IBMer (Hunter) in the parking lot after a detailed technical presentation to a customer involving replication and federation tools: “We can do that, right?”  The answer: yes we can.  It resulted in a massive data warehouse at a large federal government healthcare agency.

I have had the privilege to learn from and share friendships with some of IBM’s original developers of relational database technology including Pat, Curt, Don and Don, and Hamid.  For IBM’s Hybrid Transaction/Analytic Platform (HTAP) implementations of today I rely on Paul, Tim, Gary, Namik, Knut, Patric, and Udo among many, many others.

I also cherish the friendships I have formed with other DB2 Gold Consultants like David, Ted, Bonnie, Jan, Juergen, Julian, Jackie, Kermit, Sheryl, Susan – and especially Gerry.

IBM has been a maddening company with which to partner, but the vast majority of the time The Fillmore Group has benefited from the technical excellence and basic decency of IBM employees.  In return, TFG consultants like Roger and Ravi have delivered innovative, cost-effective IT solutions to our mutual customers.  After more than two decades I still rely on Roger for his calm, wise counsel.

There have been tough times, too.  The Fillmore Group overcame at least three financial near-death experiences (1993, 2002, 2006).  At the risk of tempting fate: we never missed a payroll or failed to pay a debt on time.

But the best time, by far, was the day Kim May arrived to rent The Fillmore Group’s technical training classroom in downtown Baltimore in 2003.  That was the day my life changed forever.

This is reverie, not valedictory.  I am still too young to retire.  And I am as jazzed about the possibilities of HTAP, data repositories, and data interoperability (aka “plumbing”) in 2017 as I was when I first started working with SQL/DS (maximum storage capacity: 64GB) in the mid 1980s.  We’re currently working on a database rehosting project for a local government targeting DB2 for z/Linux and have an IBM DB2 Analytics Accelerator (IDAA) v6 Workshop scheduled next month.

But I wanted to take a moment to jot down a few thoughts on the past three decades.  Of course, I haven’t called out everyone by name who has contributed to our success over the years.  But I truly, sincerely appreciate your hard work, dedication, integrity, smarts, and moxie.  Thank you!

In closing, when Curt retired from IBM I asked if he was pleased with a career that had reached a pinnacle as an IBM Fellow.  His response: “It turned out better than I ever could have imagined.”  Me too.

IBM DB2 Analytics Accelerator (IDAA) *Free* Hands-On Training Class

Posted by Kim May on January 3, 2017 under Data Studio, DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Champion, IDAA, TFG Blog.

idaa-sticker

DB2 Gold Consultant and IBM Champion Frank C. Fillmore, Jr. will deliver a *free*, hands-on IDAA training class in Baltimore on Monday and Tuesday, February 27th and 28th.  IBM System z customers considering a 2017 IDAA purchase are invited to attend.

Frank has delivered similar classes in the past and looks forward to delivering this updated class featuring the recently announced IDAA V6.1.  This class will combine material explaining why you should have an IDAA and how to use it (query acceleration, High Performance Storage Saver, loading non-DB2 data using the Rocket Loader tool), along with new material introducing new ways to extend your System z’s processing capabilities to the cloud and into the new world of HTAP – Hybrid Transaction Analytic Processing – with the latest IDAA release.

Class is free, however attendees are responsible for their travel and lodging expenses.  IBM reps are invited to join us along with their customers.  The Fillmore Group will provide a continental breakfast and lunch each day, and dinner Monday evening for attendees interested in joining us.  Registration is required – please follow the link below to register.

Dates (2 days):    Monday and Tuesday, February 27th and 28th, 2017
Class Times:        9:00am – 4:00pm ( breakfast served at 8:30am)
Cost:                    Class is free; attendees are responsible for their T&L
Instructor:            Frank Fillmore
Location:              The Radisson Cross Keys, 5100 Falls Rd, Baltimore, MD 21210

REGISTER HERE

Topics:
• New in IDAA v6.1 – the architecture, cloud option, R functions support and dashDB
• Assessment tools to support acquisition:  Workload Assessment, Client Value Engagement, PoC
• Positioning IDAA within your organization with the most valuable use case

Lab 1: Basic IDAA Activities
• Data Studio / IBM DB2 Analytics Accelerator Studio GUI
• Table acceleration
• Query processing and analysis

Enhancing Value to the IDAA with the IBM Tools Ecosystem
• Assessment: What is the workload that would benefit from being accelerated?
• Optimization: How do I monitor and optimize a workload to take advantage of the Accelerator?
• Administration: Can I manage the Accelerator more effectively?

Lab 2: Advanced IDAA Exploitation
• Incremental Update: keeping accelerated data in sync with DB2 for z/OS OLTP
• High Performance Storage Saver (HPSS): store archival data only on IDAA
• Accelerating Static SQL workloads

“Help!! My Manager Said We’re Moving Off the Mainframe!” Webinar Thursday

Posted by Kim May on November 14, 2016 under DB2 Education, DB2 for z/Linux, DB2 for z/OS, DB2 Gold Consultants, DB2 Migrations, Frank Fillmore, HTAP, IBM Champion, IBM DB2 Services, IDAA, TFG Blog.

Many thanks to the IBM z Systems team – Annette Zawacki and Jim Reed in particular – for supporting and promoting Thursday’s webinar.  We seem to have struck a nerve as the registrations reads like a “who’s who” list of System z customers.

We understand many organizations are facing pressure from management teams who believe “newer” solutions are better, and dealing with operational issues resulting from the aging workforce and accumulated “technology debt” brought on by years of reliable data processing on the mainframe.  Who ever thought THAT would be a problem??

We are polishing the presentation and looking forward to assisting System z customers and colleagues with a proactive response plan.  I hope you will join us – the session will be delivered from 11am-12:00pm EDT, Thursday, November 17th.  Registration is required; register HERE.

Abstract:

Technology is all about innovation and everyone knows the mainframe is as old as dirt. Therefore, according to many CIO’s, now’s the time to move to something new, like maybe open source, in the cloud with some of those cute animals.

How can loyal System z users respond to this short-sighted “management by airline magazine” approach? Join us to learn tactics to win the battle of the best platform to trust with your organization’s critical data and applications. We will prepare you to respond to the “modernization” message with a clear and logical action plan that promotes organizational efficiency, cost savings – and sanity (the mainframe!!)

The 3 critical takeaways:

  1. Locate, gather and excite your IBM z team.
  2. Be smart, be bold. Understand the enemy – where management teams are hearing the mainframe is obsolete message and the specific issues to address.
  3. Gather collateral to *wow* your colleagues. Learn where to get industry white papers, how to complete a System z cost analysis and schedule activities to address management’s concerns.

Facilitators:

Frank Fillmore: DB2 Gold Consultant Frank Fillmore has been working with System z customers throughout his 30 year career in IT. Most recently Frank has been working with IBM DB2 Analytics Accelerator (IDAA) customers and working with customers to leverage the value of the mainframe. Frank is also an IBM Champion.

Kim May: Kim May is the Vice President Business Development at The Fillmore Group, an IBM Business Partner specializing in IBM data management software and services. Kim is an IBM Champion and serves on the board of the Baltimore/Washington DB2 Users Group.

Chicago IBM DB2 Analytics Accelerator (IDAA) Class – Seats Still Available!

Posted by Kim May on May 17, 2016 under DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Information Management Software Sales, IDAA, Mako, Netezza.

There are still seats available for the June 6th and 7th *FREE* hands-on IDAA training class, scheduled for delivery in the IBM Chicago offices.  DB2 Gold Consultant Frank Fillmore will be delivering this class.  Frank has delivered this class several times and the feedback has been consistently positive, as the class helps customers understand the broad range of deployment options and use cases, as well as how it works.

If you are interested in joining us please review the course outline and register HERE.  Please note:  this class is available to prospective IDAA customers only and registration is required.  If you have any questions on the course content or logistics, please contact Kim May.  I hope to see you in Chicago!

 

*FREE* IBM DB2 Analytics Accelerator (IDAA) Hands-on Training

Posted by Kim May on April 26, 2016 under Authorized Training Partner, DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IBM Smart Analytics System, IDAA, Mako, Netezza, TFG Blog.

DB2 Gold Consultant Frank Fillmore will deliver a free, hands-on IBM DB2 Analytics Accelerator (IDAA) class at the IBM offices in Chicago at 71 South Wacker Drive on Monday and Tuesday, June 6th and 7th.  The course outline and registration link are HERE.   The Welcome Packet with travel and lodging recommendations will be sent once the registration is accepted.

Class is free, however students are responsible for their own travel and lodging expenses.  The Fillmore Group will provide breakfast and lunch each day to students in class.

The IDAA is a high-performance appliance that integrates IBM Netezza and zEnterprise technologies. The solution delivers extremely fast results for complex and data-intensive DB2 queries on data warehousing, business intelligence and analytic workloads.  You can:

– Query data at high speeds-to significantly improve response times for unpredictable, complex and long-running query workloads.

– Extend the capabilities of DB2 for z/OS-to support a cost-effective analytics solution for data warehousing, business intelligence and predictive analytics.

– Lower operating costs-by reducing System z disk requirements and offloading query workloads to a high-performance platform.

Please note:  this class is offered exclusively to IBM z Systems customers considering an IDAA purchase.  Registration is required.

I hope you will join us and learn more about the IDAA! If you have any questions on the class, please feel free to contact me at kim.may@thefillmoregroup.com.