IBM Db2 Analytics Accelerator (IDAA) v7 Announced #IBMz #zAnalytics

Posted by Frank Fillmore on October 17, 2017 under BLU Acceleration, DB2 for Linux Unix Windows, HTAP, IBM Pure Systems, IDAA, Mako, Netezza. Tags: , , , .

On July 23, 2010 I attended the announcement of the IBM Smart Analytics Optimizer (ISAO).  This was IBM’s first iteration of heterogeneous scale-out to enable mixed OLTP and OLAP workloads to run on the same platform.  Subsequently IBM acquired Netezza and the Netezza appliance became the foundation for the IBM Db2 Analytics Accelerator (IDAA).  In IDAA workshops I would refer to the ISAO as IDAA v0.5.

Fast forward to today when IBM announced IDAA v7.1.  “What is old is new again.”  Think of this delivery of IDAA as “ISAO v4.0” (there was some good-natured debate about the numbering).  Why do I frame it those terms?

  1. IDAA has received a “brain transplant”.  Instead of Postgres, the database engine for IDAA will be Db2 Warehouse.  This will give IDAA greater compatibility with Db2 for z/OS, including broader SQL and datatype support, TIMESTAMP consistency, and more.  By exploiting Db2 with BLU Acceleration features such as in-memory columnar (rather than row-organized) data, Single Instruction, Multiple Data (SIMD) chips, actionable compression, and “data skipping” (avoiding extents that don’t contain data of interest) IDAA v7.1 provides a robust platform for better performance with a roadmap for continuous improvement and enhancement.  IBM has also consolidated its data repository development efforts by focusing on fewer, higher-value initiatives.
  2. IDAA has received a “heart transplant”.  The IBM Integrated Analytics System (IIAS) appliance on which IDAA v7.1 is based, no longer depends on Field Programmable Gate Arrays (FPGA) that were the “secret sauce” of the Netezza (aka PureData System for Analytics – PDA).  FPGAs might be reintroduced at a later time.

So, a few questions – and a fewer answers.

  • How long will the legacy Netezza/PDA “Mako” N3001 be supported?  Until 2023.  So the installed base of existing IDAAs will be protected for five years.
  • Will the Database Partitioning Feature (DPF) – IBM’s MPP shared-nothing data warehouse scaling technology – be exploited by IDAA v7.1?  Dunno.
  • Wither the IDAA cloud deployment introduced in v6?  Nary a mention today.

Topics for a future blog post:

  • “True HTAP” – Hybrid Transaction / Analytic Processing
  • IDAA deployment on IBM z – using Docker images sitting on Integrated Facility for Linux (IFL) specialty processors.

Thank you Governor Hogan!

Posted by Kim May on February 9, 2017 under DB2 for z/Linux, DB2 for z/OS, DB2 Migrations, IBM Information Management Software Sales, IDAA, Mako, Netezza, TFG Blog.

When I started working for The Fillmore Group over ten years ago, the world of DB2 was far different.  The State of Maryland had probably over a dozen IBM mainframes running state government agencies.  We occasionally delivered training and support, but often struggled with the procurement processes, as we weren’t an approved vendor.

As I learned, the master vendor list for IT vendors to the State of Maryland adds new vendors only once every 8 to 10 years, as the qualification process (we are talking government here!) is onerous and terribly time consuming for all involved.  So I waited and finally this past year it was time again for open enrollment.  The qualification process WAS onerous and time consuming and required the assistance of Maryland Governor Hogan’s office to make the insurance requirements attainable for small businesses like The Fillmore Group.

Many thanks Governor Hogan!  Today The Fillmore Group received the fully executed contract to deliver IT services to the State of Maryland.   There aren’t as many mainframes as there were ten years ago and efforts have been underway to consolidate their workloads, but we can help.  I think a private cloud running System z with a couple shared IDAA’s would be cost effective, efficient, and modern.  Can’t wait to get started!

IBM Q Replication: Frank’s Field Notes, Summer ‘16

Posted by Kim May on June 21, 2016 under DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, DB2 Migrations, Frank Fillmore, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IDAA, InfoSphere, Netezza, Oracle, Q-Replication, TFG Blog.

Please join us Thursday, July 28th, from 11am-12pm EDT for a free webinar with an update on IBM’s Q Replication.

Having worked with Q Replication customers since 2006, DB2 Gold Consultant and IBM Champion Frank Fillmore has collected useful tips and techniques for Q Replication implementation and administration. Join Frank as he shares his notes and thoughts on the topics below and delivers a mid-2016 checkpoint on the evolving IBM InfoSphere Data Replication (IIDR) product development roadmap.

In this session Frank will cover the topics below.  Please register for the session here.

  1. Cold Start a Q Replication topology.
    1. When and why would you need to consider a Cold Start.
    2. What are the steps?
  2. Oracle Native Q Apply – replication directly to an Oracle database (including RAC and Exadata).
    1. Comparison to Federated Apply.
    2. Co-existence and migration.
  3. Tooling – what tool do I use when?
    1. Q Replication Dashboard.
    2. ASNMON.
    3. Replication Center.
    4. ASNCLP.
  4. ASNCONSUMER – used to replicate to PureData System for Analytics (Netezza).
  5. Pricing models.

About Frank Fillmore:

DB2 Gold Consultant and IBM Champion Frank C. Fillmore, Jr. is the Founder and President of The Fillmore Group, Inc., a Premier IBM Business Partner that specializes in IBM Analytics software sales, consulting, and training.  Frank has been providing IBM database-oriented solutions to government, industry, and not-for-profit enterprises as varied as The World Bank, J.P. Morgan Chase, Northrop Grumman, and the FBI for over 29 years.  Frank’s current practice centers on Hybrid Transaction and Analytic Processing (HTAP) and Oracle to DB2 migrations as well as information governance and integration.  Frank kayaks and cheers for the Baltimore Orioles.

 

 

Chicago IBM DB2 Analytics Accelerator (IDAA) Class – Seats Still Available!

Posted by Kim May on May 17, 2016 under DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Information Management Software Sales, IDAA, Mako, Netezza.

There are still seats available for the June 6th and 7th *FREE* hands-on IDAA training class, scheduled for delivery in the IBM Chicago offices.  DB2 Gold Consultant Frank Fillmore will be delivering this class.  Frank has delivered this class several times and the feedback has been consistently positive, as the class helps customers understand the broad range of deployment options and use cases, as well as how it works.

If you are interested in joining us please review the course outline and register HERE.  Please note:  this class is available to prospective IDAA customers only and registration is required.  If you have any questions on the course content or logistics, please contact Kim May.  I hope to see you in Chicago!

 

*FREE* IBM DB2 Analytics Accelerator (IDAA) Hands-on Training

Posted by Kim May on April 26, 2016 under Authorized Training Partner, DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IBM Smart Analytics System, IDAA, Mako, Netezza, TFG Blog.

DB2 Gold Consultant Frank Fillmore will deliver a free, hands-on IBM DB2 Analytics Accelerator (IDAA) class at the IBM offices in Chicago at 71 South Wacker Drive on Monday and Tuesday, June 6th and 7th.  The course outline and registration link are HERE.   The Welcome Packet with travel and lodging recommendations will be sent once the registration is accepted.

Class is free, however students are responsible for their own travel and lodging expenses.  The Fillmore Group will provide breakfast and lunch each day to students in class.

The IDAA is a high-performance appliance that integrates IBM Netezza and zEnterprise technologies. The solution delivers extremely fast results for complex and data-intensive DB2 queries on data warehousing, business intelligence and analytic workloads.  You can:

– Query data at high speeds-to significantly improve response times for unpredictable, complex and long-running query workloads.

– Extend the capabilities of DB2 for z/OS-to support a cost-effective analytics solution for data warehousing, business intelligence and predictive analytics.

– Lower operating costs-by reducing System z disk requirements and offloading query workloads to a high-performance platform.

Please note:  this class is offered exclusively to IBM z Systems customers considering an IDAA purchase.  Registration is required.

I hope you will join us and learn more about the IDAA! If you have any questions on the class, please feel free to contact me at kim.may@thefillmoregroup.com.

DB2 101 Event – 8 Seats Still Available!

Posted by Kim May on April 8, 2016 under Big Data, BLU Acceleration, DB2 Connect, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Federation, Frank Fillmore, Hadoop, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IBM Mid Market Customers, IBM Pure Systems, IDAA, InfoSphere, Mako, Netezza, Optim, pureScale, Q-Replication, TFG Blog.

Frank and I attended an IBM Business Partner event in Philadelphia earlier this week where we met with several IBM’ers supporting Business Partner initiatives in 2016.  Each of the specialists presented their “best of” solutions to the partners in attendance, and then patiently answered our many questions (mostly mine – sorry team!)

The final preparations for our Woodberry Kitchen lunch event are underway:   Frank and I are polishing the presentation, IBM’s Andrew Levine and Warren Heising are tracking down answers to my Cloud deployment “what if?” questions, Megan is gathering gold coins for attendees who ask Frank good technical questions, and Jolanta at Woodberry Kitchen has me salivating with her menu recommendations.

If you will be in Baltimore April 21st and haven’t registered yet, please do!  Register HERE.

DB2 101 – IBM Data Management Portfolio 2016 – Woodberry Kitchen Luncheon

Posted by Kim May on March 10, 2016 under BLU Acceleration, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, DB2 Migrations, DB2 Stars, Frank Fillmore, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IBM Pure Systems, IDAA, InfoSphere, InfoSphere Streams, Mako, Netezza, Oracle, pureScale, Q-Replication, TFG Blog.

For Baltimore and Mid-Atlantic area data management customers, The Fillmore Group is excited to announce a “DB2 101” luncheon event at award-winning Woodberry Kitchen in Baltimore on Thursday, April 21, 2016, from 11am – 2pm.

Join DB2 Gold Consultant Frank C. Fillmore, Jr., for a delicious lunch and a sprint through the IBM Analytics 2016 data management solutions portfolio.   Whether you are a long-time IBM customer or are considering your first IBM product purchase, Frank’s presentation will deliver the latest on today’s hottest technology topics – HTAP, Big Data/Hadoop and Cloud – and the specific solutions IBM has built, acquired and integrated to enable customers to meet their data management goals.

Is this, “the more things change the more they stay the same”, or an inflection point for data technology? You be the judge!

Frank’s overview will include IBM’s DB2 core databases, InfoSphere data integration solutions, Hybrid Transaction / Analytics Processing (HTAP), Big Data/Hadoop and Cloud offerings, as well as his 2016 best product recommendations and resources to help you learn more and evaluate these solutions.

Lunch and valet parking will be provided free of charge by The Fillmore Group.  Registration is required as seating is limited.  Register HERE.

If you have any questions or dietary restrictions please contact Kim May at kim.may@thefillmoregroup.com.  I hope we will see you at Woodberry!

DB2 101 Woodverry Kitchen 003

 

April Events – “DB2 101” Luncheon and Free Hands-on IDAA Class

Posted by Kim May on March 7, 2016 under Authorized Training Partner, BigInsights, BLU Acceleration, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, HTAP, IBM Champion, IBM Information Management Software Sales, IDAA, Mako, pureScale, Q-Replication, TFG Blog.

I am excited to announce two upcoming events The Fillmore Group will deliver in April.  Stay tuned for dates and locations!

Woodberry “DB2 101” Luncheon

Join DB2 Gold Consultant Frank C. Fillmore, Jr., for a sprint through IBM Analytics’ 2016 data management solutions portfolio. From today’s hottest topics – HTAP, Hadoop and Cloud – to the specific IBM solutions behind the buzzwords, Frank will deliver an overview of how IBM has built, acquired and integrated data management solutions to enable customers to accomplish their organization’s goals. Is this, “the more things change the more they stay the same”, or an inflection point for data technology? You be the judge!

Free Hands-on IBM DB2 Analytics Accelerator (IDAA) April Class

IBM’s 2012 announcement of the IBM DB2 Analytics Accelerator – the IDAA – the Netezza/mainframe hybrid, delivered IBM’s first Hybrid Transaction/Analytics Processing (HTAP) solution. Now, after 3 years and multiple enhancements, the IDAA continues to promise great things for IBM DB2, VSAM and IMS customers. According to our calculations, 90% of IBM System z customers don’t own an IDAA yet – and we think everyone should have one! Join us for this free, 2-day, hands-on, technical introduction to learn how an IDAA can benefit your System z shop.

 

 

Lunch Event March 3rd: #zIBM (Mainframes!) for Data Architects and Data Scientists

Posted by Frank Fillmore on February 2, 2016 under Big Data, DB2 Connect, DB2 for z/OS, DB2 Gold Consultants, Federation, Frank Fillmore, IBM Champion, IDAA, Q-Replication. Tags: , , , , , , , .

Kim has just returned from IBM’s annual “z Bootcamp” where they prepare their System z sellers for the upcoming year with a series of product updates, announcements and education.  Her takeaway message for 2016 was loud and clear:  IBM intends to continue to enhance and extend the capabilities of System z so they can remain relevant and leading the effort to leverage the power of System z data.

Which leads, naturally, to the “how?” question.  At The Fillmore Group, as an IBM Business Partner we believe our ability to connect with Data Scientists and Data Architects and to help them understand the data stored in System z will help us all better align our interests and build a successful data and analytic ecosystem.  To kick start this effort we have planned a lunch event at the award-winning Woodberry Kitchen in Baltimore where Frank Fillmore will present an overview of System z.  Read more below – and please join us if you can!

“IBM z Systems (Mainframes!) for IT Architects and Data Scientists”

Abstract
Fifty percent or more of a large enterprise’s data – especially the lifeblood online transaction processing (OLTP) data – likely reside on IBM z Systems (aka mainframe) computers.  In many organizations, mainframes remain a black box inside the “glass house” data center.  Yet the rich transactional data they contain are crucial to predictive analytics, such as fraud detection, and real-time data warehousing applications such as point-of-sale market basket analysis.

This lunch session is intended for Architects and Data Scientists who don’t have a mainframe background, but have been tasked by lines-of-business to develop new competitive insights into customers, supply chains, insurance claims, financial transactions – and/or any of a variety of other opportunities to turn an enterprise’s OLTP data into Big Data.

DB2 Gold Consultant and IBM Champion Frank Fillmore will explain:

The types of data are found on the mainframe, including:
• DB2 for z/OS (relational database)
• IMS – Information Management System (hierarchical database)
• VSAM – Virtual Storage Access Method (indexed file)

Frank will also explain the four key approaches to unlocking the data:
1. HTAP – Hybrid Transaction and Analytics Platform
2. Replication to heterogeneous data stores
3. Virtualization of heterogeneous data stores
4. ETL – Extract Transform Load

Frank will also discuss the how these approaches apply to the types of data in the context of the application requirements such as service level agreements (SLAs).

The session will be held on Thursday, March 3rd, from 11am-2pm at the Woodberry Kitchen, 2010 Clipper Mill Road, Suite 126, Baltimore, Maryland, 21211.

Registration is required.  Register HERE.

If you are unable to join us in Baltimore, Frank will deliver similar content in a webinar on Friday, March 11, 2016.  Registration for the session, to be held between 11am and noon, EST, is HERE.

Please note:  registration is required for both sessions as space is limited.  If you are a mainframe systems programmer or database administrator this is *not* the session for you (you should already know this stuff!)

Frank to Present on HTAP at Philadelphia System z Meeting

Posted by Kim May on August 21, 2015 under BLU Acceleration, DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IDAA, Netezza, TFG Blog.

Frank will be presenting, “Hybrid Transaction Processing” at the new Philadelphia System z group meeting at Maggiano’s Little Italy, located at 205 Mall Boulevard, King of Prussia, Pennsylvania, 19406, on Friday, September 18th.  Frank’s presentation will run from 10:45am – 11:45am, after which lunch will be served.

In his session, Frank will describe and compare the four distinct data retrieval technologies available from IBM, including two Hybrid Transaction and Analytics Processing (HTAP) platforms.  Choices are good to have, but how do you choose which technology to apply to a particular business use case?  Learn now these technologies differ, including their relative strengths and weaknesses.

Also on the schedule to present are Bill Shipley, Senior DBA from Vanguard, discussing his experience facilitating analytics with both System z and the IDAA,  Mark Anzani, IBM Vice President of IBM z Systems Strategy and Montgomery Bauman, IBM Technical Specialist for z Systems.

The event runs from 9:00am to 2:45pm, and is being sponsored by IBM.  Register to attend at:  https://ibm.biz/zPhillyUserGroup