I want to thank everyone who helped make the inaugural Mid-Atlantic Db2 for z/OS Users Group virtual meeting such a great success:

• my colleague, Kim May, for pulling the meeting together and for filling a void of timely technical content for this topic and this region
• our presenters for crafting and delivering a comprehensive new way of considering IBM System z
  • Andrew Austin, Red Hat
  • Clark Hale, Red Hat
  • Elton (the Wizard) de Sousa, IBM

The recording of the meeting is here: https://youtu.be/Am279HW1DDY

Individual presentations are as follows:

Db2 VUG – OpenShift Introduction – Austin + Hale

Db2 VUG – OpenShift on IBM z – de Sousa

Db2 VUG – Mainframe Modernization Field Notes – Fillmore

Please share this content with your colleagues.

Over 180 folks attended the “45 Minutes to Understand IBM Replication – Sources & Targets, Lower Latency, Costs” webinar on April 30, 2020 hosted by my colleague @KimMayTFG and me.  Thank you for joining us – along with the excellent questions and feedback.

These are the presentation materials IBM Data Replication Update 2020-04-30

You’ll find the recording of the webinar here.

Thanks to my colleagues, Kim May and Ed Lynch, for a terrific IBM InfoSphere Data Replication (IIDR) new features webinar delivered today.  The recording of the webinar is found here.    These are the presentation materials: Data Replication Update 2019-02-07 – Final

Dr. Sheldon Cooper of “The Big Bang Theory” regularly records a YouTube video called “Fun with Flags” so I’m going to call this blog post “Fun with SQL”.  Sheldon may be a future Nobel Prize winner, but I’ve been named an IBM Champion for Analytics and System z for 2019. 🙂

The problem statement: a large US government agency is contemplating migrating a packaged application from System z to Linux.  The current and future database repositories are Db2 for z/OS and Db2 for LUW respectively.  As a System z Champion I’ve presented on the continued relevancy and efficacy of the IBM mainframe, but that’s not the focus of this post.  One of the challenges of porting data is the conversion of character encoding from EBCDIC (Extended Binary Coded Decimal Interchange Code) which is the legacy encoding protocol used on IBM mainframes and System i to Unicode.  Db2 for z/OS supports Unicode, but I’m not going to address anything other than EBCDIC encoding at the source and Unicode at the target (Sorry, ASCII).  In brief, EBCDIC represents an 8 bit binary encoding scheme that can represent 256 different characters.  For example: the letter “F” (one of my faves) is represented as 1100 0110 in binary and C6 in hexadecimal. For national language support amid the variety of Single Byte Character Sets (SBCS) used around the world – think the German umlaut (i.e. ä ö ü) – the 256 byte universe of EBCDIC wasn’t nearly enough.  The Unicode solution is to use more than 1 byte to represent some characters.  For example: the “¢” cent sign takes one byte to represent in EBCDIC, but 2 bytes in Unicode.

select length(ebcdic_str('¢')) as EBCDIC, length(unicode_str('¢')) as Unicode from sysibm.sysdummy1;

EBCDIC    UNICODE

     1          2

This problem has manifested itself as an error when moving a CHAR(5) column of data from Db2 for z/OS to Db2 for LUW.  If, say, the pesky “¢” is present in the string and all 5 characters are significant (i.e. no trailing blanks), the string won’t fit in the same column width on the target platform.  Most customers find this out the hard way when the Db2 for LUW LOAD command or IMPORT utility posts errors.  There are two possible solutions:

• data cleanup (Do we really need the pesky ‘¢’ in a Comments column?)
• lengthen the target columns to accommodate Unicode expansion

Both can be time-consuming and expensive and will depend on a variety of factors beyond the scope of this blog post.  The purpose here today is to identify the extent of the problem before you actually try to port the data.  I’ve constructed this SQL statement to do just that. Read More…

On July 23 and 24, 2018 The Fillmore Group delivered a hands-on IBM Db2 Analytics Accelerator (IDAA) v7 Workshop to 12 students across 5 different enterprises at the IBM Dublin, Ohio (USA) Technical Education Center.  This was the first IDAA v7 hands-on Workshop delivered to customers anywhere.  Many thanks to Atlee, Bill, Bob, Dom, Emmi, Larry, Marshall, Mohammed, Naga, Ruth, Shawn, and Toby for all of the great questions.  Kudos to the IBM Poughkeepsie Benchmark Center for standing up the IDAA v7 environment in record time with just-released functionality like Incremental Update.  And thanks to IBMers Rich Gast, Mike Hood, Sandro Ramirez (aka “Nicky’s Dad”), Julie Efthymiou, and Rudy Benvenuto for all of their support.

Finally – and most importantly – the Workshop’s flawless execution from scheduling, invitations and outreach to customers, to welcome packets for travelers, to food service, and overall logistics was the direct result of many months of hard work on the part of my colleague, Kim May.  I really appreciate it!

The presentation materials are here:IDAA Workshop 2018-07

Since IDAA v7 is so radically different from it’s predecessors, the Workshop generated lots of questions which will be incorporated into future sessions.  Watch this space.

On July 23, 2010 I attended the announcement of the IBM Smart Analytics Optimizer (ISAO).  This was IBM’s first iteration of heterogeneous scale-out to enable mixed OLTP and OLAP workloads to run on the same platform.  Subsequently IBM acquired Netezza and the Netezza appliance became the foundation for the IBM Db2 Analytics Accelerator (IDAA).  In IDAA workshops I would refer to the ISAO as IDAA v0.5.

Fast forward to today when IBM announced IDAA v7.1.  “What is old is new again.”  Think of this delivery of IDAA as “ISAO v4.0” (there was some good-natured debate about the numbering).  Why do I frame it those terms?

1. IDAA has received a “brain transplant”.  Instead of Postgres, the database engine for IDAA will be Db2 Warehouse.  This will give IDAA greater compatibility with Db2 for z/OS, including broader SQL and datatype support, TIMESTAMP consistency, and more.  By exploiting Db2 with BLU Acceleration features such as in-memory columnar (rather than row-organized) data, Single Instruction, Multiple Data (SIMD) chips, actionable compression, and “data skipping” (avoiding extents that don’t contain data of interest) IDAA v7.1 provides a robust platform for better performance with a roadmap for continuous improvement and enhancement.  IBM has also consolidated its data repository development efforts by focusing on fewer, higher-value initiatives.
2. IDAA has received a “heart transplant”.  The IBM Integrated Analytics System (IIAS) appliance on which IDAA v7.1 is based, no longer depends on Field Programmable Gate Arrays (FPGA) that were the “secret sauce” of the Netezza (aka PureData System for Analytics – PDA).  FPGAs might be reintroduced at a later time.

So, a few questions – and a fewer answers.

• How long will the legacy Netezza/PDA “Mako” N3001 be supported?  Until 2023.  So the installed base of existing IDAAs will be protected for five years.
• Will the Database Partitioning Feature (DPF) – IBM’s MPP shared-nothing data warehouse scaling technology – be exploited by IDAA v7.1?  Dunno.
• Wither the IDAA cloud deployment introduced in v6?  Nary a mention today.

Topics for a future blog post:

• “True HTAP” – Hybrid Transaction / Analytic Processing
• IDAA deployment on IBM z – using Docker images sitting on Integrated Facility for Linux (IFL) specialty processors.

My colleague, Kim May – Vice President of Business Development at The Fillmore Group, has been elected Chairperson of the Board of Directors of the Baltimore/Washington DB2 Users Group.  Kim has served on the board of BWDB2UG since 2005 in many capacities such as programming and membership.  BWDB2UG continues to provide strong technical leadership for DB2 practitioners in the US Mid-Atlantic region.  Kim takes over from long-time board Chair Steve Rosenberger.

Kim is also an IBM Champion and is very active in the DB2 Community.  As an example, she presented at the IBM World of Watson conference in Las Vegas in 2016.  Kim recently returned from the zAnalytics Bootcamp held annually at IBM Silicon Valley Lab.

Kim’s business focus in 2017 is the IBM DB2 Analytics Accelerator (IDAA) and DB2 running on Linux on System z.  Please join me and the BWDB2UG board in supporting Kim in her new role.

On Tuesday, January 13, 1987 I sat in the kitchen of my 11 foot wide rowhouse in the Highlandtown section of Baltimore and typed out on a manual typewriter the Articles of Incorporation for The Fillmore Group.  My son, Nathaniel, was five weeks old.

Some back-of-the-envelope metrics across the past 30 years:

• approximately 300 clients
• about 60 consultants have helped train these customers and implement their IBM Analytics software
• As a consultant, instructor, and/or presenter at technical conferences I have traveled to approximately 20 countries.  Prague is my favorite foreign city; I’ve been there three times and look forward to returning.

I have had two consultants, Ray and Jim, tell me that working for The Fillmore Group “has changed [their] life”.  In the beginning it was a common occurrence that an employment verification form from a mortgage underwriter would arrive shortly after a consultant started with TFG.  I know of several consultants that purchased their first home while working with us.

My favorite work environment was The World Bank.  The cosmopolitan atmosphere – working with colleagues from all over the planet – was delightful.  I helped implement a telephone billing system there using SQL/DS.

My most satisfying project was the Oracle to DB2 migration at JP Morgan Chase.  It was a tough, demanding environment with a timeline that was half of the 18 months originally estimated.  But we got it done with the help of Jim, Joe G., Joe L., John, Rebecca, and Teresa.  The customer had an equally talented, hard-working team.  Our contribution to that project was recognized by IBM SVP Steve Mills at the Insight conference that year.

As a small business owner, my favorite question from an IBMer (Scott): “Since the deadline can’t change, if money were no object what would you do?”  The answer: supply five more consultants to the project.  It was completed on time – if not under budget.

As a technician, my favorite question from an IBMer (Hunter) in the parking lot after a detailed technical presentation to a customer involving replication and federation tools: “We can do that, right?”  The answer: yes we can.  It resulted in a massive data warehouse at a large federal government healthcare agency.

I have had the privilege to learn from and share friendships with some of IBM’s original developers of relational database technology including Pat, Curt, Don and Don, and Hamid.  For IBM’s Hybrid Transaction/Analytic Platform (HTAP) implementations of today I rely on Paul, Tim, Gary, Namik, Knut, Patric, and Udo among many, many others.

I also cherish the friendships I have formed with other DB2 Gold Consultants like David, Ted, Bonnie, Jan, Juergen, Julian, Jackie, Kermit, Sheryl, Susan – and especially Gerry.

IBM has been a maddening company with which to partner, but the vast majority of the time The Fillmore Group has benefited from the technical excellence and basic decency of IBM employees.  In return, TFG consultants like Roger and Ravi have delivered innovative, cost-effective IT solutions to our mutual customers.  After more than two decades I still rely on Roger for his calm, wise counsel.

There have been tough times, too.  The Fillmore Group overcame at least three financial near-death experiences (1993, 2002, 2006).  At the risk of tempting fate: we never missed a payroll or failed to pay a debt on time.

But the best time, by far, was the day Kim May arrived to rent The Fillmore Group’s technical training classroom in downtown Baltimore in 2003.  That was the day my life changed forever.

This is reverie, not valedictory.  I am still too young to retire.  And I am as jazzed about the possibilities of HTAP, data repositories, and data interoperability (aka “plumbing”) in 2017 as I was when I first started working with SQL/DS (maximum storage capacity: 64GB) in the mid 1980s.  We’re currently working on a database rehosting project for a local government targeting DB2 for z/Linux and have an IBM DB2 Analytics Accelerator (IDAA) v6 Workshop scheduled next month.

But I wanted to take a moment to jot down a few thoughts on the past three decades.  Of course, I haven’t called out everyone by name who has contributed to our success over the years.  But I truly, sincerely appreciate your hard work, dedication, integrity, smarts, and moxie.  Thank you!

In closing, when Curt retired from IBM I asked if he was pleased with a career that had reached a pinnacle as an IBM Fellow.  His response: “It turned out better than I ever could have imagined.”  Me too.

Our webinar delivered on March 11, 2016 outlining access to mainframe data specifically oriented to non-mainframers such as IT Architects and Data Scientists was a success.  The presentation materials are here: IBM z Systems – Mainframes – for IT Architects and Data Scientists

A recording of the webinar is found here.

On Monday, March 14, 2016 DB2 Gold Consultant and IBM Champion Frank Fillmore will present on Hybrid Analytic/Transaction Processing (HTAP) at the Heart of America DB2 Users Group in Overland Park, KS.

A complete agenda, presentation abstracts, and speaker biographies can be found here.