IBM Data Replication 2020: In a Nutshell

IBM replication is based on two unique technical solutions: InfoSphere Change Data Capture, the heritage DataMirror product, and Q-Replication, the IBM-developed replication solution that uses MQ messaging.

IBM replication supports numerous sources and targets. For heterogeneous environments, that is, where either the source or target are not Db2, IBM recommends InfoSphere Change Data Capture. For Db2 to Db2 replication, IBM recommends Q Replication.

The currently available sources are targets are below. New offerings are always being added; for a current list visit the IBM replication homepage.

New offering highlight: Mainframe replication for Db2 for z and VSAM featuring “Remote Capture”, with the replication engine installed off the mainframe. The new solution delivers easier installation and administration as well as lower MIPs consumption to support replication from System z.

Coming soon: Refreshed monitoring tools built on Watson Knowledge Catalog, enabling expanded governance and integration with replication monitoring.

Implementation support, healthchecks and education:  Contact The Fillmore Group. We have several Quickstart offerings and have been delivering the IBM replication education offerings for decades.

Replication Sources: Db2 (LUW, Z/OS, iSeries), Oracle, SQL Server, PostgreSQL, VSAM, IMS, Informix, Sybase, MySQL.

Replication Targets: All above RDBMSs plus Teradata, Kafka, Hadoop, Files, Information Server (DataStage/QualityStage), Cloudant, AWS RedShift, S3, Azure SQL DB, JDBC targets (MongoDb, etc.), IBM IAS/ Db2WH/Db2WHoC, Netezza/Cloud Pak 4 Data System, and more.

Remote Capture Quickstart

Postgres Capture Quickstart

Kafka Replication Quickstart

Over 180 folks attended the “45 Minutes to Understand IBM Replication – Sources & Targets, Lower Latency, Costs” webinar on April 30, 2020 hosted by my colleague @KimMayTFG and me.  Thank you for joining us – along with the excellent questions and feedback.

These are the presentation materials IBM Data Replication Update 2020-04-30

You’ll find the recording of the webinar here.

IBM is hosting the September meeting of the Baltimore/Washington Db2 Users Group to be held at the BWI Hilton on Wednesday, September 11th.  IBM’s Kenishia Sapp and Anthony Ciabattoni will be presenting on Db2 for z/OS topics (see agenda below) and *drum roll!* IBM Replication Product Offering Manager Davendra Paltoo will be presenting on IBM’s recent replication enhancements and new offerings.

With the recent Gartner report validating IBM’s market position in their “magic quadrant” with IBM’s offerings supporting a broad range of replication sources and targets (including Postgres and Kafka), and the increased focus on making data accurate and available for analytics, it’s important to understand what IBM is delivering to customers today.

If you are in the Baltimore/Washington area I hope you will join us for the meeting and the opportunity to talk replication with Davendra.

The full agenda is below.  Registration is required – please register on the Baltimore/Washington Db2 Users Group website HERE.

Date:  Wednesday, September 11, 2019

Time:  9:00am – 3:30pm (registration open at 8:30am)

Location:  BWI Hilton, 1739 W Nursery Road, Linthicum Heights, MD  21090

Agenda:

9:00am – 10:15am   APIs: A Pathway to the Modern Enterprise, Kenishia Sapp, IBM NA z API Swat Team

As Enterprises begin their modernization journeys, REST and the API economy are integral elements of their roadmaps. There are many ways to achieve the goal of REST API enablement for the mainframe, and it can be hard to distinguish the benefits and unique value points among them. Kenishia Callaway will illustrate how solutions such as z/OS Connect, API Connect and others can be used to modernize while retaining the well-developed systems that differentiate company value.

10:30am – 11:45am  Db2 for z/OS Native RESTful Experience, Anthony Ciabattoni, IBM Db2 zOS Development SWAT Team

IBM Db2 for z/OS is still the undisputed leader for storing and maintaining mission critical data. It remains the “gold standard” for system availability, scalability, security and cost effectiveness. A majority of Fortune 500 companies, including the world’s top banks, retailers and insurance providers trust Db2 for z/OS for storing their data. In addition, Db2 for z/OS continues to invest in industry leading easy to access, efficient and cost effective data access capabilities while maintain our mainframe heritage.This session will show how Db2 REST services allow modern applications to access and consume Db2 data and to reuse existing SQL statements and stored procedures. We will present how they are easily deployed, managed and also promote the rapid/agile development and deployment of new applications that are mobile friendly.

12:45pm – 2:00pm  Db2 12 experiences from the field, recipe for successful migrations, FTB’s & Insert Algorithm 2, Anthony Ciabattoni

Migrating to Db2 12 and exploiting and taking advantage of new features and functions needs to be planned, prepared and executed to maintain availability and achieve organizational success. This session will go through the recipe of a successful Db2 migration, what can be completed prior to the migration window and what steps actual customers have made to achieve a successful migration. In addition, Fast Traversal Blocks and Insert Algorithm 2 are two of the most popular new features in Db2 12. During the session these two features will be described in detail along with the appropriate use cases for both technologies. Lastly, real life customer behavior, experiences and implementation successes will be discussed. If you are an organization that is in the process of migrating to Db2 12 or are planning for a Db2 12 migration before Db2 11 End of Service this is a must attend session.

2:15pm – 3:30pm Delivering a Real-time Experience for Dynamic Digital Businesses, Davendra Paltoo, Replication Offering Manager

Learn how organizations use IBM Data Replication to deliver near real time data across the enterprise from Db2 and most other major databases. IBM Data Replication key capabilities and plans will also be covered.

Thanks to my colleagues, Kim May and Ed Lynch, for a terrific IBM InfoSphere Data Replication (IIDR) new features webinar delivered today.  The recording of the webinar is found here.    These are the presentation materials: Data Replication Update 2019-02-07 – Final

On Monday, October 1, 2018 from 9:00 a.m. to 4:00 p.m. EDT IBM will stream Day 1 of the IBM Gold Consultants briefing “Live from the Lab” from the IBM Toronto software development lab.  This is free and open to everyone.

Topics include:

1. Db2 for LUW v11.1.4.4
2. Db2 Event Store
3. IBM Integrated Analytics System (IIAS) – Db2 Warehouse appliance
4. Db2 on Cloud
5. Db2 Virtualization
6. Db2 Tools
7. Open source DB (MongoDB and PostgreSQL)

Here is the link to register

On July 23 and 24, 2018 The Fillmore Group delivered a hands-on IBM Db2 Analytics Accelerator (IDAA) v7 Workshop to 12 students across 5 different enterprises at the IBM Dublin, Ohio (USA) Technical Education Center.  This was the first IDAA v7 hands-on Workshop delivered to customers anywhere.  Many thanks to Atlee, Bill, Bob, Dom, Emmi, Larry, Marshall, Mohammed, Naga, Ruth, Shawn, and Toby for all of the great questions.  Kudos to the IBM Poughkeepsie Benchmark Center for standing up the IDAA v7 environment in record time with just-released functionality like Incremental Update.  And thanks to IBMers Rich Gast, Mike Hood, Sandro Ramirez (aka “Nicky’s Dad”), Julie Efthymiou, and Rudy Benvenuto for all of their support.

Finally – and most importantly – the Workshop’s flawless execution from scheduling, invitations and outreach to customers, to welcome packets for travelers, to food service, and overall logistics was the direct result of many months of hard work on the part of my colleague, Kim May.  I really appreciate it!

The presentation materials are here:IDAA Workshop 2018-07

Since IDAA v7 is so radically different from it’s predecessors, the Workshop generated lots of questions which will be incorporated into future sessions.  Watch this space.

IBM’s strategy is difficult to understand at first, but often makes eventual sense.  There’s been a great deal of discussion recently about the future of Db2.  Db2 on the mainframe has an established customer base consisting of some of the planet’s largest and busiest organizations.  While many of these organizations are continuously searching for better, faster and/or cheaper technologies, the mainframe continues to deliver and justifies continued Db2 for z/OS investment.

Db2 for LUW, on the other hand, has always been a technical leader, but expensive, and a support challenge.  Never a market leader, Db2 for LUW has suffered in the marketplace from a lack of skilled DBA’s and Developers, and IBM’s inability to deliver affordable and consumable Db2 for LUW training has hampered DIY customer efforts to “build” DB2 support teams.  For many years the snob appeal of great technology that only a few understand seemed the most promising approach.  This, however, does not seem to have driven many customers to Db2 for LUW.

So the IBM teams are taking some interesting new approaches to Db2 for LUW and their distributed data management tools.  The “Flex Pricing” announced earlier this year enables customers to purchase solutions within 3 broad product groups (core databases, data governance and management tools and analytic solutions) and re-purpose the license entitlements within the product groups as their business needs change.  This won’t excite anyone making an initial purchase but may translate into “found money” sometime down the road.  It’s a great idea.

IBM has also been working on new strategies for distributed database support and recently announced a support offering for – drum roll – open source databases.  The one that interested me initially was PostgreSQL, as many Db2 customers use Postgres within their organizations, and it has many similarities with Db2.  IBM sellers are now actively promoting IBM’s Postgres support offering, along with services to support Postgres.  One IBM seller reached out to me recently about a customer considering purchasing Postgres support along with Postgres support services, and through my search for a Postgres Architect, I met a terrific consultant named Joel whose background includes database design, application architecture, hiring a Postgres development team, managing DBA’s, etc., etc., etc.  As a Db2 snob, I was super impressed!  And by the way, he’s available if you are considering your first Postgres application…

The IBM support deal is through the Subscription and Support program.  The annual cost to purchase support for one Virtual Core License (explained in the attached Announcement Letter) is $1000 per year.  What do you get?  According to the announcement,

“While your Software Subscription and Support is in effect, IBM provides you assistance for your routine, short duration installation and usage (how-to) questions, and code-related questions. IBM provides assistance by telephone and, if available, electronic access, only to your information systems (IS) technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your users.) IBM provides Severity 1 assistance 24 hours a day, 7 days a week. For additional details, see the IBM Software Support Handbook. Software Subscription and Support does not include assistance for the design and development of applications, your use of programs in other than their specified operating environment, or failures caused by products for which IBM is not responsible under the applicable agreements. “

If your organization is giving Postgres a look please let me know – I would love to introduce Joel and connect the dots to enable your organization to access IBM Support for Postgres.

PostgreSQL Database Support IBM Announcement Letter