Greetings after a little while.

For those of you who have been working with IBM’s data virtualization technology – as I have – since the beginning (we miss you DataJoiner, Federation Server, et al), there’s yet another new name: Watson Query a service of Cloud Pak for Data (CP4D).

DataJoiner began as a research project (code name: “Garlic”) led by then-IBMer Nelson Mattos. The goal was to provide heterogeneous data access via a Db2 for LUW “gateway”. Enterprises in the 1980s began deploying lots of discrete data repositories (primarily Oracle, Sybase, and MS SQL Server along with Db2) to serve line-of-business and departmental applications (e.g. sales, accounting, finance, manufacturing, logistics). The ability to access data from multiple disparate servers to provide a comprehensive view of business processes was a significant advance. DataJoiner was not limited to RDBMS repositories, but could also retrieve data from MS Access, MS Excel, CSV and Text files… pretty much any data on persistent storage with a definable structure.

For a while DataJoiner also provided increased performance and reduced expense benefits as well. IBM sold DataJoiner as a front-end to Oracle because (at least in some cases) a query using the cost-based Db2 optimizer embedded in DataJoiner produced a better access path than the, at that time, rules-based Oracle optimizer. Expenses were reduced due to the per-seat Oracle license charges; DataJoiner was just “one seat” which could support hundreds of concurrent users. Over time Oracle has modified both their optimizer and licensing model.

For those of you who geek-out on the roots of the technology that we apply to common data administration challenges in our day jobs – as I do – you’ll find a seminal paper on the IEEE website: DataJoiner: a practical approach to multi-database access

So why the history lesson?

• At its roots Watson Query continues to use much of the original federation “plumbing”: Wrappers, Servers, Nicknames, etc.
• Watson Query no longer relies on point-to-point connections to the back-end data repositories, but exploits a “computational mesh” which provides increased performance and resiliency. This approach leverages third-party data repository vendor advances in parallelism, caching, and compression. All of this is of enormous importance when enterprise data is distributed not just across multiple in-house geographically disparate locations, but perhaps across multiple cloud vendors as well.

• BUT (there’s usually a but), due to engineering and design within CP4D some of the capabilities in IBM’s legacy federation stack have not yet been incorporated into Watson Query. Two are of particular interest – which is why I have posted two Ideas (the successor to IBM Request for Enhancement – RFE):
  1. Formerly for data repositories with Indexes that metadata would automatically be captured for a Remote Table in, say, Oracle and propagated back to the Db2 SYSCAT.INDEXES catalog view for use by the Db2 optimizer to help build the best access path for the Remote Table represented by the Nickname. Right now that’s not being done. Hence Idea ASQL-I-16 “Propagation of Indexes for Virtualized Tables to SYSCAT.INDEXES”.
  2. Federated queries have always used Db2’s SQL dialect. There is a PASSTHRU capability that enables users to employ the native SQL dialect of the back-end data repository. For certain queries this can produce significant performance benefits. See Idea ASQL-I-17 “Federated PASSTHRU Capability in Watson Query (WQ)”.

Please review both of these Ideas and vote!

https://ibm-data-and-ai.ideas.ibm.com/ideas/ASQL-I-16

https://ibm-data-and-ai.ideas.ibm.com/ideas/ASQL-I-17

Thanks in advance.

#IBM #WatsonQuery #DataVirtualization #Federation

Having participated in many board meeting debates over the years about the best place to hold meetings of the Baltimore/Washington Db2 Users Group, it’s a bit sad to learn that the 2021 IDUG North America Conference is already being planned as a virtual event, with the possibility of an in-person component.  Let’s hope we can all get together sometime in 2021!

In the meantime, it’s certainly worth noting that with so many people working remotely, many conferences and users groups have actually been quite successful adopting a virtual format.  Some changes resulting from the transition from in-person to virtual events are welcome improvements.  One of these is the more flexible session scheduling IDUG is offering.  I think it’s great, as one-size-fits-all is difficult to accommodate with technical topics.

To the many people I’ve spoken to who have said they have a topic but aren’t sure they have enough (or maybe have too much) material, IDUG 2021 may be a great option as, new this year, IDUG is offering three different presentation timeslots—30, 60, and 120 minutes. You can choose what length works best for you. You can also opt out of the live session and instead pre-record your presentation. To help inspire you, here are some of the most popular session categories:

New Db2 releases: migrating and effective usage
Analytics & Business Intelligence
New technologies: mobile applications, cloud, XaaS, etc.
Application development and data modelling
Db2 and packaged applications (ERP, etc.)
Performance, availability, & security
User experiences and best practices: what did you achieve with Db2?
Db2 and non-standard data types (JSON, etc.)

This is your chance to share your technical expertise and connect with the global community of Db2 users. If you’ve never presented at an IDUG event, this is a great opportunity. First-time speakers are always welcome, as is material geared toward beginner, intermediate, or advanced users.

To submit an abstract, visit IDUG at:  https://www.idug.org/p/cm/ld/fid=2495

I hope to “see” you at IDUG 2021!

I want to thank everyone who helped make the inaugural Mid-Atlantic Db2 for z/OS Users Group virtual meeting such a great success:

• my colleague, Kim May, for pulling the meeting together and for filling a void of timely technical content for this topic and this region
• our presenters for crafting and delivering a comprehensive new way of considering IBM System z
  • Andrew Austin, Red Hat
  • Clark Hale, Red Hat
  • Elton (the Wizard) de Sousa, IBM

The recording of the meeting is here: https://youtu.be/Am279HW1DDY

Individual presentations are as follows:

Db2 VUG – OpenShift Introduction – Austin + Hale

Db2 VUG – OpenShift on IBM z – de Sousa

Db2 VUG – Mainframe Modernization Field Notes – Fillmore

Please share this content with your colleagues.

The proliferation of webinars and events transitioning to virtual meetings is getting hard to keep up with, and maybe some of the event fatigue is a result of an explosion of invitations.  Some events are, however, not to be missed, and one of these is the annual North America International Db2 Users Group (IDUG) conference, scheduled for next week.

Due to the change from an in person to virtual format, IDUG is offering a generous premium membership to everyone who registers for the virtual conference (which is only $199!!) and will allow attendees to view all session recordings and content.

Imagine attending a conference where you can attend ALL sessions, and not spend hours trying to figure out how minimize schedule conflicts and get from one end of the conference center to the other (and get something to drink and hit the restroom) in 10 minutes.  Pretty sweet!

If you haven’t registered yet, consider it.  The session information and keynotes are on the IDUG homepage (www.idug.org), along with the registration link.  Also, if you’ve read this far – I understand IBM still has some remaining vouchers available so customers can attend (as a guest of IBM)…call your IBM rep if you’re interested!

From the webpage:

The event will include 60+ dynamic sessions, live Q&A with industry experts and leaders, opportunities for engagement with your favorite vendors and each other, and most importantly, cutting-edge technical education streaming straight to your home or office. Your registration also includes a complimentary premium membership so you can access exclusive IDUG content all year long.

 

I can’t say I’m too disappointed to be taking a break from conference travel and post conference exhaustion, and it’s refreshing to see the creative changes facilitated by the mass transition to virtual events. Given that the primary goal of these events, whether in person or virtual, is to share technical announcements and updates, it seems either format can be successful.  And of course, each has its pros and cons.

When this is all over, however, I look forward to reconnecting – in person – with friends and colleagues to share technical updates.  Along with dinner and drinks!!

With a virtual “Cheers!” to everyone, here is a list of current and upcoming Db2 events:

1. Going on NOW – Enterprise Data & AI on IBM Z Virtual Symposium, May 19, 20, 21
This complimentary virtual event will explain how to use IBM Z data for modern engagement, analytics and AI applications to become truly insights-driven. Please note: you must register to access copies of all replays.

Register here: http://ibm.biz/BdqvcX

2. July – IDUG Virtual Db2 Tech Conference, July 20, 21, and 23
This three-day event will be followed by three additional weeks of IDUG conference content, making this the perfect way to access the cutting-edge sessions of an IDUG event directly from your home or office.

Conference registration also comes with complimentary, year-long premium membership to IDUG, enabling full access to IDUG exclusive articles, blogs, presentations, and forums.

Cost: $199
Register here: https://www.idug.org/e/in/eid=109

3. August – SHARE Boston, dates TBD
In an effort to continue to provide education, networking and influence, SHARE Boston will now be a virtual event. SHARE is looking to deliver opportunities to learn and network with peers in this new format. Stay tuned to the SHARE website for updates.

More information: https://event.share.org/

4. Db2 LUW Virtual Users Group – July, date TBD
IBM’s Db2 LUW coordinator extraordinaire Kay Groski is working to schedule speakers and topics so the groups she started in 2018 (including the Mid-Atlantic group I attend) can extend their reach by going virtual – at least for a while. As details are confirmed I will share more here.

With 2020 off to a positive start for Db2 12 there are two current events I hope are on your radar.

First, IDUG is supporting an effort to create a new Db2 12 certification, led by IBM Gold Consultant and Champion Dan Luksetich, who also manages the Db2-L listserv.  A survey was created to gather responses to the specific technical issues the community considers important.  If you have time to complete the survey and contribute, it is much appreciated by the IBM community.  Take the survey here.  And of course, if you aren’t already monitoring (or better yet, contributing to!) Db2-L, sign-up.  It’s easy and free – Db2-L.

Second, IBM is offering a week-long Db2 Master Class for advanced Db2 for z/OS system and database administrators clients, led by Distinguished Engineer, John Campbell.  John will be joined by Adrian Burke and Michael Dewert. The US-based session will be held at IBM Silicon Valley Laboratory (SVL), Monday, September 28 (8 am) to Friday, October 2, 2020 (2:30 pm), in San Jose, California.  The complete outline is attached.

Participants will meet the Db2 for z/OS development team – visit the incredible people whose work is known worldwide!

If you are interested in attending this class, fill in and submit the application form.  Class is a client-only course, participation is BY INVITATION only, and seating is very limited.  Applications will be reviewed and acceptance notices will be emailed.  Apply HERE.

A registration link with payment instructions will be included in the invitation. If you have any questions, please contact Dorothy Lin (dclin@us.ibm.com)

There are pre-requisites, and attendees must have at least 1 of the following certifications (or the equivalent experience level):
– IBM Certified System Administrator – Db2 for z/OS
– IBM Certified Database Administrator – Db2 for z/OS

Cost
$2,500 USD per client participant
Client participants are responsible for their own travel, lodging, and meal expenses
A registration link with payment instructions will be included in the invitation.

Db2 for z 2020 Master Class Summary and Outline

This month the International Db2 Users Group (IDUG) hosted their annual European conference in Rotterdam, and this week IBM is hosting the Data and AI Forum in Miami.  With so many conference options it can be difficult to decide where to invest your organization’s conference funding – if you are lucky enough to have it available.

One way to reduce attendance cost is to be a speaker, as conference presenters typically receive a free conference pass.  You are still responsible for your travel expenses, but the overall cost will be greatly reduced.  And of course end user conference presentations are always welcome and appreciated.

One way to decide between IDUG North America (Dallas) and Think (San Francisco), is to submit presentation abstracts to both and see if you are selected.  But hurry!  The call for speakers is open for both; details are below.

Think 2020, San Francisco, May 4 – 7.  Registration cost $1995-$2495.  Call for speakers deadline November 12, 2019.

IDUG North America, Dallas, June 8 – 11.  Registration cost $1865 – $2295.  Call for speakers deadline November 12, 2019.

Coincidence???

Details on submitting presentation abstracts for IDUG are here.  Details on submitting abstracts for Think are in the attachment below.

Good luck!!

Think 2020 Speaker Guidelines

The Time is NOW!
Upgrade to Db2 12 for z/OS!

Date:           Wednesday, October 9, 2019
Time:          11:00am EDT
Register:     HERE

You are invited to join a live webcast hosted by IBM Gold Consultants to learn why this is the right time to upgrade to Db2 12.

Gold Consultants are an independent voice, delivering Db2 consulting and support to  customers worldwide. Learn more about the Golds and how they can help your organization by visiting the IBM Gold Consultant webpage.

During this webcast expert Golds will discuss:

• The benefits of upgrading to Db2 12
• Continuous availability and potential cost savings
• In-memory Features
• Pre-planning tasks and their importance
• Costs and risks associated with failing to migrate by September 30, 2020

The session will close with a live Q&A session with several of the Golds who contributed recommendations and content to the presentation.

The session was developed and will be delivered by the following IBM Gold Consultants.  Bio’s for each presenter are below.

Julian Stuhler
Triton Consulting

Julian has over 30 years of Db2 experience in application programming, database administration, technical architecture, performance tuning and systems programming, working within the insurance, telecommunications, banking, financial services and manufacturing sectors. He is an IBM Redbook and White Paper author and IDUG Best Speaker, and has lectured widely on DB2 subjects in the UK, Europe and US. In 1999 Julian was invited to join the IBM Gold Consultants program, and in May 2008, Julian was recognized as one of IBM’s inaugural Data Champions. Julian served on the IDUG Board of directors from 2003 to 2010, and is an IDUG Past President.

Frank Fillmore, Jr.
The Fillmore Group, Inc.

Frank is the Founder and President of The Fillmore Group, Inc., a Premier IBM Business Partner.  Frank is an IBM Gold Consultant and IBM Champion for both Analytics and System z.  The Fillmore Group’s areas of expertise include data interoperability, replication and high availability, InfoSphere, Db2 Server for VSE&VM, competitive migrations and technical Project Management. Frank oversees a staff of talented employees and contractors, and manages projects ranging from new database implementations to health checks.  In addition to consulting Frank and his team deliver IBM Authorized Training and are IBM software resellers.

Isaac Yassin
DBX-Consulting

Isaac is an IBM Gold Consultant and Champion with over 40 years of experience consulting on IT and security at cross-industry customers covering areas of global system tuning including Sysplex and Parallel Sysplex, Security (RACF, Top-Secret, Guardium) and large-scale projects involving Data Warehouse / Big Data and Machine Learning as well as data analysis in heterogeneous environments.

Isaac has vast knowledge in DB2 (both Z & LUW), IMS and other major DBMSs and has installed and migrated every release of Db2 starting with V1.2 and up to V12, including “skip & jump” migrations and worked on a variety of migrations to and from other vendor databases.  Isaac’s Db2 technical work includes wide-scale problem analysis, performance, troubleshooting, education/training, security problems and audits and BCP/DRP scenarios.  Isaac is an active IDUG contributor and frequent presenter.

Gerald Hodge
HLS Technologies

Gerry began working with Db2 V2 in 1985 while a First Vice President at Security Pacific National Bank. While there he headed the Capacity Planning and Performance Planning for 11 of the bank’s data centers. In 1990 he moved to BMC Software’s International Sales as their SME for their Db2 products, and was the primary on sight support for sales and Db2 Products in both Europe and Asia.

In 1995 Mr. Hodge started HLS Technologies, Inc. His company developed the following DB2 products: Avoid Bind, DBRM Check, Path Check, and Express Hints. He was invited to join IBM’s Gold Consultants the year the program was formed. He has been an active member every year since.  HLS Technologies has provided detailed planning and support for Db2 migrations since V5 and is currently supporting a large V12 migration project.

Dan Luksetich
DanL Database Consulting

Dan is a Db2 DBA consultant, an IBM Gold Consultant and IBM Analytics Champion. He works as a DBA, application architect, presenter, author, and teacher. Dan has been in IT for over 34 years, and has worked with Db2 for over 29 years. He has been an application programmer, Db2 system programmer, Db2 DBA, and DB2 application architect. His experience includes major implementations on z/OS, AIX, i Series, Windows, and Linux environments. His industry experience includes retail, banking, fraud detection, analytics, government, and utility. He specializes in highly available, high-volume transaction processing against very large database systems.

Dan’s experience includes, but is not limited to:

· Application design and architecture
· Business analytics
· SQL consulting and education
· SQL coding and application programming
· Database administration
· Complex SQL
· SQL tuning
· DB2 performance audits
· Replication
· Disaster recovery
· Stored procedures, user-defined functions, and triggers

The buildup and push for the Think Conference was manic. The “EXCITEMENT!!” seemed to come from a small group of IBM marketing folks and the focus on attendance numbers (tough to confirm or deny) was odd.

Customers and Business Partners focused on the data management component of the Analytics portfolio, and with a limited budget to attend conferences, seem to have shifted from the IOD/Insight/Think Conference to the International Db2 Users Group (IDUG) conferences. IDUG North America is held in the Spring, this year in Charlotte, South Carolina, from June 2 – 6. The conference focus is education for IBM database technologies solutions.  Artificial Intelligence and Machine Learning aren’t the dominating topics, and session selections and content are managed by IDUG volunteers.  IDUG NA 2019 costs $2165 to attend, with a $300 early bird discount available until April 22nd.

Having IDUG to counterbalance Think makes sense to me.  Also, the IDUG community is very user friendly.  There are several discount options to make attendance affordable, and as has been the case at most technical conferences, presenters receive a free pass.

Now – the wild card.  IBM, through their marketing collaboration with IDG, has scheduled another conference, this one called IBM Data and AI Forum, for Miami, Florida, from October 21 – 24.   This event is the former IBM Analytics University, which I believe evolved from the Db2 Technical Conference.

It seems to be IBM’s attempt to cross pollinate Db2 users with AI, not necessarily a logical partnership in my opinion, as the potential benefits of AI and Machine Learning seem to be in the conceptual sales stage, being pitched to senior management, while the technical teams running data centers aren’t setting the analytics vision.  The conference pass cost is far lower than IDUG or Think, at $1295 for a full price pass and $1095 with the early bird discount through July 31.

The call for speakers is open and I understand selected speakers will be compensated for presenting.

It will be interesting to see how the community responds to all these conference offerings.  Hmmm…

The Baltimore/Washington Db2 Users Group will be holding our annual education session on Wednesday, March 20, 2019, at the BWI Hilton.  Please note the date is the third Wednesday in March, not the second, when meetings are typically held, as several members will be attending SHARE.

As a very special 2019 offer, the group will have two session tracks and two terrific presenters.  You are invited to sign up for one of the two tracks.  The cost per attendee is $100 and includes session materials and a sit down lunch with the entire group. 

Date: Wednesday, March 20, 2019

Time: 9:00am – 4:00pm (Registration and continental breakfast at 8:30am)

Location: BWI Hilton, 1739 W Nursery Rd, Linthicum Heights, MD 21090

Register: HERE

For DBA’s IBM’s Robert Catterall will present, and for developers, Tony Andrews from Themis.  Abstracts for their day-long sessions are below.  

Track 1:

Db2 Database Administration Db2 for z/OS DBA’s: News You Can Use This day-long session for DBAs delivers updates on four topics pertinent to database administration. Each unique segment will provide up-to-date information on:

1. Leveraging large z/OS LPAR memory resources for improved Db2 application performance.
2. Key metrics for Db2 subsystem and application performance monitoring and tuning.
3. DDF application architecture and workload management.
4. Modern Db2 for z/OS physical database design.

Presenter: Robert Catterall

Robert Catterall is an IBM Senior Consulting Db2 for z/OS specialist. He started his IT career with IBM in 1982, and worked throughout the 1990s as a member of the Company’s Db2 for z/OS National Technical Support team. From 2000 to 2007, Robert worked as a database technology strategist for CheckFree (now part of Fiserv). After working for three years as an independent Db2 consultant, he rejoined IBM in 2010.

Robert is a past President of the International Db2 Users Group (IDUG), and a member of IDUG’s Speakers Hall of Fame. He presents frequently at conferences and user group meetings, and blogs about Db2 for z/OS at http://robertsdb2blog.blogspot.com/.

Track 2:

Db2 Developers New Application Features for Db2 12

Are you still coding and designing SQL from the 90’s? The last several releases of Db2 have brought quality new features that can be used to improve both functionality and performance for today’s complex applications. This event will help catch you up!

Morning Segment: • Global Variables: Creation, Usage, Rules, V12 Enhancements • Transparent Archiving: Automatic Archiving of Data, Data Retrieval Options, Global Variables for Archiving • Sequence Objects: Creation, Usage, Sequence vs Identity • Advanced Groupings: Group By / Having Review , Grouping Sets, Rollup, Cube • OLAP Ranking Functions Upgrades: o Rank, Dense_Rank, Row_Number Review o Ranking Moving Sums and Avgs o Rows Between o Range Between o Partition By • SQL Set Operations: Union/Union All Review, Intersect/Intersect All, Except/Except All, Union Select Into

Afternoon Session: • SQL Merge: Overview, V12 Enhancements • SQL : Select From Update, Select From Insert • SQL Piece-Wise Delete: V12 Enhancement • SQL Pagination: V12 enhancement • SQL QUERYNO: Review • SQL Procedural Language: Piece Wise Delete, Autonomous Processing, SQL PL support for Triggers • Performance Enhancements: o New Stage 1 Predicates o V10, V11 New Performance Review o V12 Performance Enhancements o Sparse Indexing o V12 Runtime Adaptive Indexing o V12 Fast Traverse Indexing

Presenter: Tony Andrews

Tony Andrews has more than 25 years’ experience in the development of relational database applications. Most of this time, he has provided development and consulting services to Fortune 500 companies and government agencies. Tony has written literally thousands of queries and programs during his development years, and has also served as a database analyst. For the last 10 years, Tony has been splitting his time between performance and tuning consulting engagements along with training. His main focus is to teach today’s developers the ways of RDBMS application design, development and SQL programming — always with a special emphasis on improving performance.

He is a current IBM Champion, and regular speaker at many regional user groups, IDUG NA, and IDUG EMEA. He is also the author of a book for developers titled ‘DB2 SQL Tuning Tips for z/OS Developers’. *the Baltimore/Washington Db2 Users Group is a non-profit organization funding a portion of this meeting. If registration levels exceed our funds the per attendee cost will need to be raised to offset expenses.