Posted by Frank Fillmore on September 21, 2023 under Big Data, BigInsights, DB2 for Linux Unix Windows, DB2 for z/OS, Hadoop, IBM Think Conference. Tags: Db2 Warehouse, Lakehouse, watsonx.data.
IBM hosted the inaugural TechXchange Conference in Las Vegas last week (September 11 – 15, 2023). Here’s what I liked:
- The Developer community was the primary focus of TechXchange. This is a significant change from the pre-pandemic IBM technical conferences – Think and World of Watson (sited variously in Las Vegas and San Francisco). Two of the TechXchange keynote presenters pointed out that there were no “suits” at the conference (in reference to both people and apparel).
- Artificial Intelligence (AI) was (not surprisingly) given a shout-out in almost every keynote, but I thought the most prescient comment was that in three years Quantum Computing will be where AI is today.
Lakehouse
- Since I’m a career database administrator (DBA) I am really jazzed about IBM’s Lakehouse approach to data. For decades IBM was primarily focused on IMS (hierarchical) for large-scale online transaction processing (OLTP) and Db2 (relational) for analytical workloads (and, eventually, OLTP too).
- IBM made a brief foray into Data Lake (vast amounts of unstructured or semi-structured data with varying standards of curation) with its BigInsights Hadoop distribution.
- But Lakehouse is the combination of traditional shared-nothing MPP IBM Db2 Warehouse (relatively structured with higher levels of curation, consistency, and veracity) and watsonx.data an open source stack of data repositories: Lake + House.
Key characteristics of Lakehouse:
- Let the data decide where it should reside. Based on data attributes such as volume, structure, quality, timeliness, etc. choose the data repository that best addresses those attributes. You no longer have to force data into a repository where it’s not best-suited.
- Seamlessly access data regardless of how and where it’s stored.
- Data Scientists can easily combine customer account data, transaction history, and sentiment analysis.
- An Auto Repair Technician can pull up vehicle history by Make/Model/Trim/Year, geography, mileage, and so forth on a tablet in a garage bay while the car is on the lift.
- Ever increasing data storage costs have your CFO in a frenzy? Performant Object Storage will likely meet your response-time targets for most applications – at about 3% of the cost of Block Storage. Automated multi-temperature storage enables you to transition data to the storage platform most suited to its age, likelihood of being retrieved, and other factors.
- On-prem, in the cloud, or SaaS? You decide where – and by whom – the infrastructure underpinning your OLTP and analytics workloads are provisioned.
- Containerization enables scaling that infrastructure as required by both cyclical and black-swan events.
A much more detailed dive into Db2 Warehouse Gen 3 and watsonx.data will be in an upcoming blog post.
Posted by Frank Fillmore on April 8, 2016 under Big Data, BLU Acceleration, DB2 Connect, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Federation, Frank Fillmore, Hadoop, HTAP, IBM Champion, IBM DB2 Services, IBM Information Management Software Sales, IBM Mid Market Customers, IBM Pure Systems, IDAA, InfoSphere, Mako, Netezza, Optim, pureScale, Q-Replication, TFG Blog.
Frank and I attended an IBM Business Partner event in Philadelphia earlier this week where we met with several IBM’ers supporting Business Partner initiatives in 2016. Each of the specialists presented their “best of” solutions to the partners in attendance, and then patiently answered our many questions (mostly mine – sorry team!)
The final preparations for our Woodberry Kitchen lunch event are underway: Frank and I are polishing the presentation, IBM’s Andrew Levine and Warren Heising are tracking down answers to my Cloud deployment “what if?” questions, Megan is gathering gold coins for attendees who ask Frank good technical questions, and Jolanta at Woodberry Kitchen has me salivating with her menu recommendations.
If you will be in Baltimore April 21st and haven’t registered yet, please do! Register HERE.
Posted by Frank Fillmore on July 14, 2015 under Big Data, BigInsights, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, Hadoop, IBM Champion, IDAA, Insight 2015, Mako, Netezza, TFG Blog. Tags: BigData, Data Champion, DB2 for z/OS, HTAP, IDAA, Netezza.
Congratulations to Frank on the selection of his 2015 Insight Conference presentation! Frank’s presentation (session #3584 for those of you already working on your schedules) is titled, “DB2 ^ (Netezza | BLU) = Hybrid Transaction and Analytics Processing (HTAP)”.
As soon as the Insight schedule is released I will update this post with the session date and time. Stay tuned!
In his session Frank will describe and compare the four distinct data retrieval technologies available from IBM, including two Hybrid Transaction and Analytics Processing (HTAP) platforms. Choices are good to have, but how do you choose which technology to apply to a particular business use case? Learn how these techniques differ, including their relative strengths and weaknesses.
– The traditional RDBMS, relying primarily on indexes to speed access
– The new BLU Acceleration columnar compression and memory-optimized database
– IBM PureData System for Analytics (Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse data
– IBM InfoSphere BigInsights, the IBM distribution of Hadoop
Bio
DB2 Gold Consultant and IBM Champion Frank C. Fillmore, Jr. is the Founder and President of The Fillmore Group, Inc., a Premier IBM Business Partner that specializes in IBM Analytics software sales, consulting, and training. Frank has been providing IBM Information Management solutions to government, industry, and not-for-profit enterprises as varied as The World Bank, J.P. Morgan Chase, Northrop Grumman, and the FBI for over 28 years. Frank’s current practice centers on Hybrid Transaction and Analytic Processing (HTAP) and Oracle to DB2 migrations as well as information governance and integration. Frank kayaks and cheers for the Baltimore Orioles.
Posted by Frank Fillmore on May 20, 2015 under Authorized Training Partner, Big Data, BigInsights, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, Hadoop, IBM DB2 Services, IDAA, Netezza, TFG Blog.
I am excited to invite IBM data management users to join DB2 Gold Consultant Frank C. Fillmore for a series of three webinars covering the latest IBM database strategies. Each session highlights a topic critical to IBM data management customers’ knowledge of the many, sometimes competing, often confusing, options available from IBM.
The content will help data architects better understand the latest solutions available to support analytic and OLTP workloads, as well as IBM’s data strategy direction and where today’s solutions – relational databases, Netezza and Hadoop – are best applied.
Attend one webinar or join us for all three. Each one hour session will provide a wealth of clear, useful information. Click on the links below to register.
#1 IBM DB2 Analytics Accelerator v4 PTF 5 Enhancements
Tuesday, June 9, 2015, 1pm-2pm EDT Register here: https://attendee.gotowebinar.com/register/5384878354738776577
Frank will present an update on the latest IBM DB2 Analytic Accelerator (IDAA) PTF released in April, 2015. This PTF delivers new functionality to extend IDAA utilization for DB2 for z/OS users including:
– Improved Incremental Update reliability and performance
– Accelerated dynamic query statement caching
– Additional scalar function support
– In-database transformation with Accelerator Only Tables
#2 IBM Hybrid Transaction/Analytic Processing (HTAP)
Tuesday, June 20, 2015, 1pm-2pm EDT Register here: https://attendee.gotowebinar.com/register/5118968064636087810
Learn how customers are using HTAP to eliminate analytic latency and data synchronization issues to transform and simplify information management infrastructure. For years IT customers have been told that online transaction processing (OLTP) and analytics couldn’t co-exist on the same platform. This led to costly and complex regimes to move OLTP data to a different platform for analytics. With HTAP, the barriers to near real-time analytics are removed amid significant reductions in IT expenses and complexity risk.
The concept of Hybrid Transaction/Analytic Processing was coined by Gartner. IBM implements HTAP in two ways:
– IBM DB2 Analytics Accelerator (IDAA) for DB2 for z/OS data (using Netezza hardware)
– DB2 BLU Acceleration – DB2 for Linux, Unix, Windows (a software-only implementation)
#3 IBM Data Retrieval Technologies: RDBMS, BLU, Netezza and Hadoop
Tuesday, July 21, 2015, 1pm-2pm EDT, Registration here: https://attendee.gotowebinar.com/register/1762449336105853441
In this session Frank will describe and compare the four distinct data retrieval technologies available from IBM. Choices are good to have, but how do you choose which technology to apply to a particular business use case? Learn how these techniques differ, including their relative strengths and weaknesses.
– The traditional RDBMS, relying primarily on indexes to speed access
– The new BLU Acceleration columnar compression and memory-optimized database
– IBM PureData System for Analytics (Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse data
– IBM InfoSphere BigInsights, the IBM distribution of Hadoop
Registration for each webinar is required. To register, click on the session registration links above. I hope you will join us!
Posted by Frank Fillmore on May 14, 2015 under Arrow ECS, Authorized Training Partner, Big Data, BigInsights, BLU Acceleration, Data Studio, DB2 Connect, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, Global Skills Initiative, Hadoop, InfoSphere, Optim, pureScale, Q-Replication, TFG Blog.
The Fillmore Group 2H 2015 Class Schedule
With all the challenges IBM’s move to the Global Skills Initiative (aka outsourcing education) has created for DB2 users, please remember IBM classes do still exist and are available for the patient and persistent. Fear not! If you need training, we are prepared to help.
After seeing public training nosedive over the past two years we are now seeing a bit of a resurgence. Are classes really running? Well, in all honesty, not often. However, we are seeing a few run here and there, and when they don’t, with our relationship with Arrow ECS (one of the five Global Training Partners) intact, we are learning to “collect” students interested in training, and either gather them together for classes, or provide private training at affordable rates.
I’ve just submitted our second half of 2015 public training class schedule to Arrow (see the attachment above) and expect to see the classes posted on the IBM training site (IBM.com/training) within the next couple weeks. I welcome anyone looking for a class – whether it’s on my schedule or not – to contact me at kim.may@thefillmoregroup.com so that I can work some coordination magic for you.
Posted by Frank Fillmore on December 15, 2014 under Arrow ECS, Authorized Training Partner, Big Data, BigInsights, Data Studio, DB2 Connect, DB2 Education, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Global Skills Initiative, Hadoop, IBM Training Services Delivery Partner, InfoSphere, Optim, Q-Replication, TFG Blog.
We are looking forward to continuing our relationship with IBM Global Training Partner Arrow ECS is 2015. Our schedule is up on the IBM training website, with the specific Arrow/The Fillmore Group classes listed and available for registration at: https://ecsedu.arrow.com/ibm/us/index.html.
If you plan on taking a class early next year, I hope you will consider attending one of our classes, delivered in Towson, Maryland, just north of Baltimore. We have great instructors, a comfortable classroom, and Baltimore offers some the best seafood in the world.
The complete list of classes is here. I hope to see you in 2015!
Posted by Frank Fillmore on November 18, 2014 under BigInsights, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, Hadoop, IDAA, International DB2 Users Group (IDUG), Netezza. Tags: BigInsights, BLU Acceleration, Hadoop, IBM PureData System for Analytics, Netezza.
The trip to Prague, CZ last week for the International DB2 Users Group meeting was fabulous. The city certainly has changed since I’ve been there – all for the better. It seems more cosmopolitan, the people seem younger, more vibrant than I remember from 2004. And the dining and music – Kim and I attended jazz and classical music concerts and enjoyed Madame Butterfly at the Prague State Opera – were amazing CutterWelderMaestro.
Here’s my pitch on “IBM Data Retrieval Technologies” if you weren’t able to attend. IDUG EMEA 2014 E7 – IBM Data Retrieval Technologies – RDBMS BLU IBM Netezza and Hadoop
Next year IDUG EMEA will be in Dublin. Hope you can join us for a Guinness by the River Liffey.
Posted by Frank Fillmore on November 11, 2014 under Big Data, BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, Hadoop, IBM Champion, IBM Pure Systems, International DB2 Users Group (IDUG), Netezza.
Frank is doing his final preparation for today’s presentation at IDUG Europe – if you are lucky enough to be in beautiful Prague at the conference I hope you will stop by!
Session E7 on Tuesday, November 11 from 3:15 to 4:15 p.m.
Abstract: IBM offers four distinct data retrieval technologies: the traditional RDBMS, which primarily relies on indexes to speed access; the new BLU Acceleration columnar compression database; IBM PureData System for Analytics (IBM Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse the data; and IBM InfoSphere BigInsights, which is the IBM distribution of Hadoop. Choices are good to have, but how do you choose which technology to apply to a particular business use case? In this session, you learn how these techniques differ, including their relative strengths and weaknesses, to help you make an informed choice.
Posted by Frank Fillmore on July 14, 2014 under Big Data, BigInsights, BLU Acceleration, DB2 Education, DB2 for Linux Unix Windows, Hadoop, IDAA, Netezza. Tags: BLU Acceleration, DB2, Hadoop, InfoSphere BigInsights, Netezza, PureData System for Analytics.
From November 9 – 14 I will be visiting one of the most charming cities on the planet when I attend the International DB2 Users Group (IDUG) conference in Prague, CZ. I will present “IBM Data Retrieval Technologies : RDBMS, BLU, IBM Netezza and Hadoop”. It will be session E7 on Tuesday, November 11 from 3:15 to 4:15 p.m. Please consider attending IDUG Europe and joining me at this session.
Abstract: IBM offers four distinct data retrieval technologies: the traditional RDBMS, which primarily relies on indexes to speed access; the new BLU Acceleration columnar compression database; IBM PureData System for Analytics (IBM Netezza), which deploys racks of Field Programmable Gate Array (FPGA) processors to parse the data; and IBM InfoSphere BigInsights, which is the IBM distribution of Hadoop. Choices are good to have, but how do you choose which technology to apply to a particular business use case? In this session, you learn how these techniques differ, including their relative strengths and weaknesses, to help you make an informed choice.
Posted by Frank Fillmore on May 30, 2014 under Authorized Training Partner, Big Data, Data Studio, DB2 Connect, DB2 Education, DB2 for i, DB2 for Linux Unix Windows, DB2 for VSE&VM, DB2 for z/OS, DB2 Gold Consultants, DB2 Migrations, Federation, Frank Fillmore, Hadoop, IBM Champion, IBM DB2 Services, IBM Pure Systems, IDAA, InfoSphere, InfoSphere Streams, MQT's, Netezza, Optim, Oracle, pureScale, Q-Replication, SQL Tuning, TFG Blog. Tags: AESE, BigData, BigInsights, Change Data Capture, Data Studio, DB2, DB2 Connect, DB2 Consulting, DB2 Education, DB2 for z/OS, High Availability, IIDR, InfoSphere, Netezza, Optim, Oracle to DB2 Migration, Q Replication, Query Capture Replay.
I was on a call this morning with an IBM technical team to discuss our progress filling the seats in one of our upcoming free IDAA classes. Not surprising, given the number of people on the call (and who they were!) we went a bit off topic and ended up chatting about services and what appears to be – to IBM customers and sellers at least – a shortage of skilled consultants available to help with the “tions” – replication, implementations, migrations and federation.
The Fillmore Group has skilled consultants available to support these efforts, at rates that are typically about half of those being charged by “the competition”.
If your team has a project pending, or one in process, where a skilled consultant, at a reasonable hourly rate, can get things back on track, please contact me. We are ready to work! A list of our IBM Information Management capabilities is attached here.