IBM DB2 Analytics Accelerator (#IDAA) Workshop a Success!

Posted by Frank Fillmore on April 14, 2014 under Data Studio, DB2 Education, DB2 for z/OS, IDAA, Optim, Sidecar. Tags: , .

Last week in Baltimore The Fillmore Group conducted a deep-dive technical workshop on IBM DB2 Analytics Accelerator.  We covered Basic and Advanced hands-on labs with the support of the IBM Poughkeepsie Demo Center.  Saghi Amirsoleymani and Mike Hood, both of IBM, presented on the Tools Ecosystem supporting the Accelerator including:

The presentation I gave outlining the topics covered in the Basic and Advanced lab exercises is here: IDAA Workshop 2014-04  Additional presentations will be posted soon.

Demo videos of the Tools include:

Database Magazine and Articles on Accelerating Analytics Queries

http://ibmdatamag.com/2013/12/accelerating-analytics-queries/

http://www.ibm.com/developerworks/data/library/techarticle/dm-1403queryaccel/index.html

Summary of DB2 and Q Replication Performance Tuning Techniques

Posted by Frank Fillmore on March 25, 2014 under DB2 for Linux Unix Windows, Q-Replication, SQL Tuning. Tags: , .

Performance tuning for both DB2 and Q Replication are an ongoing process.  However, there are three tools which provide an initial set of recommendations for bufferpools, Database Manager (DBM or instance) and database configuration parameters, indexes, and other application table objects.

 

DB2 Configuration Advisor

The DB2 Configuration Advisor recommends the initial values of the bufferpool size, database configuration parameters, and database manager configuration parameters.

To use the Configuration Advisor, specify the AUTOCONFIGURE command for an existing database, or specify AUTOCONFIGURE as an option of the CREATE DATABASE command.

Example:

db2 autoconfigure using mem_percent 50 num_stmts 100000 tpm 6000 admin_priority performance num_local_apps 144 num_remote_apps 0 isolation UR apply none

DB2 Design Advisor

The DB2 Design Advisor is used to improve application SQL performance by creating (or dropping) indexes, Materialized Query Tables (MQTs), and MultiDimensional Clustering (MDCs).  The Design Advisor analyzes an SQL workload against existing table structures and recommends changes to improve performance.  The workload can be derived from Dynamic Statement Cache (DSC).  The DB2 Design Advisor command can be invoked by the db2advis command.

A prerequisite is creating the DB2 EXPLAIN tables for the schema conducting the analysis.

cd /<path>/sqllib/misc

db2 –vtf EXPLAIN.DDL

Then run the db2advis command.

db2advis -d mydb -g -a myuser -x -c USERSPACE1 -f -m IMCP -o db2advis_output

 

Q Replication Dashboard Performance Advisor

The Q Replication Performance Advisor helps you identify latency issues with your replication environment and suggests ways to lower end-to-end latency.  The Performance Advisor tab is located within each Monitoring Group.  The Q Replication Dashboard Performance Advisor can recommend updating statistics or reorganizing tables.

IBM zEnterprise Technology Summit – May 6th, Washington, DC

Posted by Kim May on March 21, 2014 under Baltimore Washington DB2 Users Group, DB2 for z/OS, IBM DB2 Services, IDAA, Optim, Q-Replication, TFG Blog. Tags: , , , , , , .

IBM has scheduled a second presentation of the 2014 zEnterprise Technology Summit due to the snowstorm that hit in January when the event ran originally.  If you are in the area and have time to attend, please do!  Information on the event is below; register on the IBM site here.  There are several other events scheduled across the US in 2014 – view them on the IBM site here.

IBM zEnterprise Technology Summit Tuesday, May 6, Washington, DC

New technology is stretching IT budgets in many directions, forcing IT to find better ways of meeting business demands in increasingly complex data centers. Read More…

BLU Acceleration – One Size Fits Most (Well)

Posted by admin on March 17, 2014 under BLU Acceleration, DB2 for Linux Unix Windows, DB2 for z/OS. Tags: , .

DB2-L had some interesting and (always!) entertaining discussion recently about the process of performance tuning for DB2 for LUW vs. DB2 for z/OS.  After a bit of spirited debate Leon Katsnelson posted an analogy explaining the evolution of DB2 BLU.  It’s perfect.  Enjoy it below.

Leon Katsnelson DB2-L Post 3/17/14:

At some point in time, not too long ago the only way to get a well fitting suit was to go to a tailor. Tailor would measure you up and after a few fittings you would get a suit that was, well, tailor made for you. Nobody, and especially not me, would argue that this is the best way to get a great fitting suit. However, most of us could not afford a tailor made suit. But most of us can go to a mall and pick up a great Boss suit for, say $600, off the rack. What the fashion industry has done is deliver high fashion to everyone. Some designers argued that it could not be done as did many custom tailors. Now, high end designers have not disappeared and I get calls and emails from custom tailors who still make the best fitting suits … for a price.

BLU Acceleration for Cloud is high end data warehousing for everyone the same way a $600 Boss suit is a high end suit for everyone. Many have told us it can’t be done. Well, we did it. The cloud allowed us to take the cost of the hardware off the table. It also allowed us to create configurations which just like suit sizes fit most people. BLU Acceleration technology removed indexes, reorgs etc., and does not even give one a choice to disable compression and other features.  It removed the need and in some cases even ability to decide on some aspects of the system. Fewer decisions make it much easier to run. For many, BLU Acceleration is as close to the load-and-go system as you can get. BLU Acceleration for Cloud went even further by integrating BI tools (Cognos BI), pre-engineered schemas and reports (3 Warehouse Packs) and we are working hard on making sure that getting data in to the warehouse is brain dead simple. Can you create a better performing data warehouse by hand tuning DB2? Yes you can. But can you make one available to your end-user to run themselves in less than an hour and for less than $1/hr? That is what BLU Acceleration for Cloud does. We are betting that there are lots of people who could use data warehouse capability if it was easy and affordable. We intend to help these people, regardless of their skill or budget, get value from the IT technologies that for too long have been out of reach. For these people, cloud is the only path and technologies like BLU is the only future.

 

Postcard from IBM #BigData Fundamentals Bootcamp

Posted by Frank Fillmore on February 20, 2014 under Authorized Training Partner, Big Data, BigInsights, Federation, IDAA, InfoSphere, InfoSphere Streams, Netezza. Tags: , .

Over the last 10 years I have become deeply immersed in three major (then) new IBM Information Management software technologies:

  • IBM InfoSphere Data Replication (IIDR – Q Replication)
  • InfoSphere Information Server (legacy DataStage, et al)
  • PureData System for Analytics (nee Netezza) and – it’s sibling for System z – IBM DB2 Analytics Accelerator (IDAA)

If there’s a theme it’s data in motion, data transformation, and deep analytics.  In 2014 The Fillmore Group is focusing on BigData which encompasses all three.  As an IBM authorized Training Sales and Delivery Partner we offer IBM’s BigData curriculum.  As such I am gathering all of the resources I can find to dive into

  1. InfoSphere BigInsights - IBM’s distribution of Hadoop (and a whole lot more)
  2. InfoSphere Streams - Real Time Analytical Processing (RTAP) for data in motion like stock trades and social networking feeds
  3. InfoSphere Data Explorer - federated discovery, navigation, and search in the BigData world

This week I am attending an IBM BigData Fundamentals Bootcamp.  I have four free resources that I would like to share with anyone who wants to try to understand BigData.  Two Redbooks:

In addition, there are two free VMWare images of fully-functional software available for download.  Please note: these images are to be used for education and demonstration purposes only; they cannot be used to support production workloads.

More to follow on my return from the Bootcamp.

IBM Data Analytics Accelerator Class Announced

Posted by admin on February 10, 2014 under DB2 Education, DB2 for z/OS, DB2 Gold Consultants, Frank Fillmore, IDAA, Netezza, TFG Blog. Tags: , , .

DB2 Gold Consultant Frank Fillmore will deliver a 2-day, hands-on training class to introduce experienced DB2 for z/OS DBA’s to the IBM Data Analytics Accelerator (IDAA).  Starting with an overview of the unique hybrid technology behind the IDAA, and covering topics including installation, security, and operational management, the class will deliver an understanding of how the IDAA can quickly integrate into existing zEnterprise infrastructure and rapidly deliver value.

Dates:  April 8 and 9, 2014                                                                            Location:  Radisson Cross Keys, Baltimore, Maryland 21210
Course Outline:  Click HERE
Register: HERE

The course is *free* to all IBM z customers currently running DB2 for z/OS and considering an IDAA.  Customers traveling to Baltimore to attend the class will be responsible for their travel and lodging expenses.

The IBM DB2 Analytics Accelerator for z/OS is a high-performance appliance that integrates IBM Netezza and zEnterprise technologies proven to deliver extremely fast results for complex and data-intensive DB2 queries on data warehousing, business intelligence and analytic workloads.  DB2 Analytics Accelerator for z/OS helps DB2 customers:

  • Query data at high speeds—to significantly improve response times for unpredictable, complex and long-running query workloads.
  • Extend the capabilities of DB2 for z/OS—to support a cost-effective analytics solution for data warehousing, business intelligence and predictive analytics.
  • Lower operating costs—by reducing System z disk requirements and offloading query workloads to a high-performance platform.

If you are interested in the IDAA I hope you will join us!

Changing the Hostname for a DB2 Server – An Update

Posted by Frank Fillmore on February 7, 2014 under DB2 for Linux Unix Windows, DB2 Migrations. Tags: , .

Probably my most popular blog post of all time – certainly the one most commented upon – was called Changing the Hostname for a DB2 Server.  If you work in a shop that uses the same image (i.e. a Windows backup, VMWare image, or some other form of snap-shotting a Windows computer) containing DB2 for LUW for multiple implementations you will have run into a problem.  When changing the ”Computer name” or hostname, the DB2 instance fails to start with an SQL1042C error.

I won’t repeat the entire blog post here – that’s why I included the link above – but I do need to post an update on the location of the important db2nodes.cfg file.  The db2nodes.cfg file now (in DB2 version 9.7) resides in the instance directory.  On a default Windows DB2 installation, that would be x:\ProgramData\IBM\DB2\DB2COPY1\DB2

Please be sure to follow the rest of the instructions on the original post to clear the SQL1042C error.

Big Data Classes at The Fillmore Group

Posted by Kim May on February 6, 2014 under Arrow ECS, Authorized Training Partner, Big Data, BigInsights, DB2 for Linux Unix Windows, DB2 for z/OS, Hadoop, InfoSphere Streams, TFG Blog. Tags: , , , , .

With IBM’s 2014 focus on Big Data solutions I want to highlight The Fillmore Group’s IBM authorized training classes coming this Spring – and invite new BigInsights and Streams customers to join us.  We have students enrolled and expect these sessions to run as scheduled.

All classes may be attended either in our classroom in Towson, Maryland, or remotely via distance learning.

Feb 26 DW652  IBM BigInsights Analytics for Programmers      2 days; $1500

Mar 17 DW723  Program for InfoSphere Streams V3 with SPL   4 days; $3000

Mar 21 DW730  Administration of InfoSphere Streams                 1 day; $750

Apr 2   DW641   BigInsights Analytics for Business Analysts        1 day; $750

If you are interested in learning more click on the course code above for the complete outline of topics to be covered and registration information.  If you have any questions on these classes or other training classes available from The Fillmore Group please contact me here.

One note:  these classes are being delivered through The Fillmore Group’s affiliation with Global Training Provider Arrow ECS; you will need to register for classes on the Arrow website.

Thanks!

Hot-off-the-presses Redbook on DB2 for z/OS High Availability #DB2forz/OS

Posted by Frank Fillmore on January 25, 2014 under DB2 for z/OS, Q-Replication. Tags: , , , .

IBM just published a new Redbook titled Understanding and Using Q Replication for High Availability Solutions on the IBM z/OS Platform.  Two of my fave Silicon Valley Lab replication developer/experts – Cecile Madsen and Jayanti Mahapatra - are co-authors.

Customer expectations in 2014 are that they can conduct business with a variety of financial, retail, and other enterprises 24x7x365.  Even with the availability characteristics of the System z platform in general and DB2 for z/OS in particular, planned and unplanned outages will occur. 

The Redbook focuses on IBM InfoSphere Data Replication (IIDR) Q Replication as the undergirding HA technology.  It details two-node and three-node active-active replication topologies.  I suspect much of the basis for the document is the massive deployment of Q Replication at a large commercial bank in Brazil.