Posts

Log Based CDC Now Available for Noetix Analytics 5.4

Support for log based CDC to capture Data Manipulation Language (DML) changes from Oracle E-Business Suite is now available for Noetix Analytics 5.4. This method eliminates ETL overhead and CDC DML triggers on source application. Read more

Executive Q & A with Magnitude Software Vice President of IT, David Haam

During the padavidhaamst year, David Haam steered Magnitude Software’s IT team through a challenging corporate merger and he is now gearing up for the rapid corporate growth expected in 2015. Read more

The Agile BI Ship Has Sailed – are you on a Tanker or a Jet Boat?

I recently took a very touristy outing in Boston when we went on the “Codzilla” boat ride in Boston Harbor. On a hot day, it is great. The boat goes out of the harbor, gains speed, and then tries to get everyone wet by turning sharply and quickly, stopping short and diving forward, and generally stirring up the water until it is falling over the decks and spraying the crowd. On the day we went there was at least one tanker moored in the distance – quite the opposite of the fast and agile boat we were on. Read more

What’s The Real Burden in ETL?

Readers of our corporate blog and followers of the Kalido message know we have been promoting “No ETL” in the context of data warehousing. Inevitably this leads to ETL tool vendor outrage at the notion that you don’t need ETL. So let me be clear: we believe you will always need the concept of Extract, Transform and Load. However, most ETL tools do not automate many data integration concepts – they just provide a mechanism for a human to create that manually. Our approach is to keep the concept of ETL – extract data from multiple sources, transform it and then load that data into the data warehouse tables – but to automate this process. With Kalido, you don’t always need a separate ETL tool to do it. Read more

Estimating Velocity

Velocity is perhaps the most important concept in agile development. In his recent Agile 101 class at the TDWI BI Summit in San Diego, Ralph Hughes defined velocity as “The number of story points that can be delivered comfortably in an iteration.” That estimate effects many other estimates, such as the size and mix of your teams, as well as the number of iterations needed to deliver the full project scope—all of which impact the budget. Read more

Executive Q & A with Michael Huffines, Noetix General Manager, Sales Central and West

From what you’ve seen in the field, why do data warehouse projects fail?

For the past 16 years I’ve been involved in the data warehousing / business intelligence industry.  I’ve seen an amazing amount of progress and yet, nearly every day I meet with a potential customer that has fallen victim to one or more of the major pitfalls inherent to data warehouse initiatives.  Here are some tips to avoid common mistakes. Read more

Building an Agile Data Warehouse – Part 2

building-an-agile-dw-pt2-300x256

If you accept the concepts of Agile Data Warehousing you quickly will discover that the traditional toolset (modeling tools, ETL tools, etc.) bring little to the table to advance an agile methodology.  As we saw in part one, acquiring a pre-built model can help focus some of the requirements gathering, but it does little to enable the implementation of an agile methodology.  Read more

Building an Agile Data Warehouse – Part 1

Data warehouses are hard to build.  The goal, of course, of any data warehouse is to house all the data required to provide the business with the answers needed to run the business effectively.  The problem is that the questions keep changing and evolving.  Read more

Survey Results on ETL-Based Data Warehouses

During 2012 we have been surveying TDWI World Conference attendees about their data warehousing investments. We wanted to know their thoughts and experiences on a variety of topics, ranging from whether they felt like IT and “the business” are on the same page in terms of keeping the warehouse up to date with the latest requirements, how long it takes to keep the warehouse current, and how many resources they expended on supporting their environment. We’ve received a little over 400 responses from events in Las Vegas, Chicago, San Diego and Boston. Read more

Is Your Data Warehouse Fragile or Agile?

In his most recent blog, Ralph Hughes makes the point that business managers have grown accustomed to seeing data warehousing professionals “disappear after gathering requirements, only to return 10 or more months later with applications that don’t meet the needs or are out of date because the business has changed while we were off coding.” Read more