Now that we’ve discussed various common metadata strategies used in creating BimlScript, I’m going to explain exactly how the metadata in my sample BimlScript framework functions. Basically, I’m going to start to pull back the curtain and explain some of the “magic” involved in my Biml – The Next Step in Agile Data Warehousing presentation.
What are the best methods for generating Biml and what language should you use? Before I dive into this, let me begin with a disclaimer. I applaud anyone working with Biml to improve their productivity and eliminate needless, repetitive work. One of the primary advantages of Biml is its flexibility, which allows people to generate [...]
Simply put, metadata is data about data. Probably the most common way that SQL Server Professionals use metadata is when we query SQL Server System Views. In this article we’ll discuss using metadata to drive BimlScript automation. Before I start listing common metadata sources and methods, I need to briefly contrast two basic metadata philosophies [...]
Agile development is good, Waterfall is bad. We hear this all the time, along with un-documented statistics claiming that approximately 80% of Data Warehouse projects fail. So, we as Business Intelligence Professionals are told that we must be Agile. Whenever I taught Dimensional Modeling and Data Warehouse classes, I could count on at least one [...]
The Matrix is one of my favorite movies. The story, special affects, and the theme are so compelling that I’ve watched the movie at least a dozen times. I referenced it in the introduction for my SQL Saturday 255 presentation, Biml – The Next Step in Agile Data Warehousing, and it fits in perfectly with [...]
I’ll admit it, I’m a cheater. Now, before you click away in disgust, give me a minute to explain. Almost 15 years ago, when I felt stuck in my career as “The Made2Manage Guy,” I’d routinely run out of things to do. I mean, once you’ve learned all the pitfalls and gained a mastery of [...]
A “Hello World” program is an ages old traditional way to teach the basics of syntax for a programming language to a beginner. Since so many of us are just starting to use Biml Script, I thought it would be fun to start out with it. Also, I’ve made the entire solution available for download.
If T-SQL Merge can only handle one changed record at a time, how can we use it for our initial/historical load? Further, how can we use Merge in those situations where the incremental load may produce more than 1 changed record per entity? Well, I’m glad you asked.
Welcome to the next article in the [...]
This past weekend I made the trek to Oklahoma City to participate in their latest SQL Saturday. It was the first time I had spoken there, but it didn’t feel that way. Kristin Ferrier (Blog/Twitter), Jeremy Marx (Blog/Twitter), Matt Brimer (Twitter), Allen Smith (Blog/Twitter), and the rest of the team were so welcoming, just what [...]
Just because you can extract every single historical record for a dimension doesn’t mean you should. In this article, we’ll cover three basic extraction “methods” and when each of them may be preferred.
As with many of my Urge to Merge Series articles, this one will be presented in layers. In this case, each layer is [...]