improve.dk
Just another mindless drone looking for the perfect stack
posts - 227, comments - 489

Presenting a precon at SQLBits

Written on June 30, 2011 by Mark S. Rasmussen in Conferences, SQL Server: SQLBits, Presenting

I’m honored to announce that I’ll be presenting my SQL Server Storage Engine and MDF File Internals precon at SQLBits on September 29th. It’s an amazing bunch of precon sessions and presenters, I didn’t think I’d be speaking at SQLBits, much less presenting a precon – given the lineup of speakers.

SQLBits

So what will I be presenting?

Let me start out with the official abstract:

Join me for a journey into the depths of the SQL Server storage engine. Through a series of lectures and demonstrations we'll look at the internals of pages, data types, indexes, heaps, extent & page allocation, allocation units, system views, base tables and nightmarish ways of data recovery. We'll look at several storage structures that are either completely undocumented or very scarcely so.  By the end of the day, not only will you know about the most important data structures in SQL Server, you'll also be able to parse every bit of a SQL Server data file yourself, using just a hex editor! There will be lots of hands on demos, a few of them performed in C# to demonstrate the parsing of data files outside of SQL Server.

It all stems from some experimental coding I did back in March, trying to parse SQL Server data pages using C#. What started out as a learning experiment resulted in me presenting on the Anatomy of an MDF File at the Miracle Open World 2011 conference in April. Since then I’ve continued my experiment and officially christened it OrcaMDF while opening up the source.

During my research for OrcaMDF I’ve reverse engineered data structures, matched up various undocumented base tables and generally achieved a really great understanding of the storage engine and MDF file format. It’s my goal that attendees of my session will have a complete (well, almost) understanding of the on disk structures we’ll see in typical databases. Not just by looking at them through DBCC PAGE, but by taking it a couple of steps further by attempting to parse the contents by hand. You’ll get an understanding of the importance of the sys.sysallocunits base table and how that fuels all metadata in SQL Server.

For the full agenda, please check the official precon description. If you have any questions about the content that you’d like to clear up before signing up for either mine or one of the other precons available, I encourage you to leave a comment here or grab a hold of me on Twitter Smile

Prerequisites

While I will give brief introductions to the main concepts, I will assume a solid knowledge of what SQL Server does. I won’t spend a long time explaining why you should use clustered tables over heaps, instead I’ll give you the toolset to hopefully make that decision yourself. I’m not exaggerating when I classified the precon as level 500 – there will be 300 content too but we’ll be peaking at 500 several times during the day. We will be looking at hex codes, converting between decimal, hex and binary as needed – so make sure you don’t throw up when you see binary numbers Smiley

Registration

Registration hasn’t opened yet, but sign up and you’ll be notified as soon as it opens. A three day conference, including a precon day for just £375 really is a steal so make sure to get the early bind discount! I still can’t fathom that Saturday is free, as in £0, no charge – that’s too good an offer to pass up!

Feedback

Gravatar

Mogens Heller Grabe wrote on 6/30/2011 1:49 PM

Contrats! - that is awesome news!

I'm sorry, but I throw up when I see binary numbers, so I'll most likely not attend your session. Also, I'm not going to SQLBits ;)

But I wish you luck!
Gravatar

Ewald Cress wrote on 7/3/2011 10:31 PM

I so hope I'll be able to make it. If not, I'm still grateful to SQLBits, because it's only through them that I've discovered your blog. Yummy internals!
Gravatar

Mark S. Rasmussen wrote on 7/4/2011 4:34 PM

Glad to hear that, and I certainly hope to see you too at SQLBits - nothing better than discussing internals :)
Gravatar

mazzz in Leeds wrote on 7/5/2011 1:25 PM

I'm extrememly rusty on the hex side - would reading up on conversion suffice? Or would you recommend any other aspect to read up on?
Gravatar

Mark S. Rasmussen wrote on 7/5/2011 1:33 PM

I wouldn't worry too much - I'll be introducing the concept of converting between decimal, hex and binary numbers briefly. Through the day, most conversions will be done using a calculator and any actual use will mostly be for pattern matching :)

Post Comment

Name  
Email
Url
Comment
Please add 8 and 8 and type the answer here: