Running SQL Server in Docker
I’ve had lots of challenges in getting docker for sql-server working because I’ve wanted to ensure for my dev use case that there was no need for virtual volume management and copying files into and out of this. Instead, I’ve wanted to bind to local windows paths and have it drop all the mdf/ldf right there, so even on container destruction everything is good to go.
After working through the changes in SQL 2019 that require running as non-root, I’ve gotten it work again. No install of sql-server needed. Easy disposable development instance through docker! I’ll update my docker compose content when I can, but in the meantime, this should get you running even more quickly with SQL Server 2019.
Say you have an onboarding and need to get a new developer up to speed. Have you gone through the setup process for SQL Server on Windows? It’s a bit tedious and even with running scripts to install (or in my case I wrapped up with Chocolatey), it’s still a lot of things you need, including possibly a reboot if missing some .net dependencies.
The normal solution is to leverage more localdb for quickly deploying and isolating the database.
This has its own set of challenges that personally I like to avoid. Localdb is more isolated, but it’s not truly like running a local SQL Server standard edition, and debugging permissions, sharing, and other things can with its own set of steps to work through. I’ve seen it common for many devs to just avoid these issues and run a local SQL Server installation to just simplify and work with SQL Server as it’s expected to be.
I’d explored Docker SQL Server containers in the past, but one big issue for adoption to me was the issues I had mounting the local Windows folders to the Linux based container. ❓ Why is this important? Ease of usage for a developer. If I proposed this would save effort to many developers working with SQL Server, I’m pretty sure telling them that they’d have to copy a backup or database file in via CLI to a virtual mounted drive that they can’t easily manage would be a deal-breaker. I basically wanted to ensure if they spun up SQL Server in a container, the database backups, mdf and ldf files, and any other created files would be able to persist outside of that instance, ensuring easy development workflow.
I’m happy to say I finally have it working to my satisfaction, resolving most of those concerns.
If you’ve desired to do the following, then using Docker might end up saving you some effort.
- simplify the setup of a new SQL Server instance
- be able to reset your SQL Server instance to allow testing some setup in isolation
- be able to switch SQL Server editions to match a new requirement
- be able to upgrade or patch to a later version of SQL Server with minimal effort
This is not for production. There’s more effort and debate that goes on to using SQL Server in containers, Kubernetes (even more complex!), and other containerization approaches that are far outside the scope of what I’m looking at. This is first and foremost focused on ensuring a development workflow that reduces complexity for a developer and increases the ease at which SQL Server testing can be implemented by making the SQL Server instance easily disposed of and recreated.
If this also means I spread some 🐧 Linux magic to some Windows stack developers… then count it as a sneaky win. 😏
The following example is done with SQL Server on Linux. As I’m already comfortable with SQL Server on Windows, I wanted to be try this on Linux based container. I also wanted to continue using Linux based containers for tooling, and not have to switch back to Windows containers for the sole purpose of running SQL Server. At the time I began this testing, I found it was exclusive. You either ran Linux or Windows-based containers. This is changing with the advent of new features in Docker that are there to allow side by side Windows + Linux based containers.
Release notes indicate:
Experimental feature: LCOW containers can now be run next to Windows containers (on Windows RS3 build 16299 and later). Use –platform=linux in Windows container mode to run Linux Containers On Windows. Note that LCOW is experimental; it requires the daemon experimental option. Docker Community Edition 18.03.0-ce-win59 2018-03-26
The main difference in your local development process will be Windows Authentication vs SQL Authentication. Use SQL Authentication with Linux based SQL Server
The following is the result of a lot of trial and error over a year. Thanks to Shawn Melton 👏 also for providing me with support doing my troubleshooting as part of the SQL Server community in Slack. You can find Shawn’s example I used as a starting point for my 🧪testing in this gist.
A few helpful tips:
-dfor detached and you can see the SQL Server console output in the console.
- See the persisted databases (system and user!) in the artifacts directory after docker-compose begins running.
Another reason I’m really excited about is the ability to better support testing through tools like Pester. Yes, it’s a geek thing, but I love a solid written test 🧪that maintains my code and helps me ensure quality with changes. Better TDD is a goal of mine for sure.
🔨 This supports implementation of better tests by providing the potential for spinning up a local SQL Instance, restoring a test database, and running a sequence of actions against it with pass or fail without the additional infrastructure requirements to have this done on another server. Making your tests that are not full integration testing as minimally dependent on external factors is a fantastic step to saving you a lot of work.
A simple pester (PowerShell) might frame the start of a test like this:
Hope this helps someone. I spent at least a year coming back over time to this hoping to actually get it working in a way that felt like a first-class citizen and reduced complexity for development work.
I’m pretty happy with the results. 😁