SQL Server Performance Tuning

How We Made T-SQL Queries Run 34,785 Times Faster

Updated June 25, 20262 min read

One query: 53 minutes to under a second. Ploom holds up a stopwatch next to a tipped-over hourglass.

Improvement after tuning

34,785xDURATION
31,084xCPU

Most SQL Servers bottleneck on Disk, which is number of disk operations required to pull all data necessary to process the the query.

When tuning, the goal is often to get SQL Server to read less data from the disk.

Problem

We identified a long-running query that was throttling CPU usage to 70% and concurrently executing across 12 threads.

Here’s a glance at the pre-tuning metrics:

  • Duration (query duration in milliseconds): 3,200,290
  • Disk (number of read operations required to get all data needed): 942,222,862

The query execution time was 53 minutes or 3,200,290 ms while making almost 1 million disk read operations.

Solution

  • After reviewing the query plan, we identified the culprit: a NOT IN operation invoking a VIEW.
  • The fix was straightforward: switching the NOT IN operation to a NOT EXISTS operation. See below.

Here is how we modified the original query to fix the problem:

Note: The performance difference between NOT IN and NOT EXISTS is often massive. This is one of those examples.

Before vs. After

Small changes, huge difference? Totally!

We slashed a query's run time from 3,200,290 ms down to 92 ms. No joke!

Below is a comparison of the number of disk reads before vs after tuning:

Reads per table before and after tuning

Disk (number of read operations)

942,222,862
Before tuning
30,312
After tuning
BeforeAfterImprovement
Duration (ms) 3,200,2909234,785x or 3,478,576%
Disk (number of reads)942,222,86230,31231,084x or 3,108,415%

Simple query rewrite reduced the duration of the stored procedure by a 34,785 times!

Duration – milliseconds

3,200,290
Before tuning
92
After tuning

Final Thoughts

A simple tweak of swapping the NOT IN operation for a NOT EXISTS operation resulted in a 34,785x improvement.

In SQL performance tuning, it's often crucial to understand how the SQL engine retrieves data.

Check Red9's SQL Server Services

SQL Server Consulting

Perfect for one-time projects like SQL migrations or upgrades, and short-term fixes such as performance issues or SQL remediation.

Discover More ➜

SQL Server Managed Services

Continuous SQL support, proactive monitoring, and expert DBA help with one predictable monthly fee.

Discover More ➜

Emergency SQL Support

Take the stress out of emergencies with immediate access to a SQL Server Sr. DBA 24x7x365

Discover More ➜

Explore All Services ➜