Click here to Skip to main content
15,867,308 members
Articles / Database Development / SQL Server
Article

SQL Server 2005 Paging Results

Rate me:
Please Sign up or sign in to vote.
4.86/5 (46 votes)
19 Apr 20073 min read 198.3K   134   50
Using SQL Server to do paging of sql results.

Introduction

With SQL Server 2005, it is now a lot easier to use paged queries than in previous versions. I will be using the NorthWind database (mostly), so you can also use the examples I have provided. I will keep the examples simple; anything complex will only cause confusion. I will start with "traditional" methods such as SELECT, TOP, and then move on to the specific SQL Server 2005 paging examples.

Background

I was asked a question or a series of questions, "How would you do paging in a SQL? How would you do this with a lot of records, say, 10,000 or more?"

I thought about answers. To be more precise, I thought of more questions and this got me thinking, "This must be a common problem, every developer must have done or solved this. What about paging sizes and working with very large data sets? What about getting results from multiple tables?"

So, I decided to look into these questions with specific reference to SQL Server 2005. The following is by far the easiest way and should be used, but it is rarely this easy.

SQL
select * from mytable
Where ID between 20 and 30

SQL Top

SQL Top (returns records from the TOP of the result set) is very good at returning a set number of records from each end of a results set. The example below gets the top 10 customers by order qty. This is a very common question on forums. TOP can also pull a percentage of records, although this isn't discussed here.

SQL
select top 10 * from customers -- This is a very basic example.
select TOP 10 Customers.CustomerID, Customers.CompanyName, count(*) OrderCount
from Customers inner join Orders on Orders.CustomerID = Customers.CustomerID
GROUP BY Customers.CustomerID, Customers.CompanyName
ORDER BY OrderCount DESC

This is really useful. When you want to pull records 11 to 20 you could use temp tables.

SQL
-- SELECT First 30 records in to Temp table
SELECT TOP 30 * INTO
#TEMP
from Customers
ORDER BY CompanyName ASC

--Select Bottom 10 records in another temp table

SELECT TOP 10 * 
INTO #TEMP2
from #Temp
ORDER BY CompanyName DESC

-- GET THE RECORDS

SELECT * FROM #TEMP2

This is fine for the first few pages or the first few users. If you have users that want to return page after page after page, you end up getting 1000 records to return 10, which is not very efficient. You could also have placed an identity on the first temp table and used a SELECT statement as an alternative.

Alternative to TOP

There is an alternative to TOP, which is to use rowcount. Use rowcount with care, as it can lead you into all sorts of problems if it's not turned off.

SQL
SET rowcount 10
SELECT * from Customers
ORDER BY CompanyName

WITH, ROW_NUMBER and OVER

This is new to SQL Server 2005 and looks really useful. Below is an example to get records 20 to 29 from a results set. It might a bit strange at first, but I will go through the query so you'll see how simple it is.

SQL
With Cust AS
    ( SELECT CustomerID, CompanyName,
    ROW_NUMBER() OVER (order by CompanyName) as RowNumber 
    FROM Customers )
select *
from Cust
Where RowNumber Between 20 and 30

The WITH in SQL Server 2005 specifies a temporary named result, much like a temporary table in previous versions of SQL Server. However, the import parts are the ROW_NUMBER and the OVER statement, which create a row number on each row based on the Company name. This is like adding an identity seed to a temp table with an order by clause.

I hope you are still with me. If not, run the code and view the results. This is really very quick for large tables; I have been impressed with the speed on tables with over 250,000 records.

Putting it All Together in a Stored Procedure

Now we will put it all together in a Stored Procedure that can be used by your application. I won't show a .NET datagrid or similar control, as that is outside the scope of this article. The stored procedure below uses flexible page sizes and page numbers, so you can select any page at random. This is quite useful if you wish to jump ahead 10 pages to find a particular record. The paging for this example starts at page 1 rather than at page 0, but this can be easily changed.

SQL
CREATE PROC GetCustomersByPage

@PageSize int, @PageNumber int 

AS 

Declare @RowStart int 
Declare @RowEnd int 

if @PageNumber > 0 
Begin 

SET @PageNumber = @PageNumber -1 

SET @RowStart = @PageSize * @PageNumber + 1; 
SET @RowEnd = @RowStart + @PageSize - 1 ; 

With Cust AS 
     ( SELECT CustomerID, CompanyName, 
       ROW_NUMBER() OVER (order by CompanyName) as RowNumber 
       FROM Customers ) 

select * 
from Cust 
Where RowNumber >= @RowStart and RowNumber <= @RowEnd end

END

To run this, simply specify the page size and page number (GetCustomersByPage, @PageSize and @PageNumber) as shown below.

exec GetCustomersByPage 10, 1

History

  • Version 1.0 22/03/2007: Initial
  • Version 1.1 18/04/2007: Fixed issue with proc that gets 11 records after the 1st page

License

This article has no explicit license attached to it but may contain usage terms in the article text or the download files themselves. If in doubt please contact the author via the discussion board below.

A list of licenses authors might use can be found here


Written By
Software Developer (Senior)
United Kingdom United Kingdom
Frank Kerrigan

Currently developing Insurance systems with SQL Server, ASP.NET, C#, ADO for a company in Glasgow Scotland. Very keen on OOP and NUNIT testing. Been in IT forever (20 years) in mix of development and supporting applications / servers. Worked for companies big and small and enjoyed both.

Developed in (newest first) : C#, Progress 4GL, ASP.NET, SQL TSQL, HTML, VB.NET, ASP, VB, VBscript, JavaScript, Oracle PSQL, perl, Access v1-2000, sybase/informi, Pic Controllers, 6502 (ask your dad).

Msc .Net Development Evenings www.gcu.ac.uk
MCAD Passed
MCP C# ASP.NET Web Applications
MCP SQL Server 2000
HND Computing
OND / HNC Electrical Engineering,

Comments and Discussions

 
GeneralMy vote of 5 Pin
Mahesh Bailwal12-Jul-13 19:18
Mahesh Bailwal12-Jul-13 19:18 
GeneralMy vote of 5 Pin
Kanasz Robert24-Sep-12 6:01
professionalKanasz Robert24-Sep-12 6:01 
GeneralMessage Closed Pin
4-Sep-08 17:07
mayurmv4-Sep-08 17:07 
QuestionRe: Use this Paging Method Pin
Eric Xue (brokensnow)8-Sep-10 15:07
Eric Xue (brokensnow)8-Sep-10 15:07 
Generalwithout using a store procedure using ; Pin
ndinges18-Apr-08 2:55
ndinges18-Apr-08 2:55 
GeneralThanks Pin
Some Jerk2-Mar-08 13:52
Some Jerk2-Mar-08 13:52 
GeneralI think my construction is better Pin
Marek Mizov6-Jul-07 0:32
Marek Mizov6-Jul-07 0:32 
GeneralRe: I think my construction is better Pin
Frank Kerrigan19-Jul-07 0:13
Frank Kerrigan19-Jul-07 0:13 
GeneralMillion rows benchmark Pin
Roberto Colnaghi11-Jun-07 7:18
Roberto Colnaghi11-Jun-07 7:18 
GeneralRe: Million rows benchmark Pin
Frank Kerrigan18-Jun-07 1:34
Frank Kerrigan18-Jun-07 1:34 
QuestionSoftware Packaging of C# Windows Application and MS Access Database Pin
SebanMathews20-Apr-07 1:25
SebanMathews20-Apr-07 1:25 
QuestionStrange effect... Pin
BenCoo12-Apr-07 6:23
BenCoo12-Apr-07 6:23 
AnswerRe: Strange effect... Pin
Frank Kerrigan17-Apr-07 3:12
Frank Kerrigan17-Apr-07 3:12 
GeneralRe: Strange effect... Pin
BenCoo17-Apr-07 4:27
BenCoo17-Apr-07 4:27 
GeneralRe: Strange effect... Pin
Frank Kerrigan18-Apr-07 1:39
Frank Kerrigan18-Apr-07 1:39 
GeneralRe: Strange effect... Pin
Frank Kerrigan18-Apr-07 23:24
Frank Kerrigan18-Apr-07 23:24 
GeneralBETWEEN is inclusive Pin
mike.griffin@entityspaces.net8-Apr-07 13:41
mike.griffin@entityspaces.net8-Apr-07 13:41 
GeneralRe: BETWEEN is inclusive Pin
Frank Kerrigan17-Apr-07 3:13
Frank Kerrigan17-Apr-07 3:13 
GeneralRe: BETWEEN is inclusive Pin
Frank Kerrigan18-Apr-07 23:25
Frank Kerrigan18-Apr-07 23:25 
GeneralVery nice Job Pin
RoboTheToolMan8-Apr-07 5:29
RoboTheToolMan8-Apr-07 5:29 
GeneralNicely put Pin
RFelts4-Apr-07 5:01
RFelts4-Apr-07 5:01 
GeneralI have been wondering about that forever Pin
philmee953-Apr-07 12:09
philmee953-Apr-07 12:09 
Generalold problem - my solution - this will work for SQL 2K and 2K5 Pin
obriejoh3-Apr-07 6:39
obriejoh3-Apr-07 6:39 
AnswerRe: old problem - my solution - this will work for SQL 2K and 2K5 Pin
Abi Bellamkonda3-Apr-07 13:49
Abi Bellamkonda3-Apr-07 13:49 
Are we not doing too much insert (data transfer into temp table) here? which is avoided in above code.

In short its long time, that SQL Server had Pusedo columns for every select statement (RowNumber, RowID) and Sort By Column Ordinal variable. Which will solve this problem for ever, in easiest way.

SELECT * FROM Products<br />
WHERE ROWNUM BETWEEN @Start AND @End<br />
ORDER BY Ordinal @OrdinalVariable


Thats it, no more SQL coding please, Mr. Billy !Confused | :confused:

Abi ( Abishek Bellamkonda )
My Blog: http://abibaby.blogspot.com
=(:*

GeneralUsing Double Top Pin
harunmip3-Apr-07 1:51
harunmip3-Apr-07 1:51 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.