Click here to Skip to main content
15,898,134 members
Home / Discussions / Database
   

Database

 
GeneralRe: What is 'IsMSShipped' ?? Pin
Kishore.P15-Jan-08 18:02
Kishore.P15-Jan-08 18:02 
GeneralCreating a View Pin
AAGTHosting15-Jan-08 7:37
AAGTHosting15-Jan-08 7:37 
GeneralRe: Creating a View Pin
Colin Angus Mackay15-Jan-08 9:58
Colin Angus Mackay15-Jan-08 9:58 
GeneralRe: Creating a View Pin
AAGTHosting15-Jan-08 20:16
AAGTHosting15-Jan-08 20:16 
QuestionPerformance question Pin
Kosta Cherry15-Jan-08 7:35
Kosta Cherry15-Jan-08 7:35 
GeneralRe: Performance question Pin
Colin Angus Mackay15-Jan-08 9:49
Colin Angus Mackay15-Jan-08 9:49 
GeneralRe: Performance question Pin
Kosta Cherry15-Jan-08 13:48
Kosta Cherry15-Jan-08 13:48 
GeneralRe: Performance question Pin
Colin Angus Mackay15-Jan-08 14:19
Colin Angus Mackay15-Jan-08 14:19 
Kosta Cherry wrote:
The problem with modeling will be that selection from many tables will be done from multithreaded application, and I'm not sure how servers will react compared with single-threaded approach when all sits in one table and retrieved with one query


A good database server will be expecting to get many queries at the same time. The only restriction is, as I recall, that you can't put down more than one query simultaneously on a single connection. So you have to open up a new connection on each thread. When you complete a query you will obviously close the connection which returns it to the pool and another thread can potentially use it.

Kosta Cherry wrote:
those DB servers should be properly tuned for one approach or another.


Well, to an extent. I would guess that database servers are already tuned to having multiple queries run against it. It is the tuning of the queries to avoid things like deadlocks that you need to be concerned about. If all the queries are effectively read only then I don't see any problems in that area. The problems come when you have queries writing to the database. Since you already said write performance isn't an issue, I'm guessing that insertions and updates don't happen frequently, or happen in batches outside of normal hours.


Kosta Cherry wrote:
I'm kind of leaning towards the "many tables" approach from the point of maintainability (where I can have each table on different table space or even different server).


Personally, I would have thought the many-tables (especially if they are all the same structure) approach would be a maintenance nightmare.

Also, I think you are possibly over-optimising at this stage.


Kosta Cherry wrote:
"Object" here is just named collection of millions of similar records - like, for example, file is collection of bytes, or picture is collection of pixels.


Well, if all the rows are using the same structure, are they not ALL similar? Differences by a column value (or small number of column values) isn't introducing dissimilartity as far as I can see.


Kosta Cherry wrote:
Of course I did. I just don't know which way it'll work faster.


In my experience you never fully know until it is running. I've implemented a system one way and optimised it. I thought I'd learned the lessons of that optimisation and attemted to apply it somewhere else, but it didn't work and some other optimisation worked better.

If you have enough data to build a prototype I would recommend doing that and experimenting. For reference, the largest database I worked on was growing at 1Gb per week. I don't recall how many rows that was, but the largest table was itself growing in the region of a million rows per day.

From that experience I found that the main bottleneck was pulling all those rows off the disk. Queries would frequently be pulling 10s, if not 100s, of millions of rows at once off the disk. In which case what you should be looking at is ensuring the disks are fast enough. A RAID set or SAN would improve performance in that area more than anything you can do.

I know this doesn't really answer your questions. It really just throws up more things to think about. But like I said earlier any answer you are going to get here will be pure guess work.

One additional thing to think about. Are any of these rows inactive? By that I mean do you have an active set of data that is used daily and another set that is only used occasionally (e.g. by reporting or archive systems)? If you do, you could optimise it along those lines and reduce the number of rows that you have to deal with on a daily basis.


GeneralRe: Performance question Pin
Paul Conrad19-Jan-08 7:07
professionalPaul Conrad19-Jan-08 7:07 
Generalcreating table adapter queries using code Pin
Cory Kimble15-Jan-08 7:10
Cory Kimble15-Jan-08 7:10 
GeneralRe: creating table adapter queries using code Pin
Kishore.P15-Jan-08 18:22
Kishore.P15-Jan-08 18:22 
GeneralRe: creating table adapter queries using code Pin
Cory Kimble16-Jan-08 4:00
Cory Kimble16-Jan-08 4:00 
GeneralPad Left Access SQL Pin
Kschuler15-Jan-08 3:37
Kschuler15-Jan-08 3:37 
GeneralRe: Pad Left Access SQL Pin
andyharman15-Jan-08 4:00
professionalandyharman15-Jan-08 4:00 
GeneralRe: Pad Left Access SQL Pin
Kschuler15-Jan-08 4:12
Kschuler15-Jan-08 4:12 
GeneralRe: Pad Left Access SQL Pin
GuyThiebaut15-Jan-08 10:33
professionalGuyThiebaut15-Jan-08 10:33 
QuestionHow to get the PK value within an update trigger Pin
ScottM115-Jan-08 0:45
ScottM115-Jan-08 0:45 
GeneralRe: How to get the PK value within an update trigger Pin
Pete O'Hanlon15-Jan-08 1:36
mvePete O'Hanlon15-Jan-08 1:36 
GeneralRe: How to get the PK value within an update trigger Pin
ScottM117-Jan-08 1:22
ScottM117-Jan-08 1:22 
GeneralChange destination column names in Snapshot Replication Pin
BillyGoatGruff14-Jan-08 5:58
BillyGoatGruff14-Jan-08 5:58 
GeneralRe: Change destination column names in Snapshot Replication Pin
Paul Conrad19-Jan-08 7:09
professionalPaul Conrad19-Jan-08 7:09 
GeneralRemote Replication Error Pin
sami_pak13-Jan-08 19:55
sami_pak13-Jan-08 19:55 
GeneralRe: Remote Replication Error Pin
Hesham Amin14-Jan-08 6:40
Hesham Amin14-Jan-08 6:40 
Generalcomparing date time values in MSAccess Pin
Member 305788713-Jan-08 19:16
Member 305788713-Jan-08 19:16 
GeneralRe: comparing date time values in MSAccess Pin
John_Adams15-Jan-08 22:37
John_Adams15-Jan-08 22:37 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.