Click here to Skip to main content
15,867,834 members
Articles / Desktop Programming / Win32

Best Practice in File Storage while Building Applications - Database (Blob Storage) Vs File System

Rate me:
Please Sign up or sign in to vote.
2.25/5 (8 votes)
7 Aug 2008CPOL3 min read 56.3K   22   6
This article explains the best strategy to be followed while designing data storage applications by System Architects

Introduction

This article discusses the pros and cons of data storage for files v/s blobs in databases while designing data store application systems.

Background

For most of the web applications, this remains a common design question “whether the images should be stored in the database or in a file system?” In the web based apps like shopping cart, the site has to deal with a number of product images and the best choice is to store the images in the database together with the meta data. However, having said that, there are pros and cons for both the approaches.

While designing any data store applications, Sys Architect should take the right decision on this by taking into account the behavior of the proposed systems in a broader perspective.

As everyone knows, the IO operation is a bit faster and hence the file retrieval is when we use the file servers for storage whereas the database as the document or file store will deliver a central repository of data for the organizations and hence data management is more efficient and hence more under control. A database may follow good entity modelling and have a logical design, but if the application and users cannot access and manipulate the BLOB data stored in it efficiently, the database is not effective.

BLOBs require database designers to understand how the application will access and use the BLOBs in practice. Spend time designing how the BLOB objects will be represented in the database. How you lay out the large objects within the database affects both the response time and throughput of the application.

Advantages and Disadvantages

BLOB Storage as the Best Solution

  1. For better scalability. Although file systems are designed to handle a large number of objects of varying sizes, say files and folders, actually they are not optimized for a huge number (tens of millions) of small files. Database systems are optimized for such scenarios.
  2. For better availability. Database servers have availability features that extend beyond those provided by the file system. Database replication is a set of solutions that allow you to copy, distribute, and potentially modify data in a distributed environment whereas Log shipping provides a way of keeping a stand-by copy of a database in case the primary system fails.
  3. For central repository of data with controlled growth. DBA has the privilege to control and monitor the growth of database and split the database as and when needed.
  4. For full-text index and search operations. You can index and search certain types of data stored in BLOB columns. When a database designer decides that a table will contain a BLOB column and the column will participate in a full-text index, the designer must create, in the same table, a separate character-based data column that will hold the file extension of the file in the corresponding BLOB field. During the full-text indexing operation, the full-text service looks at the extensions listed in the character-based column (.txt, .doc, .xls, etc.), applies the corresponding filter to interpret the binary data, and extracts the textual information needed for indexing and querying.

File System Storage as the Best Solution

  1. For the application in which the images will be used requires streaming performance, such as real-time video playback.
  2. For applications such as Microsoft PhotoDraw® or Adobe PhotoShop, which only know how to access files.
  3. If you want to use some specific feature in the NTFS file system such as Remote Storage.

History

  • 7th August, 2008: Initial post

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


Written By
Architect
United States United States
Systems Architect & Analyst with concentration in various IT technologies, especially on Microsoft platform. He is an active member of Sharepoint Community and areas of expertise are ASP.Net, SharePoint, WinForms and Workflow technologies. You can visit his blog
http://www.dotnetsoldier.blogspot.com/

Comments and Discussions

 
GeneralAt least reference where you copied this from Pin
cmk16-Nov-08 11:49
cmk16-Nov-08 11:49 
GeneralProblem with BLOBs Pin
Gevorg8-Aug-08 16:41
Gevorg8-Aug-08 16:41 
GeneralRe: Problem with BLOBs Pin
Ziyad Mohammad9-Aug-08 18:25
Ziyad Mohammad9-Aug-08 18:25 
GeneralRe: Problem with BLOBs Pin
chrwal28-Jul-09 13:23
chrwal28-Jul-09 13:23 
GeneralAnother advantage for storing in DB... Pin
stavinski7-Aug-08 4:56
stavinski7-Aug-08 4:56 
GeneralRe: Another advantage for storing in DB... Pin
Ray Cassick7-Aug-08 7:24
Ray Cassick7-Aug-08 7:24 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.