{"id":651,"date":"2012-03-03T19:39:41","date_gmt":"2012-03-03T19:39:41","guid":{"rendered":"http:\/\/www.websitedesignwebsitedevelopment.com\/?p=651"},"modified":"2014-03-19T09:13:59","modified_gmt":"2014-03-19T09:13:59","slug":"approach-of-parallelism-used-in-data-warehouse-and-olap","status":"publish","type":"post","link":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/","title":{"rendered":"Approach of parallelism used in Data warehouse and OLAP"},"content":{"rendered":"<h2>Approach of parallelism used in Data warehouse and OLAP<\/h2>\n<p>(<a title=\"A Case for Parallelism in Data Warehousing and OLAP\" href=\"http:\/\/www.websitedesignwebsitedevelopment.com\/wp-content\/uploads\/2012\/03\/10.1.1.51.1504.pdf\">Download<\/a> Reference Research Paper)<\/p>\n<p>Processor grouping is used to divide and allocate queries to run parallel and data is divided an assigned to different processors as well.<\/p>\n<p><span style=\"text-decoration: underline;\">In fact parallelism is implemented in two phases:<\/span><\/p>\n<p>i) A processor group partitioning (d+1 groups)<br \/>\nii) A physical data placement phase (allocate data fragments to individual processors)<\/p>\n<p><span style=\"text-decoration: underline;\">These two phase works with the help of followings:<\/span><\/p>\n<p>1) Data Warehouse Physical Design (w.r.t. DI)<br \/>\n2) DataIndexing<br \/>\n3) Processor Partitioning (d+1)<br \/>\n4) Tables Partitioning into fact table &amp; dimension tables<br \/>\n5) Appropriate use of BDI &amp; JDI<br \/>\n6) Data Placement (Star Schema)<\/p>\n<p>It is explained in the research paper that the size of database is not the only issue facing by the DBA and it can not be resolved only by increasing I\/O facility. Quick look into these bulleted points will give an idea that parallelism works.<\/p>\n<p><span style=\"text-decoration: underline;\">Data Warehouse Physical Design (w.r.t. DI) &amp; DataIndexing:<\/span><\/p>\n<p>DataIndexing helped not only in indexing the columns or rows but stored the data as well. Instead of just indexing it provides facility to reach the desired record in less time. To get optimum results it is suggested to design data warehouse according to dataindexing. If tables will be structured to support dataindexing like these tables characteristics has been taken care of,<\/p>\n<p>i) Primary Keys Uniqueness (Capitalization if required)<br \/>\nii) Foreign Key Selection<br \/>\niii) Dimension Tables and Sub-Tables<br \/>\niv) Sub-Tables (As smaller as good to be fit in memory)<\/p>\n<p><span style=\"text-decoration: underline;\">Processor Partitioning (d+1)<\/span><\/p>\n<p>For processor portioning following things taken care of<\/p>\n<p>The smallest number such that dimension table can be fit in the aggregate memory of processor group is being chosen with the formula<\/p>\n<p>Now number with the proportional to data volume stored<\/p>\n<p>If more processors are available then we will divide the load among them by<br \/>\ni=1 to d+1<\/p>\n<p><span style=\"text-decoration: underline;\">Data Placement (Star Schema)<\/span><\/p>\n<p>As tables are designed and partition according to the dataindexing now i-th dimension table and its associated JDI will be allocated to processor group i.<\/p>\n<p><span style=\"text-decoration: underline;\">How &amp; When tables partitioning?<\/span><\/p>\n<p>If N is greater<br \/>\nIf smallest number is being larger and out of aggregate memory of processor group so partition the i-th dimension table w.r.t. JDI which will help to overcome this situation.<\/p>\n<p>If &gt;1<br \/>\nThen partition horizontally the metric data.<\/p>\n<p>But basic dataindexing is allocated to d+1 group.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Approach of parallelism used in Data warehouse and OLAP (Download Reference Research Paper) Processor grouping is used to divide and allocate queries to run parallel and data is divided an assigned to different processors as well. In fact parallelism is implemented in two phases: i) A processor group partitioning (d+1 groups) ii) A physical data [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[54],"tags":[],"class_list":["post-651","post","type-post","status-publish","format-standard","hentry","category-data-warehouse"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Approach of parallelism used in Data warehouse and OLAP<\/title>\n<meta name=\"description\" content=\"Approach of parallelism used in Data warehouse and OLAP\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Approach of parallelism used in Data warehouse and OLAP\" \/>\n<meta property=\"og:description\" content=\"Approach of parallelism used in Data warehouse and OLAP\" \/>\n<meta property=\"og:url\" content=\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\" \/>\n<meta property=\"og:site_name\" content=\"AndroidBubble Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/pages\/Website-Design-Website-Development\/172363336135453\" \/>\n<meta property=\"article:published_time\" content=\"2012-03-03T19:39:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-03-19T09:13:59+00:00\" \/>\n<meta name=\"author\" content=\"Fahad\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Fahad\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\"},\"author\":{\"name\":\"Fahad\",\"@id\":\"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7\"},\"headline\":\"Approach of parallelism used in Data warehouse and OLAP\",\"datePublished\":\"2012-03-03T19:39:41+00:00\",\"dateModified\":\"2014-03-19T09:13:59+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\"},\"wordCount\":401,\"articleSection\":[\"Data Warehouse\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\",\"url\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\",\"name\":\"Approach of parallelism used in Data warehouse and OLAP\",\"isPartOf\":{\"@id\":\"https:\/\/androidbubble.com\/blog\/#website\"},\"datePublished\":\"2012-03-03T19:39:41+00:00\",\"dateModified\":\"2014-03-19T09:13:59+00:00\",\"author\":{\"@id\":\"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7\"},\"description\":\"Approach of parallelism used in Data warehouse and OLAP\",\"breadcrumb\":{\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/androidbubble.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Website Development\",\"item\":\"https:\/\/androidbubble.com\/blog\/category\/website-development\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Software Engineering Perspective\",\"item\":\"https:\/\/androidbubble.com\/blog\/category\/website-development\/software-engineering-perspective\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Data Warehouse\",\"item\":\"https:\/\/androidbubble.com\/blog\/category\/website-development\/software-engineering-perspective\/data-warehouse\/\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"Approach of parallelism used in Data warehouse and OLAP\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/androidbubble.com\/blog\/#website\",\"url\":\"https:\/\/androidbubble.com\/blog\/\",\"name\":\"AndroidBubble Blog\",\"description\":\"Articles &amp; Posts\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/androidbubble.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7\",\"name\":\"Fahad\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/afab5bcad71955d142a69df1758e6710aed4ab9cc2b5da28c54a7c3f39801b73?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/afab5bcad71955d142a69df1758e6710aed4ab9cc2b5da28c54a7c3f39801b73?s=96&d=mm&r=g\",\"caption\":\"Fahad\"},\"sameAs\":[\"http:\/\/www.androidbubbles.com\/\",\"https:\/\/x.com\/phpFlex\"],\"url\":\"https:\/\/androidbubble.com\/blog\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Approach of parallelism used in Data warehouse and OLAP","description":"Approach of parallelism used in Data warehouse and OLAP","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/","og_locale":"en_US","og_type":"article","og_title":"Approach of parallelism used in Data warehouse and OLAP","og_description":"Approach of parallelism used in Data warehouse and OLAP","og_url":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/","og_site_name":"AndroidBubble Blog","article_publisher":"https:\/\/www.facebook.com\/pages\/Website-Design-Website-Development\/172363336135453","article_published_time":"2012-03-03T19:39:41+00:00","article_modified_time":"2014-03-19T09:13:59+00:00","author":"Fahad","twitter_misc":{"Written by":"Fahad","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#article","isPartOf":{"@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/"},"author":{"name":"Fahad","@id":"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7"},"headline":"Approach of parallelism used in Data warehouse and OLAP","datePublished":"2012-03-03T19:39:41+00:00","dateModified":"2014-03-19T09:13:59+00:00","mainEntityOfPage":{"@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/"},"wordCount":401,"articleSection":["Data Warehouse"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/","url":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/","name":"Approach of parallelism used in Data warehouse and OLAP","isPartOf":{"@id":"https:\/\/androidbubble.com\/blog\/#website"},"datePublished":"2012-03-03T19:39:41+00:00","dateModified":"2014-03-19T09:13:59+00:00","author":{"@id":"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7"},"description":"Approach of parallelism used in Data warehouse and OLAP","breadcrumb":{"@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/androidbubble.com\/blog\/website-development\/software-engineering-perspective\/data-warehouse\/approach-of-parallelism-used-in-data-warehouse-and-olap\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/androidbubble.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Website Development","item":"https:\/\/androidbubble.com\/blog\/category\/website-development\/"},{"@type":"ListItem","position":3,"name":"Software Engineering Perspective","item":"https:\/\/androidbubble.com\/blog\/category\/website-development\/software-engineering-perspective\/"},{"@type":"ListItem","position":4,"name":"Data Warehouse","item":"https:\/\/androidbubble.com\/blog\/category\/website-development\/software-engineering-perspective\/data-warehouse\/"},{"@type":"ListItem","position":5,"name":"Approach of parallelism used in Data warehouse and OLAP"}]},{"@type":"WebSite","@id":"https:\/\/androidbubble.com\/blog\/#website","url":"https:\/\/androidbubble.com\/blog\/","name":"AndroidBubble Blog","description":"Articles &amp; Posts","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/androidbubble.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/0a833b633f744c3a5e0de7c9a94e71f7","name":"Fahad","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/androidbubble.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/afab5bcad71955d142a69df1758e6710aed4ab9cc2b5da28c54a7c3f39801b73?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/afab5bcad71955d142a69df1758e6710aed4ab9cc2b5da28c54a7c3f39801b73?s=96&d=mm&r=g","caption":"Fahad"},"sameAs":["http:\/\/www.androidbubbles.com\/","https:\/\/x.com\/phpFlex"],"url":"https:\/\/androidbubble.com\/blog\/author\/admin\/"}]}},"views":496,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/posts\/651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/comments?post=651"}],"version-history":[{"count":4,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/posts\/651\/revisions"}],"predecessor-version":[{"id":1653,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/posts\/651\/revisions\/1653"}],"wp:attachment":[{"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/media?parent=651"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/categories?post=651"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/androidbubble.com\/blog\/wp-json\/wp\/v2\/tags?post=651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}