基于web服務(wù)的異構(gòu)數(shù)據(jù)集成設(shè)計(jì).rar
基于web服務(wù)的異構(gòu)數(shù)據(jù)集成設(shè)計(jì),基于web服務(wù)的異構(gòu)數(shù)據(jù)集成設(shè)計(jì)4.5萬字符33頁本資料為英文論文,包括開題報(bào)告和任務(wù)書摘 要企業(yè)對(duì)信息技術(shù)的應(yīng)用經(jīng)歷了不同的階段。各階段的應(yīng)用,無論是開發(fā)語言、部署平臺(tái)、通信協(xié)議還是數(shù)據(jù)格式及架構(gòu)都存在較大的差異,如何將企業(yè)內(nèi)部的“信息孤島”聯(lián)系起來,實(shí)現(xiàn)信息的交互和共享,已成為實(shí)現(xiàn)企業(yè)戰(zhàn)略目標(biāo)的必需手段和捷徑。數(shù)據(jù)...
該文檔為壓縮文件,包含的文件列表如下:
內(nèi)容介紹
原文檔由會(huì)員 usactu 發(fā)布
基于Web服務(wù)的異構(gòu)數(shù)據(jù)集成設(shè)計(jì)
4.5萬字符 33頁
本資料為英文論文,包括開題報(bào)告和任務(wù)書
摘 要
企業(yè)對(duì)信息技術(shù)的應(yīng)用經(jīng)歷了不同的階段。各階段的應(yīng)用,無論是開發(fā)語言、部署平臺(tái)、通信協(xié)議還是數(shù)據(jù)格式及架構(gòu)都存在較大的差異,如何將企業(yè)內(nèi)部的“信息孤島”聯(lián)系起來,實(shí)現(xiàn)信息的交互和共享,已成為實(shí)現(xiàn)企業(yè)戰(zhàn)略目標(biāo)的必需手段和捷徑。
數(shù)據(jù)集成是企業(yè)應(yīng)用集成的根基,決定著企業(yè)集成的成敗。數(shù)據(jù)集成是將一個(gè)異構(gòu)的,存在沖突的,分散的源數(shù)據(jù)抽取出來,進(jìn)行相應(yīng)的結(jié)構(gòu)和數(shù)據(jù)轉(zhuǎn)換后加載到目標(biāo)系統(tǒng)中的過程。數(shù)據(jù)集成分為三個(gè)步驟:集成分析,數(shù)據(jù)分析,數(shù)據(jù)遷移。
本設(shè)計(jì)的內(nèi)容是以湖南大學(xué)學(xué)生管理系統(tǒng)和公寓管理系統(tǒng)為例,分析系統(tǒng)數(shù)據(jù)來源及相互關(guān)系,總結(jié)公共信息模型,從而設(shè)計(jì)并實(shí)現(xiàn)整合后的數(shù)據(jù)倉庫。本設(shè)計(jì)利用數(shù)據(jù)庫和.NET Framework相關(guān)知識(shí)實(shí)現(xiàn)為源系統(tǒng)定制的ETL工具,將數(shù)據(jù)從源系統(tǒng)中提取出來,經(jīng)過相應(yīng)轉(zhuǎn)換和清洗,最終加載到數(shù)據(jù)倉庫;該工具擁有記錄和顯示數(shù)據(jù)加載的狀態(tài),導(dǎo)入導(dǎo)出狀態(tài)文件,根據(jù)狀態(tài)文件繼續(xù)尚未完成的導(dǎo)庫工作等功能。集成流程必須最優(yōu)利用源系統(tǒng),并對(duì)未來需求可擴(kuò)展,因此本設(shè)計(jì)利用NHibernate實(shí)體映射解決數(shù)據(jù)倉庫中數(shù)據(jù)字段和頁面邏輯層數(shù)據(jù)綁定字段的沖突,以Web服務(wù)提供數(shù)據(jù)倉庫中數(shù)據(jù)的管理,此為數(shù)據(jù)消費(fèi)的過程,目的在于達(dá)成源系統(tǒng)數(shù)據(jù)實(shí)時(shí)更新和一致的目標(biāo)。
關(guān)鍵字:數(shù)據(jù)集成;ETL;數(shù)據(jù)倉庫;NHibernate實(shí)體映射
The Design of Heteromerous Data Integration Based on Web Service
Abstract
Nowadays application of information technologies in enterprises has gone through several phases. No matter from languages to deployment platforms or from communication protocol to data format and schema, systems developed in different phases are diverse from each other. So connecting those isolated data islands, realizing information sharing and communication are the required and express way to achieve strategic goal in enterprise.
The foundation of application integration is data integration, which decides whether the integration will be successful. Data integration extracts data from isomerous, conflicted and isolated sources, transforms data and then loads it into the destination. It has three steps: Integration Analysis, Data Analysis, and Data Transference.
The design uses Hunan University Student MIS and Dormitory MIS as samples, analyzes data resources and their connection, produces the common data model and designs data warehouse. The Extract-Transform-Load (ETL) process is applied into data integration and an ETL tool is customized; it has following features: record and display the importing status, import and export status file, read status files and continue what have not been finished during last importing. The whole integration process must make full use of source applications and be extensible to potential requirements in future, so here DW uses NHibernate OR-Mapping to get rid of the confliction of data fields between DW and UI layer and provides data management to resource applications by web services, finally this data consumption process reaches the goal to update data in real time and achieve data consistence in all sources.
Key Words: Data Integration; ETL; Data Warehouse; NHibernate OR-Mapping
The Table of contents
1. Introduction 1
1.1 Thesis background 1
1.2 The research actualities between the domestic and abroad 2
1.3 The course points 3
1.4 The dissertation structure and research contents 3
2. Integration analysis and data analysis 5
2.1 Integration analysis 5
2.1.1 Overview 5
2.1.2 Integration requirement analysis 5
2.1.3 Integration design 7
2.2 Data analysis 8
2.2.1 Overview 8
2.2.2 Database design of source applications 9
2.2.3 Design of data warehouse 11
3. ETL 13
3.1 Overview 13
3.1.1 Concepts of ETL 13
3.1.2 Challenges facing to ETL 14
3.1.3 Related technologies about ETL 16
3.2 Data integration tool 16
3.2.1 Features of data integration tool 16
3.2.2 Design of data integration tool 17
3.2.3 Implementation 17
4. Implementation of data consumption 21
4.1 Requirements of data consumption 21
4.2 Architecture of integrated application 21
4.3 NHibernate OR mapping 22
4.3.1 Introduction to NHibernate 22
4.3.2 Application of NHibernate 23
4.4 Works presentation 25
4.5 Conclusion and prospect 26
Acknowledgments 28
References 29
References
[11] 沈海華.Web Services在企業(yè)應(yīng)用集成中安全的研究[D].上海:上海交通大學(xué),2004.01.
[12] 王逢春.一種基于數(shù)據(jù)集成的EAI解決方案[J].工業(yè)工程與管理,2004,01:14-18.
[13] 劉英丹.基于Web服務(wù)企業(yè)應(yīng)用集成的研究[D].上海:上海交通大學(xué),2004.01.
[14] 朱俊杰.XML在數(shù)據(jù)集成中的應(yīng)用[D].廣州:中山大學(xué),2004.05.
[15] 陳宏.分布異構(gòu)環(huán)境下的數(shù)據(jù)集成方法及實(shí)現(xiàn)[D].上海:上海交通大學(xué),2004.09.
[16] 潘向輝.基于Web Service的企業(yè)應(yīng)用集成的研究與實(shí)現(xiàn)[D].西安:西北大學(xué),2005.05.
[17] 林素美.基于Web Service的軟件構(gòu)件化組裝技術(shù)研究與應(yīng)用[D].上海:復(fù)旦大學(xué),2004.05.
[18] 潘大四.基于XML的異構(gòu)數(shù)據(jù)庫數(shù)據(jù)集成的關(guān)鍵技術(shù)研究[D].重慶:重慶大學(xué)
4.5萬字符 33頁
本資料為英文論文,包括開題報(bào)告和任務(wù)書
摘 要
企業(yè)對(duì)信息技術(shù)的應(yīng)用經(jīng)歷了不同的階段。各階段的應(yīng)用,無論是開發(fā)語言、部署平臺(tái)、通信協(xié)議還是數(shù)據(jù)格式及架構(gòu)都存在較大的差異,如何將企業(yè)內(nèi)部的“信息孤島”聯(lián)系起來,實(shí)現(xiàn)信息的交互和共享,已成為實(shí)現(xiàn)企業(yè)戰(zhàn)略目標(biāo)的必需手段和捷徑。
數(shù)據(jù)集成是企業(yè)應(yīng)用集成的根基,決定著企業(yè)集成的成敗。數(shù)據(jù)集成是將一個(gè)異構(gòu)的,存在沖突的,分散的源數(shù)據(jù)抽取出來,進(jìn)行相應(yīng)的結(jié)構(gòu)和數(shù)據(jù)轉(zhuǎn)換后加載到目標(biāo)系統(tǒng)中的過程。數(shù)據(jù)集成分為三個(gè)步驟:集成分析,數(shù)據(jù)分析,數(shù)據(jù)遷移。
本設(shè)計(jì)的內(nèi)容是以湖南大學(xué)學(xué)生管理系統(tǒng)和公寓管理系統(tǒng)為例,分析系統(tǒng)數(shù)據(jù)來源及相互關(guān)系,總結(jié)公共信息模型,從而設(shè)計(jì)并實(shí)現(xiàn)整合后的數(shù)據(jù)倉庫。本設(shè)計(jì)利用數(shù)據(jù)庫和.NET Framework相關(guān)知識(shí)實(shí)現(xiàn)為源系統(tǒng)定制的ETL工具,將數(shù)據(jù)從源系統(tǒng)中提取出來,經(jīng)過相應(yīng)轉(zhuǎn)換和清洗,最終加載到數(shù)據(jù)倉庫;該工具擁有記錄和顯示數(shù)據(jù)加載的狀態(tài),導(dǎo)入導(dǎo)出狀態(tài)文件,根據(jù)狀態(tài)文件繼續(xù)尚未完成的導(dǎo)庫工作等功能。集成流程必須最優(yōu)利用源系統(tǒng),并對(duì)未來需求可擴(kuò)展,因此本設(shè)計(jì)利用NHibernate實(shí)體映射解決數(shù)據(jù)倉庫中數(shù)據(jù)字段和頁面邏輯層數(shù)據(jù)綁定字段的沖突,以Web服務(wù)提供數(shù)據(jù)倉庫中數(shù)據(jù)的管理,此為數(shù)據(jù)消費(fèi)的過程,目的在于達(dá)成源系統(tǒng)數(shù)據(jù)實(shí)時(shí)更新和一致的目標(biāo)。
關(guān)鍵字:數(shù)據(jù)集成;ETL;數(shù)據(jù)倉庫;NHibernate實(shí)體映射
The Design of Heteromerous Data Integration Based on Web Service
Abstract
Nowadays application of information technologies in enterprises has gone through several phases. No matter from languages to deployment platforms or from communication protocol to data format and schema, systems developed in different phases are diverse from each other. So connecting those isolated data islands, realizing information sharing and communication are the required and express way to achieve strategic goal in enterprise.
The foundation of application integration is data integration, which decides whether the integration will be successful. Data integration extracts data from isomerous, conflicted and isolated sources, transforms data and then loads it into the destination. It has three steps: Integration Analysis, Data Analysis, and Data Transference.
The design uses Hunan University Student MIS and Dormitory MIS as samples, analyzes data resources and their connection, produces the common data model and designs data warehouse. The Extract-Transform-Load (ETL) process is applied into data integration and an ETL tool is customized; it has following features: record and display the importing status, import and export status file, read status files and continue what have not been finished during last importing. The whole integration process must make full use of source applications and be extensible to potential requirements in future, so here DW uses NHibernate OR-Mapping to get rid of the confliction of data fields between DW and UI layer and provides data management to resource applications by web services, finally this data consumption process reaches the goal to update data in real time and achieve data consistence in all sources.
Key Words: Data Integration; ETL; Data Warehouse; NHibernate OR-Mapping
The Table of contents
1. Introduction 1
1.1 Thesis background 1
1.2 The research actualities between the domestic and abroad 2
1.3 The course points 3
1.4 The dissertation structure and research contents 3
2. Integration analysis and data analysis 5
2.1 Integration analysis 5
2.1.1 Overview 5
2.1.2 Integration requirement analysis 5
2.1.3 Integration design 7
2.2 Data analysis 8
2.2.1 Overview 8
2.2.2 Database design of source applications 9
2.2.3 Design of data warehouse 11
3. ETL 13
3.1 Overview 13
3.1.1 Concepts of ETL 13
3.1.2 Challenges facing to ETL 14
3.1.3 Related technologies about ETL 16
3.2 Data integration tool 16
3.2.1 Features of data integration tool 16
3.2.2 Design of data integration tool 17
3.2.3 Implementation 17
4. Implementation of data consumption 21
4.1 Requirements of data consumption 21
4.2 Architecture of integrated application 21
4.3 NHibernate OR mapping 22
4.3.1 Introduction to NHibernate 22
4.3.2 Application of NHibernate 23
4.4 Works presentation 25
4.5 Conclusion and prospect 26
Acknowledgments 28
References 29
References
[11] 沈海華.Web Services在企業(yè)應(yīng)用集成中安全的研究[D].上海:上海交通大學(xué),2004.01.
[12] 王逢春.一種基于數(shù)據(jù)集成的EAI解決方案[J].工業(yè)工程與管理,2004,01:14-18.
[13] 劉英丹.基于Web服務(wù)企業(yè)應(yīng)用集成的研究[D].上海:上海交通大學(xué),2004.01.
[14] 朱俊杰.XML在數(shù)據(jù)集成中的應(yīng)用[D].廣州:中山大學(xué),2004.05.
[15] 陳宏.分布異構(gòu)環(huán)境下的數(shù)據(jù)集成方法及實(shí)現(xiàn)[D].上海:上海交通大學(xué),2004.09.
[16] 潘向輝.基于Web Service的企業(yè)應(yīng)用集成的研究與實(shí)現(xiàn)[D].西安:西北大學(xué),2005.05.
[17] 林素美.基于Web Service的軟件構(gòu)件化組裝技術(shù)研究與應(yīng)用[D].上海:復(fù)旦大學(xué),2004.05.
[18] 潘大四.基于XML的異構(gòu)數(shù)據(jù)庫數(shù)據(jù)集成的關(guān)鍵技術(shù)研究[D].重慶:重慶大學(xué)