| Author | Rehman, Mariam |
| Call Number | AIT RSPR no.IM-09-01 |
| Subject(s) | Database management
|
| Note | A research study submitted in partial fulfillment of the requirements for the degree of Master of Engineering Information Management, School of Engineering and Technology |
| Publisher | Asian Institute of Technology |
| Series Statement | Research studies project report ; no. IM-09-01 |
| Abstract | Many organizations collect large amounts of data to support their business and decision making processes. The data collected from various sources may have data quality problems in it. These kinds of issues become prominent when various databases are integrated. The integrated databases inherit the data quality problems that were present in the source database. The data in the integrated systems need to be cleaned for proper decision making. Cleansing of data is one of the most crucial steps. In this research, focus is on one of the major issue of data cleansing i.e. "duplicate record detection" which arises when the data is collected from various sources. As a result of this research study, comparison among standard duplicate detection algorithm, sorted neighborhood algorithm, duplicate elimination sorted neighborhood algorithm, and adaptive duplicate detection algorithm is provided. A prototype is also developed which shows that adaptive duplicate detection algorithm is the optimal solution for the problem of duplicate record detection |
| Year | 2009 |
| Corresponding Series Added Entry | Asian Institute of Technology. Research studies project report ; no. IM-09-01 |
| Type | Research Study Project Report (RSPR) |
| School | School of Engineering and Technology (SET) |
| Department | Department of Information and Communications Technologies (DICT) |
| Academic Program/FoS | Information Management (IM) |
| Chairperson(s) | Vatcharaporn Esichaiku; |
| Examination Committee(s) | Vilas Wuwongse;Jenecek, Paul; |
| Scholarship Donor(s) | Higher Education Commission ( HEC), Pakistan; |
| Degree | Research Studies Project Report (M.Eng.) - Asian Institute of Technology, 2009 |