Institutional Repository of Computer Application Research Laboratory
| 3DT-CM: A Low-complexity Cross-matching Algorithm for Large Astronomical Catalogues Using 3d-tree Approach | |
Mu, Yifei1,2; Yu, Ce1,2; Sun, Chao1,2; Li, Kun1,2; Zhang, Yajie1,2; Wei, Jizeng1,2; Xiao, Jian1,2; Wang, Jie3
| |
| 2023-10-01 | |
| Source Publication | RESEARCH IN ASTRONOMY AND ASTROPHYSICS
 |
| ISSN | 1674-4527 |
| Volume | 23Issue:10Pages:105011 |
| Contribution Rank | 3 |
| Abstract | Location-based cross-matching is a preprocessing step in astronomy that aims to identify records belonging to the same celestial body based on the angular distance formula. The traditional approach involves comparing each record in one catalog with every record in the other catalog, resulting in a one-to-one comparison with high computational complexity. To reduce the computational time, index partitioning methods are used to divide the sky into regions and perform local cross-matching. In addition, cross-matching algorithms have been adopted on high-performance architectures to improve their efficiency. But the index partitioning methods and computation architectures only increase the degree of parallelism, and cannot decrease the complexity of pairwise-based cross-matching algorithm itself. A better algorithm is needed to further improve the performance of cross-matching algorithm. In this paper, we propose a 3d-tree-based cross-matching algorithm that converts the angular distance formula into an equivalent 3d Euclidean distance and uses 3d-tree method to reduce the overall computational complexity and to avoid boundary issues. Furthermore, we demonstrate the superiority of the 3d-tree approach over the 2d-tree method and implement it using a multi-threading technique during both the construction and querying phases. We have experimentally evaluated the proposed 3d-tree cross-matching algorithm using publicly available catalog data. The results show that our algorithm applied on two 32-core CPUs achieves equivalent performance than previous experiments conducted on a six-node CPU-GPU cluster. |
| Keyword | methods: data analysis catalogs techniques: miscellaneous |
| DOI | 10.1088/1674-4527/acee50 |
| Indexed By | SCI |
| Language | 英语 |
| WOS Keyword | IDENTIFICATION ; FRAMEWORK ; EFFICIENT |
| Funding Project | This work is supported by the National Key Research and Development Program of China (2022YFF0711502), the National Natural Science Foundation of China (NSFC) (12273025 and 12133010). Data resources are supported by China National Astronomical Data Center[2022YFF0711502] ; National Key Research and Development Program of China[12273025] ; National Key Research and Development Program of China[12133010] ; National Natural Science Foundation of China (NSFC) ; Chinese Virtual Observatory (China-VO) |
| WOS Research Area | Astronomy & Astrophysics |
| WOS Subject | Astronomy & Astrophysics |
| WOS ID | WOS:001072142900001 |
| Publisher | NATL ASTRONOMICAL OBSERVATORIES, CHIN ACAD SCIENCES |
| Funding Organization | This work is supported by the National Key Research and Development Program of China (2022YFF0711502), the National Natural Science Foundation of China (NSFC) (12273025 and 12133010). Data resources are supported by China National Astronomical Data Center ; National Key Research and Development Program of China ; National Natural Science Foundation of China (NSFC) ; Chinese Virtual Observatory (China-VO) |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://ir.xao.ac.cn/handle/45760611-7/5516 |
| Collection | 计算机技术应用研究室 |
| Corresponding Author | Wei, Jizeng |
| Affiliation | 1.Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China 2.Natl Astron Data Ctr, Tech R&D Innovat Ctr, 135 Yaguan Rd, Tianjin 300350, Peoples R China 3.Chinese Acad Sci, Xinjiang Astron Observ, Urumqi 830011, Peoples R China |
| Recommended Citation GB/T 7714 | Mu, Yifei,Yu, Ce,Sun, Chao,et al. 3DT-CM: A Low-complexity Cross-matching Algorithm for Large Astronomical Catalogues Using 3d-tree Approach[J]. RESEARCH IN ASTRONOMY AND ASTROPHYSICS,2023,23(10):105011. |
| APA | Mu, Yifei.,Yu, Ce.,Sun, Chao.,Li, Kun.,Zhang, Yajie.,...&Wang, Jie.(2023).3DT-CM: A Low-complexity Cross-matching Algorithm for Large Astronomical Catalogues Using 3d-tree Approach.RESEARCH IN ASTRONOMY AND ASTROPHYSICS,23(10),105011. |
| MLA | Mu, Yifei,et al."3DT-CM: A Low-complexity Cross-matching Algorithm for Large Astronomical Catalogues Using 3d-tree Approach".RESEARCH IN ASTRONOMY AND ASTROPHYSICS 23.10(2023):105011. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| Mu-2023-3DT-CM_ A Lo（1115KB） | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Application Full Text | |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment