Institutional Repository of Computer Application Research Laboratory
| 基于容器的脉冲星数据处理软件部署与测试 | |
| Alternative Title | Deployment and Testing of Pulsar Data Processing Software Based on Container |
冶鑫晨1,2,4 ; 张海龙1,2,3,4; 王杰1,2,4; 张萌1,2; 张亚州1,2; 王万琼1; 李嘉1; 杜旭1,2
| |
| 2023-03-01 | |
| Source Publication | 天文研究与技术
 |
| ISSN | 1672-7673 |
| Volume | 20Issue:2Pages:154-164 |
| Contribution Rank | 1 |
| Abstract | 随着天文观测技术的飞速发展，天文数据处理软件日趋复杂，天文数据处理环境的部署与管理日渐繁琐。利用容器技术将脉冲星数据处理环境封装成容器镜像并建立私有镜像库，科研人员可以根据数据处理需求选择镜像，实现数据处理环境的快速部署。利用实体计算机、虚拟机和容器中对脉冲星基带数据进行相干消色散处理，对比不同平台的资源利用率与数据处理效率。实验结果表明，容器的性能与实体计算机相近；在多任务并发的数据处理测试中，容器的资源分配更加合理，相较虚拟机可以提高计算资源利用效率。在新疆天文台脉冲星数据处理服务器上实现了基于容器的数据处理架构部署，设计并开发了容器管理图形用户界面，通过优化多用户登录、身份验证、数据卷挂载管理等功能，提高利用容器技术进行天文数据处理的效率。 |
| Other Abstract | With the rapid development of astronomical observation technology, astronomical data processing software has become increasingly complex, and it is challenging to deploy the software environment. Container technology is used for packaging the pulsar data processing environment to images by applying hierarchical encapsulation. According to the data processing requirements, a private library of images is established, and the users can select the images according to the data processing mode. The hardware environment, the traditional virtual machine environment, and the container environment perform coherent dedispersion for pulsar baseband data. The resource utilization and data processing efficiency of different platforms are compared. Experimental results show that the performance of the container is similar to the physical machine. In multi-threaded parallel processing, the resource allocation of the container is more reasonable and can improve the efficiency of service resource utilization. The container-based data processing architecture is implemented on Xinjiang Astronomical Observatory pulsar data processing server, and the container management graphical user interfaces are designed and developed. Through optimizing functions such as multiuser login, authentication and data volume mount, the efficiency of astronomical data processing using container technology is improved. |
| Keyword | 脉冲星 数据处理 容器 虚拟化 |
| DOI | 10.14005/j.cnki.issn1672-7673.20230118.003 |
| URL | 查看原文 |
| Indexed By | CSCD |
| Language | 中文 |
| CSCD ID | CSCD:7442096 |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://ir.xao.ac.cn/handle/45760611-7/6637 |
| Collection | 计算机技术应用研究室 110米口径全可动射电望远镜（QTT）_技术成果 |
| Corresponding Author | 张海龙 |
| Affiliation | 1.中国科学院新疆天文台; 2.中国科学院大学; 3.国家天文科学数据中心; 4.中国科学院射电天文重点实验室 |
| First Author Affilication | Xinjiang Astronomical Observatory, Chinese Academy of Sciences |
| Corresponding Author Affilication | Xinjiang Astronomical Observatory, Chinese Academy of Sciences |
| Recommended Citation GB/T 7714 | 冶鑫晨,张海龙,王杰,等. 基于容器的脉冲星数据处理软件部署与测试[J]. 天文研究与技术,2023,20(2):154-164. |
| APA | 冶鑫晨.,张海龙.,王杰.,张萌.,张亚州.,...&杜旭.(2023).基于容器的脉冲星数据处理软件部署与测试.天文研究与技术,20(2),154-164. |
| MLA | 冶鑫晨,et al."基于容器的脉冲星数据处理软件部署与测试".天文研究与技术 20.2(2023):154-164. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| 冶鑫晨-2023-基于容器的脉冲星数据处（1867KB） | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Application Full Text | |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment