EGI’s Infrastructure Manager Empowers Seamless Deployment of Pulsar Endpoints

Sebastian Luna-Valero , Cloud Community Support Specialist at the EGI Foundation, together with colleagues from EuroScienceGateway Project, has spearheaded the development of a novel solution. This solution, presented in the accompanying video, focuses on simplifying the deployment process of Pulsar endpoints in the EGI Federated Cloud, ensuring a seamless experience for users bringing their own compute power to Galaxy.

• Efficiency and Speed: It accelerates the deployment process, enabling users to set up Pulsar endpoints swiftly and efficiently. Time-saving solutions are crucial in research and data processing scenarios.
• Ease of Use: Users can easily configure clusters of virtual machines with HTCondor and Pulsar. This user-friendly approach reduces complexities, making it accessible even to those with limited technical expertise.
• Resource Optimization: The seamless deployment ensures efficient utilization of resources within the EGI Federated Cloud. It optimizes the allocation of computing power, enhancing overall resource management.
• Scalability: Users can scale their computational resources as needed. This flexibility allows for easy expansion or reduction of resources based on varying workloads, ensuring cost-effectiveness and efficiency.
• Enhanced Collaboration: Streamlined deployment fosters collaboration among researchers and teams. It enables seamless sharing and execution of workloads, enhancing collaborative research efforts.
• Research Advancements: Faster and more efficient deployment of Pulsar endpoints facilitates quicker data analysis and processing. This, in turn, accelerates research timelines, leading to more rapid advancements and discoveries

The video demonstrates the utilisation of the Infrastructure Manager Dashboard, showcasing how users can effortlessly deploy and configure clusters of virtual machines equipped with HTCondor and Pulsar. These clusters can seamlessly connect to Galaxy, facilitating the efficient execution of workloads.

To embark on this journey, users are required to possess an EGI Check-in Account, granting access to a Virtual Organization (VO) with ample resources for deploying a virtual cluster of machines featuring HTCondor. In this illustration, the designated VO is vo.usegalaxy.eu. Additionally, users must have previously uploaded the Virtual Galaxy Compute Node image to the cloud, utilizing the vggp-v60-j340 configuration.

Please note that this initiative is continuously evolving, and your valuable feedback is highly encouraged to enhance this solution further. Join us in this collaborative effort towards streamlined and innovative computing solutions.