DEV Community

Cover image for Running DeepCell on Google Batch with node pools
David Haley
David Haley

Posted on

Running DeepCell on Google Batch with node pools

#googlecloud #serverless #bioinformatics #scale

As part of our ongoing work to run DeepCell on GCP, I'm pleased to share our benchmarking results using Google Batch's private preview feature: node pools.

Node pools allow Batch to reuse infrastructure across jobs, which can improve end-to-end performance for jobs with a lot of setup time (like our 3 GB container). Using a node pool reduced our benchmark time by 80%. 😎

https://medium.com/@dchaley/running-deepcell-on-google-batch-with-node-pools-8fe7d1c121a2

Top comments (0)

Read next

thomasy0ung profile image

Quick Guide on How to Create a Project Timeline in Excel

Thomas H. Young -

rigalpatel001 profile image

Advanced JavaScript Patterns: Unlocking the Power of Mixins, Factories, and Services

Rigal Patel -

sriramsridhar profile image

HOCON - secret behind .conf files

sriram sridhar -

gihan_kavinda_f10ec06d0a8 profile image

I’m running a Spring Boot application inside a Docker container on my VM. The application works fine over HTTP, and I can access all endpoints via http://127.0.0.1:8080. I’ve set up NGINX as a reverse proxy to serve HTTPS requests. No errors for http reqs.

Gihan Kavinda -