Stories Tag: machine-learning

Hyperparameter Optimization on Kubernetes With Argo | by David Rosin | idealo Tech Blog | Feb, 2021 | Medium

admin 3 days ago in

Leverage your Kubernetes orchestration tool to tune machine learning models. At idealo, we use Argo Workflows & Pipelines to orchestrate our Kubernetes deployments. As machine learning engineers, we found that Argo is in addition to this main purpose also useful to perform compute-intensive machine learning jobs. This allows us to leverage our cluster’s spare capacity for hyperparameter optimization. Hyperparameter optimization is a way of improving…

Automatic Open Source-based Data Pipelines? Openshift To the Rescue! | by Shon Paz | Feb, 2021 | Medium

admin 1 week ago in

Kubernetes is our new Operating System, no one can doubt that anymore. As a lot of effort has been made, in order to develop a micro-services approach, and migrate workloads towards Kubernetes, organizations left their data services behind. We all saw, due to COVID-19, how important data is, and how important it is to have the proper architecture and data fabric. Data won’t stop from…

Model Deployment in ML: An overview | by Tech in 3 | Feb, 2021 | Medium

admin 1 week ago in

The Cloud Native Computing Foundation (CNCF) found that in 2019 the vast majority of respondents — 84 percent — were running containers in production. That was up roughly 15 percent (or 11 percentage points, from 73) from the previous year. Production container usage was at just 23 percent when CNCF first did its survey in March 2016. As a newbie in “Machine Learning”, it’s always…

Automatic Open Source-based Data Pipelines? Openshift To the Rescue! | by Shon Paz | Feb, 2021 | Medium

admin 1 week ago in

Kubernetes is our new Operating System, no one can doubt that anymore. As a lot of effort has been made, in order to develop a micro-services approach, and migrate workloads towards Kubernetes, organizations left their data services behind. We all saw, due to COVID-19, how important data is, and how important it is to have the proper architecture and data fabric. Data won’t stop from…

Machine Learning em Ambientes Distribuídos: Deploy em Cloud | by Rodrigo Lampier | Feb, 2021 | Medium

admin 2 weeks ago in

Nesse artigo vamos fazer deploy de um modelo de machine learning utilizando o TensorFlow como framework e utilizando o Docker para entregar o modelo como um componente de uma arquitetura de microsserviços. Usaremos o ambiente em nuvem da Google (GCP) para execução da solução. Nosso objetivo é servir um modelo de machine learning para reconhecimento de imagens através de inteligência artificial. Nossa solução solução vai…

RayML using Kubernetes operator. RayML + Kubernetes = Finally, a truly… | by Prasad Paravatha | Feb, 2021 | Medium

admin 2 weeks ago in

RayML + Kubernetes = Finally, a truly scalable Distributed ML solution Background (From Ray website): Ray is an open-source distributed execution framework that makes it easy to scale your applications and to leverage state of the art machine learning libraries. Ray provides a simple, universal API for building distributed applications (supports Python and Java API). I first came across RayML on Software Engineering daily podcast…

On-premise Kubernetes for Machine Learning — A couple Kubelet tips | by Vid Jelen | Feb, 2021 | Medium

admin 3 weeks ago in

When creating an on-premise Kubernetes cluster, one trades the ease of handling a mostly configured cloud-hosted solution, with the power (and responsibility) of a more complex solution, which can be adapted to the specific on-premise requirements. This also requires a relatively deep know-how about networking, storage and compute considerations, but also gives the freedom to tweak and optimize the cluster for specific use-cases — like…

The Potential DevOps Trends in 2021 – Part 1 | Medium

admin 3 weeks ago in

By Shantanu Kaushik DevOps has been evolving rapidly, and the development phase is more than a decade old. DevOps no longer focuses on the developer and operations team. The focus of DevOps has evolved beyond emphasizing continuous delivery and integration. Today, it involves better analytics within a solution to understand what customers need from a solution, removing the constraints between the business solution and customers…

The Potential DevOps Trends in 2021 – Part 2 | Medium

admin 3 weeks ago in

By Shantanu Kaushik In the previous article of the series on DevOps trends to look out for in 2021, we discussed about DevSecOps and how security will greatly influence DevOps practices in 2021. We also talked about how we need to setup the fundamentals for security practices to build upon in the coming decade, or at least half decade. The previous article also mentioned how…

Conditional Kubeflow Pipeline for Dummies | by Prafful Mishra | Data Driven Investor | Feb, 2021 | Medium

admin 4 weeks ago in

This pipeline describes how to use the conditional operator kfp.dsl along with the runtime pipeline argument to branch a pipeline. Kubeflow DSL does not support the use of regular if:else statements to define the pipeline graph. To achieve this we can pass a deciding argument, the value of which defines the flow of execution for the pipeline graph. This is exemplified below using simple functions…