Story Tag: engineering

Stories Tag: engineering

Embarking on the journey to a microservice architecture | by RepTrak | RepTrak Insiders | Oct, 2020 | Medium

admin 1 week ago in

We are a company with over 20 years in the business of giving intelligence and insights to protect and improve the reputation of hundreds of companies across the world. We provide a trustworthy data-driven framework using Big Data tooling that helps company leaders to know how their company is being perceived. For the last 10 years, microservice architecture has been a trending topic among engineering…

A Trip Down the DNS Rabbit Hole: Understanding the Role of Kubernetes, Golang, libc, systemd | by Ethan Goldblum |...

admin 2 weeks ago in

Kubernetes powers much of the compute infrastructure at Box. As more and more applications and services have moved to our Kubernetes platform, we’ve invested in tools to make debugging, validating service correctness, and responding to incidents easier for Box developers. One such tool is Comcast’s Kuberhealthy, a framework for synthetic monitoring in Kubernetes. Kuberhealthy introduces a controller and a CRD to define a Pod spec…

Project Ceylon III: Deploy อย่างไร้กังวลด้วย Auto Rollback | by Manatsawin Hanmongkolchai | Oct, 2020 | [email protected] MAN Wongnai

admin 2 weeks ago in

ยังอยู่กับ Kubernetes รุ่นถัดไปของ LINE MAN Wongnai ครับ ในตอนนี้ผมขอแนะนำของเล่นถัดไปของเราคือ Canary Analysis ซึ่งเราใช้งานใน Production มาตั้งแต่ต้นปีแล้ว ใน Kubernetes การ deploy application โดยทั่วไปเราจะทำแบบ rolling deployment คือเปิด pod เวอร์ชั่นใหม่ 1 ตัว แล้วปิด pod เก่าออก 1 ตัว ทำซ้ำไปเรื่อยๆ จนครบทุกตัว วิธีนี้จะทำให้ไม่เกิด downtime เพราะจะมีเครื่องพร้อมรับ Traffic อยู่ตลอดเวลา แต่ถ้าเราทำวิธีนี้ไปกลางทาง คือพอมีเครื่องใหม่สัก 10% แล้วหยุดทำต่อ วิธีนี้เรียกว่า Canary deployment ซึ่งข้อดีคือหากโปรแกรมเวอร์ชั่นใหม่มีบั๊กแล้ว user เพียงส่วนน้อยจะได้รับผลกระทบและเราอาจจะ rollback แต่ถ้าหากไม่มีบั๊กอะไรเราก็ค่อยๆ ทำต่อไปจนครบทุก pod ในบทความนี้เราจะแนะนำโปรแกรม Argo Rollouts ซึ่งทำให้การทำ Canary analysis ทำได้ง่ายขึ้นไม่ต้องทำขั้นตอนใน CD pipeline ให้ยุ่งยาก Argo Rollout เป็น…

Podcast: Give the Developers the Keys to Production — Oded Ben Ozer (Hebrew) | by Riskified Technology | Riskified Technology...

admin 2 weeks ago in

As a developer, making configuration changes that are not part of the code (such as Scale Up, Scale Down, changes in the running environment, etc.) may force you to contact the SRE team and ask them to do it for you. This can be ok, but only until the company grows, more developers are joining, and a bottleneck is starting to create. This is the…

Deploying MetalLB In Production. MetalLB is a software load-balancer for… | by BenevolentAI Engineering | Sep, 2020 | Medium

admin 1 month ago in

The problem‍ At Benevolent we run a bare-metal Kubernetes cluster for our GPU-based workloads. The production cluster consists of GPU and CPU nodes. In addition to the GPU workloads we have various microservices, databases and data lakes that we need to expose to internal teams. To expose these we deployed NGINX ingress controller (https://github.com/kubernetes/ingress-nginx) as a daemonset across all nodes in the cluster exposed as…

The journey of deploying Apache Airflow at Grab | by Grab | Sep, 2020 | Medium

admin 2 months ago in

At Grab, we use Apache Airflow to schedule and orchestrate the ingestion and transformation of data, train machine learning models, and the copy data between clouds. There are many engineering teams at Grab that use Airflow, each of which originally had their own Airflow instance. The proliferation of independently managed Airflow instances resulted in inefficient use of resources, where each team ended up solving the…

Video: Big Data on Kubernetes – Make It Flow (Hebrew) | by Riskified Technology | Riskified Technology | Aug, 2020...

admin 2 months ago in

Apache Airflow is a leading framework for managing data workflows. It’s pretty good out of the box, but we think running it on K8s makes it even better! It takes out the tedious work and lets you focus on orchestrating and scheduling pipelines.In this talk, Lior shares our story of how we chose and deployed Airflow on k8s, the challenges we faced along the way,…

A Self-hosted external DNS resolver for Kubernetes. | by The Edgehogs | Aug, 2020 | Medium

admin 2 months ago in

There comes a time in the life of every Kubernetes cluster when internal resources (pods, deployments) need to be exposed to the outside world. Doing so from a pure IP connectivity perspective is relatively easy as most of the constructs come baked-in (e.g. NodePort-type Services) or can be enabled with an off-the-shelf add-on (e.g. Ingress and LoadBalancer controllers). In this post, we’ll focus on one…