Mastering Technical Communication: Overcoming Challenges
Kate BelovaHave you ever felt like banging your head over the wall of misunderstanding or lack of wording to describe a technical solution and prove your point of view? Oh my,…
Expect unexpected
It was a super early and gloomy autumn morning, and Mother was packing me for the school trip to a day of forest camping. I was still only half awake…
DataOps: Code of Conduct
I'm often asked what DataOps is and how to be effective in it. DataOps is a relatively new term that refers to the practice of applying DevOps principles to data…
HowTo: Apache Airflow with Docker on Linux
Here's a guide to setting up Apache Airflow with Docker on a Linux machine, with shared DAGs and plugins folder, extra plugins, specific Python packages on Airflow workers, and a…
HowTo: install Apache Airflow with Rancher Desktop (MacOS)
Setting up Apache Airflow on macOS using Rancher Desktop involves several steps. In this guide, we'll walk you through installing Rancher Desktop, deploying a Kubernetes cluster, and deploying Airflow using…
Harnessing the Power of GraphQL and Python for Modern API Development
ValIn today's fast-paced digital landscape, efficient API development is more critical than ever. GraphQL, a powerful query language developed by Facebook, has gained immense popularity for its ability to optimize…
End-to-end from frontend to backend with Catcher
Today Catcher's external modules 5.1.0 were finally released. Great news, everyone, as it adds a Selenium step for Frontend testing! What should a proper e2e test look like? Imagine you have a user service…
Testing Airflow data pipelines with Catcher end to end
This article is about writing end-to-end test for a data pipeline. It will cover Airflow, as one of the most popular data pipeline scheduler now days and one of the…
Catcher e2e tests tool for beginners
What is Catcher? It is an end-to-end test tool, specially designed to test systems containing many components. Initially developed as end-to-end microservices test tool it perfectly fits needs of data…
Rollback for microservices with Ansible and Jenkins
Imagine your project consists of 4 microservices (3 backends, 1 frontend). Yesterday you introduced several new features and made a release. Unfortunately, your users have just reported a bug. Some…
Microservices and continuous delivery
Imagine a typical situation – yesterday your devops engineer was eaten by a tiger. You a very sad because he didn’t finish the release system for your project. It contains…
End-to-end microservices testing with Catcher
I would like to introduce a new tool for end-to-end testing – Catcher. What is an e2e test? End-to-end test usually answers the questions like: “Was this user really created,…
Ansible and Jenkins – automate your scritps
The topic I’d like to reveal in this article may seem obvious, but I was surprised how many companies don’t follow this best practice. For impatient: Automate every action you’ve…
HowTo: Run Cloudera Quickstart in Docker
The best way to familiarize yourself with the Hadoop ecosystem or to do proof of concept: is to play with it in a sandbox. Cloudera provides 2 Quick Start options:…
Scala as backend language. Tips, tricks and pain
I’ve got a legacy service, written in Scala. Stack was: Play2, Scala, Slick, Postgres. Here is described why such technology stack is not the best option, what should be done…
Python & GraphQL. Tips, tricks and performance improvements.
Recently I’ve finished another back-end with GraphQL, but now on Python. In this article I would like to tell you about all difficulties I’ve faced and narrow places which can…
How to create avro based table in Impala
Consider the following situation: A bundle of .avro files is stored on HDFS. They need to be converted to Impala tables. Schemas are not provided with files, at least not…
GraphQL with Spring: Query and Pagination
In this article I’ll describe you how to use GraphQL with Spring with this library. Full example is available here. Why annotations? From my point of view schema should not…
Erlang service easy deploy with Enot
In this guide you’ll learn how to add deploy feature to the Erlang service. As a result you will get a real Erlang service, with logs in `/var/log/example_service`, systemd support…
Create Erlang service with Enot
This is step-by-step guide on how to create your Erlang service with the powerful Enot build system. Ensure you have Enot and Erlang installed locally. As a result you will…