Imagine a typical situation – yesterday your devops engineer was eaten by a tiger. You a very sad because he didn’t finish the release system for your project. It contains 4 repositories: 2 back-end, 1 front-end, 1 data pipeline. And now it is you who should set up a deploy pipeline for your project tomorrow. …
I would like to introduce a new tool for end-to-end testing – Catcher. What is an e2e test? End-to-end test usually answers the questions like: “Was this user really created, or service just returned 200 without any action?”. In comparison with project level tests (unit/functional/integration) e2e runs against the whole system. They can call your …
The topic I’d like to reveal in this article may seem obvious, but I was surprised how many companies don’t follow this best practice. For impatient: Automate every action you’ve done more than once. Don’t use Jenkins static groovy library. Use Jenkins + Ansible + Python for automation. The problem Any developer in his work …
The best way to familiarize yourself with Hadoop ecosystem or to do POC is to play with it in a sandbox. For that Cloudera provides 2 Quick Start options: one is the image for VirtualMashine and another is the Docker image. Both of them contain a small CDH cluster with one DataNode. But this is …
I’ve got a legacy service, written in Scala. Stack was: Play2, Scala, Slick, Postgres. Here is described why such technology stack is not the best option, what should be done to make it work better with less efforts and how to avoid underwater rocks. For impatient: If you have choice – don’t use Slick. If …
Recently I’ve finished another back-end with GraphQL, but now on Python. In this article I would like to tell you about all difficulties I’ve faced and narrow places which can affect the performance. Technology stack: graphene + flask and sqlalchemy integration. Here is a piece of requirements.txt: graphene graphene_sqlalchemy flask flask-graphql flask-sqlalchemy flask-cors injector flask-injector …
Consider the following situation: A bundle of .avro files is stored on HDFS. They need to be converted to Impala tables. Schemas are not provided with files, at least not externally (it’s contained as first line of any avro file). But Impala has a known-issue with avro tables, and its usage is pretty limited: we …
In this article I’ll describe you how to use GraphQL with Spring with this library. Full example is available here. Why annotations? From my point of view schema should not be written manually, just because it is easy to make a mistake. Schema should be generated from code instead. And your IDE can help you …
In this guide you’ll learn how to add deploy feature to the Erlang service. As a result you will get a real Erlang service, with logs in /var/log/example_service, systemd support and possibility to easy install it on every system via enot install comtihon/example_service even without Erlang installed!
This is step-by-step guide on how to create your Erlang service with the powerful Enot build system. Ensure you have Enot and Erlang installed locally. As a result you will build http service, which will listen the 8080 port and response JSON with service’s version and MAGIC_GREETING operation system’s environment variable or simple “hello world” …