One of my main languages for professional software-development. Capable of designing & writing scalable, testable, and maintainable software.
Solid experience with Spark for batch-processing (ETL, Machine-Learning) as well as (structured) streaming together with technologies such as Hive and Kafka.
Sound understanding of deploying and managing application on Kubernetes and OpenShift. Worked on cloud-based and on-premise K8s-Clusters and deployed applications using Helm.
Early adopter since v1.8.x. Capable of deploying Airflow using different Executors, developing complex DAGs and custom Operators and extending Airflow (f.e. the UI) to the customers need. Sound understanding of the Do´s and Dont´s for Airflow.
Using Kafka to process large realtime-streaming datasets and to build event-driven applications. Capable of managing the underlying infrastructure and intermediate understanding of different formats and the usage of schemas & schema evolution (Avro, Protobuf).
Capable of logging and monitoring applications with Elasticsearch, Logstash/Filebeat and Kibana. Basic knowledge in the setup of the infrastructure.
Writing programs as dockerized container(s). Experienced with build-processes, core concept of containerization and optimization techniques (f.e. reducing images sizes).
I´ve worked with frameworks such as Django and Flask to build APIs and Websites, worked in projects using TS/JS-Frameworks such as Angular and Webservers such as Gunicorn, Nginx and Apache HTTP.
Day-to-day operating-system. Capable of writing shell scripts, Init-Scripts and analyzing logs & essential system-metrics. Basic understanding of the Linux Internals.