Directio Sp. z o.o. logotype

This website uses cookies to ensure you get the best experience.

Directio Sp. z o.o. and our selected partners use cookies and similar technologies (together “cookies”) that are necessary to present this website, and to ensure you get the best experience of it. If you consent to it, we will also use cookies for analytics and marketing purposes.

See our Cookie Policy to read more about the cookies we set.

You can withdraw and manage your consent at any time, by clicking “Manage cookies” at the bottom of each website page.

Select which cookies you accept

On this site, we always set cookies that are strictly necessary, meaning they are necessary for the site to function properly.

If you consent to it, we will also set other types of cookies. You can provide or withdraw your consent to the different types of cookies using the toggles below. You can change or withdraw your consent at any time, by clicking the link “Manage Cookies”, which is always available at the bottom of the site.

To learn more about what the different types of cookies do, how your data is used when they are set etc, see our Cookie Policy.

These cookies are necessary to make the site work properly, and are always set when you visit the site.

Vendors Teamtailor

These cookies collect information to help us understand how the site is being used.

Vendors Teamtailor

These cookies are used to make advertising messages more relevant to you. In some cases, they also deliver additional functions on the site.

Vendors Meta
Skip to main content
Backend Department · Warsaw · Fully Remote

Scala / Spark Developer - Remote Work Type

Spark / Scala Developer for Global IT outsourcing firm, Remote, 28 500 - 30 000 PLN + VAT on B2B

We are looking for a Scala/Spark Developer to join an AI-first software engineering company delivering innovative AI, data, cloud, and IoT solutions for clients across Europe and beyond. As part of the engineering team, you will design, develop, and optimize scalable data processing solutions, build high-performance distributed systems, and work with modern big data technologies on challenging international projects.

Responsibilities

  • Design, develop, and maintain scalable data processing applications using Scala and Apache Spark;

  • Build, optimize, and maintain ETL/ELT pipelines processing large volumes of data;

  • Develop efficient Spark applications using Spark SQL and the DataFrame/Dataset API;

  • Optimize Spark jobs by improving partitioning strategies, shuffle operations, caching, and join performance;

  • Troubleshoot and resolve performance issues using Spark UI and monitoring tools;

  • Collaborate with data engineers, software developers, and stakeholders to design scalable data processing solutions;

  • Participate in code reviews and contribute to software quality, performance, and engineering best practices.

Requirements

  • Strong commercial experience developing production applications in Scala, including functional programming concepts (immutability, pattern matching, higher-order functions), Scala type system, collections, sbt, and testing frameworks such as ScalaTest or munit, with the ability to write clean, maintainable, production-quality code;

  • Proven hands-on experience with Apache Spark, including Spark SQL, DataFrame/Dataset API, designing and maintaining ETL/ELT pipelines, performance optimization (partitioning, shuffle optimization, broadcast joins, caching), and troubleshooting using Spark UI;

  • Experience working in production environments with large-scale data processing and distributed data pipelines;

  • Strong understanding of software engineering best practices, code quality, performance optimization, and maintainability.

Nice to have

  • Experience with Kafka and Spark Structured Streaming;

  • Experience with Airflow or similar workflow orchestration tools;

  • Experience with cloud platforms such as AWS (EMR, S3, Glue), Azure, GCP (Dataproc), or Databricks;

  • Knowledge of the big data ecosystem, including Hadoop, Hive, Delta Lake, Parquet, and Avro;

  • Experience with SQL, data modeling, data warehouses, and data lake architectures;

  • Experience with Docker, Kubernetes, Git, and CI/CD pipelines;

  • Familiarity with Scala libraries such as Cats, ZIO, Akka, or Pekko;

  • Knowledge of Python or Java.

We offer

  • B2B salary: 28 500 -30 000 PLN + VAT;

  • Flexible working conditions;

  • Private healthcare, Multisport card, and professional training opportunities.

Please be advised that we will only contact selected candidates
Department
Backend Department
Locations
Warsaw
Remote status
Fully Remote

Warsaw

About Directio Sp. z o.o.

Directio is a global IT services company. We consult, code, test, deploy, and manage mainly cloud-based and mobile applications, providing around-the-clock support from our offices in Poland, the Philippines, Mexico, and the USA. We prepare our FMCG, retail, automotive, and SaaS clients for the future by accelerating their digital transformation. Operating under the “We Code Success” principle, we prioritize the success of our clients, consultants, and partners. 

Founded in 1998
Co-workers ~150
Backend Department · Warsaw · Fully Remote

Scala / Spark Developer - Remote Work Type

Spark / Scala Developer for Global IT outsourcing firm, Remote, 28 500 - 30 000 PLN + VAT on B2B

Loading application form

Already working at Directio Sp. z o.o.?

Let’s recruit together and find your next colleague.

@directio.com
Applicant tracking system by Teamtailor