Belitsoft > LAUNCH YOUR CAREER > Java/Scala Data Engineer

Java/Scala Data Engineer

Responsibilities:

  • Be part of the global team building data platform to support gaming tenants.
  • Build and deploy scalable and reliable data processing pipelines to move and aggregate large amounts of data.
  • Develop internal products, frameworks and infrastructures.
  • Tune and optimize data applications architecture to reach real-time capabilities.
  • Promote best practices coding, code complete standards, and design patterns.
  • Champion the overall strategy for data governance, security, and quality that ensure
  • requirements are met.

Requirements:

  • Passion for data engineering, quality, automation and efficiency, self-starter, loves challenges, independent and a tech savvy;
  • Proficient in Java/Scala with +3 years of experience in writing Spark based batch and streaming data applications (Streaming\Structured Streaming\SparkSQL);
  • Strong understanding of the Hadoop ecosystems (especially Kafka, hdfs, Zookeeper, Yarn, ORC, Parquet, Hive) and related technologies with +2 years of experience;
  • Strong working knowledge of SQL or SQL-like data management languages with +3 years of experience;
  • Strong Linux knowledge with bash scripting experience.
  • English (both spoken & written).
  • Must be a quick and capable learner.

ADVANTAGES FOR:

  • Advanced knowledge in parallel processing algorithms and techniques.
  • Knowledge in advanced BigData topics and distributed computing.
  • Knowledge in K8s, Docker, DeltaLake, DataMesh, Aerospike, AirFlow, Redis, Vertica
  • Familiarity with data warehousing concepts and systems.

Benefits:


Apply for this job
Fill in the fields

*Maximum file size is 20 mb. Formats are PDF, PNG, JPG, DOCX

Join our team

Belitsoft. Software Development Company

Similar vacancies

Java Developer

We have a project which is related to a global provider of leading innovative network intelligence and security solutions for Service Providers and Enterprises worldwide.

Scrum Master

We have a really huge project with a client from Israel who is a global provider of leading innovative network intelligence and security solutions for Service Providers and Enterprises worldwide.

Mathematic/Statistics oriented Researcher experienced with Python

An established industry leader in network intelligence and security solutions for service providers and enterprises around the world. We believe in giving our Tier-1 customers around the world real value by offering them cutting-edge solutions that make their networks smarter and their users more secure.

to top