Senior Software Engineer

DualbirdHaifa

SeniorHybridFull-timeSoftware engineering

Apply on the employer’s site

Confirmed open at the employer yesterday · Posted 7 days ago

Listing published by its original source and linked back to it. The employer did not pay JobsWarm for this listing.

Nice to have

performance optimizationalgorithmsawsemrs3ec2pythonscala

Job description

Description

Role Overview

As a Software Engineer, you will be responsible for developing software frameworks, drivers, and tools that accelerate open-source big data processing frameworks on custom hardware accelerators. Your work will focus on enabling and optimizing large-scale data processing workloads in tailor-made cloud environments, ensuring seamless integration with AWS-based data processing services. You will develop and optimize software stacks, implement benchmarking, debugging, and performance analysis tools, and evaluate acceleration gains to enhance efficiency and performance in cloud-based data platforms.

Requirements

Qualifications & Skills

Required Qualifications:

Bachelor's degree in Computer Science, Electrical Engineering, or a related field from a leading university.
5+ years of experience in software development, focusing on high-performance computing.

Preferred Qualifications:

Experience in runtime system development and low-level performance optimization.
Strong background in debugging complex system environments.
Experience implementing and optimizing multi-threaded algorithms.
Solid understanding of columnar storage formats (e.g., Parquet) and their impact on query performance.
Familiarity with AWS cloud services, including AWS EMR, S3, and EC2.
Proficiency in Python or Scala for data processing and system development.
Familiarity with hardware accelerators.

Listing published by its original source and linked back to it. JobsWarm does not receive payment from employers.