-
Job Description
Sr Java Spark Developer
This is with a large IT services firm for a major US based bank.
Candidate must have legal work status for Canada.
Client Location is Mississauga, Ontario
Hybrid - In-Office 3 days per week.
Perm/FT role, salary and benefits OR Contract (6 months to start)
Market rate
Profile
We are looking for a talented and experienced Java Spark Developer to join our dynamic team. As a Java Spark Developer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable applications using Java and Apache Spark. You will work on data-intensive projects, leveraging the power of Spark for large-scale data processing and analytics.
Keys: Java, Apache Spark, data streaming
Responsibilities:
Design, develop, and maintain Java applications leveraging Apache Spark for distributed data processing and analytics.
Collaborate with data engineers and data scientists to implement data pipelines, ETL processes, and machine learning workflows using Spark.
Optimize and tune Spark jobs to ensure efficient utilization of computing resources and high throughput for data processing tasks.
Integrate Java applications with Spark clusters, leveraging Spark's APIs and libraries for data manipulation, transformation, and analysis.
Develop and deploy real-time and batch processing applications using Spark Streaming and Spark SQL for data ingestion and analysis.
Implement data caching, partitioning, and parallel processing techniques to optimize Spark job performance and resource utilization.
Work with cloud-based platforms and big data technologies to deploy and manage Spark-based applications in distributed environments.
Collaborate with cross-functional teams to understand business requirements, data models, and analytics use cases, and implement relevant solutions using Spark.
Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Java Developer with hands-on experience in Apache Spark for data processing and analytics.
Strong proficiency in Java programming language with a focus on scalable and distributed systems.
Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries.
Knowledge of big data technologies such as Hadoop, HDFS, and distributed computing frameworks for large-scale data processing.
Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying and managing Spark applications.
Strong understanding of data structures, algorithms, and database technologies for data manipulation and analytics.
Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Experience with Agile development methodologies and tools (e.g., JIRA, Git) is preferred.
Certification in Apache Spark or related big data technologies is advantageous.
#J-18808-Ljbffr
This is with a large IT services firm for a major US based bank.
Candidate must have legal work status for Canada.
Client Location is Mississauga, Ontario
Hybrid - In-Office 3 days per week.
Perm/FT role, salary and benefits OR Contract (6 months to start)
Market rate
Profile
We are looking for a talented and experienced Java Spark Developer to join our dynamic team. As a Java Spark Developer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable applications using Java and Apache Spark. You will work on data-intensive projects, leveraging the power of Spark for large-scale data processing and analytics.
Keys: Java, Apache Spark, data streaming
Responsibilities:
Design, develop, and maintain Java applications leveraging Apache Spark for distributed data processing and analytics.
Collaborate with data engineers and data scientists to implement data pipelines, ETL processes, and machine learning workflows using Spark.
Optimize and tune Spark jobs to ensure efficient utilization of computing resources and high throughput for data processing tasks.
Integrate Java applications with Spark clusters, leveraging Spark's APIs and libraries for data manipulation, transformation, and analysis.
Develop and deploy real-time and batch processing applications using Spark Streaming and Spark SQL for data ingestion and analysis.
Implement data caching, partitioning, and parallel processing techniques to optimize Spark job performance and resource utilization.
Work with cloud-based platforms and big data technologies to deploy and manage Spark-based applications in distributed environments.
Collaborate with cross-functional teams to understand business requirements, data models, and analytics use cases, and implement relevant solutions using Spark.
Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Java Developer with hands-on experience in Apache Spark for data processing and analytics.
Strong proficiency in Java programming language with a focus on scalable and distributed systems.
Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries.
Knowledge of big data technologies such as Hadoop, HDFS, and distributed computing frameworks for large-scale data processing.
Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying and managing Spark applications.
Strong understanding of data structures, algorithms, and database technologies for data manipulation and analytics.
Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Experience with Agile development methodologies and tools (e.g., JIRA, Git) is preferred.
Certification in Apache Spark or related big data technologies is advantageous.