Data Engineer - Epsilon Solutions Ltd.
  • N/A, Other, Canada
  • via Jobleads.com
-
Job Description

b) Technical Expertise

  • Proven experience converting SAS EG code to PySpark, SQL, and/or R
  • Familiarity with SAS macros, data steps, and PROC SQL
  • Experience with Databricks notebooks, Delta Lake, and Spark SQL
  • Ability to optimize PySpark code for performance and scalability

c) Mainframe & DB2 Integration

  • Experience accessing DB2 data via ODBC/JDBC or ETL tools
  • Familiarity with mainframe systems (JCL, COBOL, IMS)
  • Ability to replicate or migrate data from DB2 to cloud data lake

d) Tooling & Automation

  • Use of SAS-to-PySpark conversion tools (e.g., SAS2PY, SPROCKET, Scintilla, AI tools)
  • Automated testing and validation frameworks for data parity
  • Schema mapping and lineage tracking capabilities

e) Project Delivery & Governance

  • Experience successfully onboarding with client systems.
  • Clear documentation of conversion logic and testing results
  • Version control and CI/CD integration (e.g., Git, Azure DevOps)
  • Compliance with internal data governance and security policies

Databricks Platform

  • Databricks Certified Data Engineer Associate or Professional
  • Databricks Certified Machine Learning Associate or Professional
#J-18808-Ljbffr

;