Senior Data Engineer – Python & Spark

Job Description

<p><strong>Senior Data Engineer – Python & Spark</strong><br><br><strong>100% Remote - Toronto, Ontario, Canada<br>Experience: 5+ Years</strong> </p> <p><strong>Role Summary:</strong> NearSource is looking for a Data Platform Engineer with expertise in Python, Spark, and Snowflake to join our engineering team in Toronto. The selected candidate will architect and scale data pipelines, enable analytics, and support critical business insights for a Fortune 500 client.</p> <p> <br><strong>Key Responsibilities</strong></p> <ul><li>Design, build, and scale modern data platforms capable of handling both real-time and batch processing at enterprise scale.</li><li>Translate complex business and technical challenges into actionable solutions through detailed documentation and iterative delivery.</li><li>Automate deployment, monitoring, and management of cloud-based data infrastructure for high availability and reliability.</li><li>Implement and maintain CI/CD pipelines with a strong focus on automated testing and continuous improvement.</li><li>Collaborate closely with data engineers, data scientists, and product stakeholders to gather requirements and drive data best practices.</li><li>Develop and optimize SQL queries and data models to enable efficient analytics and reporting.</li><li>Create intuitive dashboards, reports, and analytical tools that provide actionable insights to business leaders.</li><li>Contribute to analytics initiatives such as performance tracking, segmentation, and revenue optimization.</li><li>Communicate findings effectively by presenting data-driven insights in a clear and strategic manner.</li></ul> <p><strong>Required Skills & Experience</strong></p> <ul><li>5+ years of hands-on experience working with large-scale data systems, processing pipelines, and relational databases.</li><li>Strong expertise with <strong>Spark (DataFrames, Spark SQL, PySpark)</strong>.</li><li>Advanced programming skills in <strong>Python</strong> and <strong>SQL</strong>, with a focus on clean, modular code.</li><li>Solid foundation in SQL concepts, dimensional data modeling, and data warehouses such as <strong>Hive</strong> or <strong>Snowflake</strong>.</li><li>Experience with <strong>workflow orchestration tools</strong> like <strong>Airflow</strong>.</li><li>Proficiency with BI tools such as <strong>Tableau, Power BI, or Qlik</strong>.</li><li>Knowledge of <strong>CI/CD practices</strong> and version control systems (Git, Jenkins).</li><li>Hands-on experience with <strong>interactive notebook environments</strong> (Jupyter, EMR, or Zeppelin).</li></ul> <p><strong>Preferred Skills</strong></p> <ul><li>Familiarity with <strong>Presto</strong> and <strong>AWS services</strong>.</li><li>Experience working with <strong>Looker</strong> for BI development.</li><li>Understanding of distributed system design with a focus on reliability and resilience.</li><li>Exposure to monitoring and observability tools.</li></ul> <p><strong>Certifications / Education:</strong><br><br> Bachelor's degree in Computer Science, Engineering, or related field (or equivalent training and experience)</p> <p><strong>Apply now,</strong> or share your resume with salary expectations at <strong>careers@nearsource.ca.</strong> Thank you for considering a career with us! Once you submit your application, our Talent Acquisition team will review your resume thoroughly. If there's a strong match, we'll reach out to discuss your experience, role details, benefits, compensation, and next steps. While we strive for transparency, we may not be able to respond to every applicant due to high volume, but we genuinely appreciate your time and interest.</p> <p></p> <p><strong>About NearSource:</strong> NearSource Technologies is a trusted partner for future-ready software consulting, enabling Fortune 500 enterprises to accelerate digital transformation. Our global engineering teams build and deploy impactful technology for some of the world's most admired brands, working directly on long-term client initiatives.</p> <p><strong>Equal Opportunity Statement:</strong> NearSource is an equal opportunity employer committed to fostering an inclusive and respectful environment. We celebrate diversity and do not discriminate based on race, gender, religion, sexual orientation, age, disability, or background. Innovation thrives when everyone feels empowered to contribute.</p>