PySpark / Python Developer
Location: Remote job or Sector-63 in Noida, Delhi/NCR
(Please share your CV)
PySpark / Python Developer
Updated : May 11, 2023
Job Description
Responsibilities:
- Develop data processing, data ingestion and ETL pipelines and perform batch and real-time analytics on data
- Develop data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destination
- Create Spark jobs for data transformation and aggregation
- Develop unit tests for Spark methods
- Contribute in the delivery/release (CI-CD) events, e.g., branching timelines, pull requests, issue triage, merge/conflict resolution, and release notes
- Develop and manage databases using PySpark / Python-based database technologies
- Write complex SQL queries, ingesting data into a database, running data on distributed SQL
- Work on Microsoft Azure to build scalable data processing solutions, using cloud-based data processing and distributed computing technologies
Requirements
A PySpark developer with a love for technology, and:
- Minimum of 2+ years of experience in PySpark
- Overall 3+ years of experience in Python programming. Must know in-and-out of programming in Python.
- Expert level database knowledge and experience
- Experience in working on a Cloud environment (preferably Azure)
- Bachelor’s / Master’s degree in Computer Science (or related field)
Good to have
Certification in Azure or Azure Synapse
We’re looking for someone who is
- Driven to push the boundaries and lead change and performance
- Communicative to leave no-one in the dark and to work with your team successfully
- Reliable so we know that we can call on you to meet deadlines
- Passionate about the latest technologies and standards
- Proactive to suggest improvements, identify and fix potential issues
Who We Are
Convexium is one of the top Fintech Analytics and AI Model development company with experience of more than 15 years in providing financial technology solutions. Our full stack fintech software development services comprise of building analytics frameworks, machine learning models, open banking APIs and middleware, front-end, distributed apps through blockchain technology, banking business intelligence, financial reporting, and integration with your existing systems. Convexium is an experienced company with 25+ years of experience and 100+ worldwide projects implemented. It has served customers in 10+ countries with a team of 65+ data scientists, engineers & experts for tackling complex data challenges.
Do you want to be part of a fast-paced and inovative company? Apply now!
The selection process will require a full assessment of your skills. Please send us your CV at dw0523@convexium.com