Open Systems Technologies
We are looking for Bigdata consultant for a contract Hybrid role in Mississauga. The ideal candidate will have a passion cum extensive experience in large scale data handling, rich expertise on BigData Transformation programs right from Architecture to Maintenance.
If you have relevant skills .Please apply with a copy of your updated resume and contact details.
Key Responsibilities:
• Translate high-level & functional requirements, Data Modelling (dimensional, semi structured, transactional use cases) to technical design.
• Develop batch & real time data ingestion Pipelines involving wide range of technologies like Spark, Hadoop, Hive, Middleware etc.
• Develop programs to migrate Historical Data from legacy platforms to the BigData platform.
• Participate in UAT/ SIT Test cycles, Release cycles, triage and resolve issues.
• Perform Code reviews, test case reviews and ensure Functional & Non-Functional requirements.
• Analyse Platform & Software version upgrades, evaluate new tools and technologies for handling the growing Data.
Required Skills:
• Experience: 6 to 8 years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems.
• Exp with Designing, creating, optimizing Cloudera platform. Design, develop, and optimize scalable distributed data processing pipelines using Apache Spark, Scala, Hadoop ecosystem tools such as Hive, HDFS, and YARN.
• Real-Time Data Streaming: Experience with streaming platforms such as Apache Kafka or Spark Streaming.