Design and architect large-scale distributed Big Data solutions using Java, Spark, and Hadoop/Cloudera. Lead global teams to build high-volume data processing and analytics pipelines, ensure robust testing (JUnit), and apply scripting for automation and data analysis.
Qualifications
- Minimum 15+ years of relevant experience in applications development
- Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloudera distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead and manage internal investigations, develop and implement compliance policies, advise on regulatory requirements, analyze operational risks, communicate findings to stakeholders, coach and lead teams, and support compliance program implementation and training to strengthen internal controls and ethical standards.
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The role involves developing, testing, and validating Generative AI agents and maintaining automated testing standards. Responsibilities include mentoring junior associates, analyzing complex issues, and applying governance controls in AI-driven solutions.
Top Skills:
AIAutomated TestingCi/CdData EngineeringLlmsMlPower Automate
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As an AI Engineering Manager at PwC, you will lead the design and operation of AI-powered platforms, mentor engineers, and ensure project delivery excellence while focusing on security and scalability.
Top Skills:
AIAzureAzure Bot Framework SdkAzure Cognitive ServicesCloud EngineeringConversational AiData VisualizationDevOpsMachine Learning
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
