Senior Java Big Data Developer with 8+ years building applications on Cloudera/Hadoop ecosystems using Spark and MapReduce. Responsible for designing performant Java (1.8+) solutions, data analysis of large datasets, unit testing (JUnit), and collaborating with/managing global technology teams. Preferred skills include Unix/Python scripting and familiarity with Hive, Impala, YARN, and Kafka.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Full lifecycle recruiter supporting AMER sales roles: sourcing passive and active candidates, partnering with hiring teams, using ATS and sourcing tools, leveraging market data and metrics to improve pipelines and candidate experience during a six-month contract.
Top Skills:
GitGitlabGreenhouseLinkedin Recruiter
Marketing Tech • Real Estate • Software • PropTech • SEO
Build and own the analytics foundation: maintain dbt models and Snowflake, create ELT pipelines (Python/Airflow), design semantic layers, ensure data quality and reconciliation, enable self-serve analytics and measurement for cross-functional teams, and support AI-ready data infrastructure.
Top Skills:
AirflowAirflow DagsApi IntegrationsBigQueryCi/CdDbtDbt Semantic LayerEltGitMixpanelPosthogPythonRedshiftSalesforceSnowflakeSnowflake CortexSQL
Big Data • Fintech • Mobile • Payments • Financial Services
Lead technical strategy and roadmap for Affirm's Online Storage platform. Design and build scalable, multi-region datastore solutions, automation control planes, and operational tooling for hundreds of databases. Drive cross-team collaboration, reliability, monitoring, and mentor engineers while delivering high-impact backend and database features.
Top Skills:
AWSDistributed SqlDynamoDBKotlinKubernetesMySQLPgbouncerPostgresProxysqlPythonRds ProxyRedisSparkTidbVitess
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
