The role involves providing data engineering support, managing data operations, enhancing data pipelines, and administering Snowflake, while adhering to KPIs and improving processes.
Company Description
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (17000+ experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job DescriptionA) Provide Data Engineering Support
- Provide services to complete Data Engineering task as assigned via Team Lead, Manager, Director or others
- Provide Data Engineering expertise to build upon tasks and capabilities defined
B) Manage Data Operations
- Monitor and respond to scheduled workloads that feed data from and to the data platform
- Restart and/or repair the workflows when necessary
- Update or create runbooks for future troubleshooting
- Closely follow the run schedules and changes to schedules during maintenance windows to make sure workloads are executed after the maintenance window is complete
- Manage a list of workloads and users that are upstream and downstream to the workloads
- Assess the impacts of schedule/run changes, processing issues or data quality issues
- Communicate and work with Suppliers on schema drift and/or other Supplier issues
- Communicate to stakeholders, delays, or impacts of failures and escalate as needed to Leadership, EOC
- Create and execute quality scripts to monitor and maintain the accuracy of our data
- Respond and resolve PagerDuty alerts or Service Now ticket assignment
- Monitor Regular KTLO activities to maintain good health of the services.
- Monitor mirroring queues for any abnormal behavior and resolve.
- Understand the failures and changes in schedules and assess business impacts.
C) Develop and enhance data pipelines.
- Configure pipelines to ingest data from supplier landing zone to the data platform that includes configuration of airflow ingestion pipelines and/or Snowflake external tables/Snow pipe.
- Configure pipelines to ingest and process data from supplier landing zone to the data platform that includes configuration of airflow ingestion pipeline and Snowflake as directed by the technical lead and/or Scrum Master.
D) Snowflake Administration & Operations
E) Adhere to and exceed KPI's to be defined and provide recommendations and implement process/technology improvements.
QualificationsSkills Required : AWS (S3, EMR, EC2, Lambda, Glue, Redshift, Athena), Snowflake, Python, Airflow, DMS. (Key AWS services for data engineers)
Good working experience in Cloud Data Engineering - Support, Operations & Enhancement projects.
Top Skills
Airflow
Aws Athena
Aws Ec2
Aws Emr
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
Dms
Python
Snowflake
Similar Jobs
Healthtech • Logistics • Pharmaceutical
This role manages client requirements, project planning, and execution while aligning IT and business objectives, ensuring deliverables are met on time and within budget.
Top Skills:
Erp ApplicationsMs Office SuiteMs ProjectVisio
Healthtech • Logistics • Pharmaceutical
The Solution Designer will serve as a subject matter expert on the Sage platform, develop documentation, troubleshoot issues, provide training, and collaborate with teams to enhance user experience and optimize workflows.
Top Skills:
ConfluenceJIRAMS OfficeSage PlatformVisio
Artificial Intelligence • Productivity • Software • Automation
Manage strategic partnerships at Zapier, focusing on building relationships and co-developing product experiences with technology partners, driving new business and growth initiatives.
Top Skills:
Ai,Saas,Apis,Bi Tools
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
