2024-01-09 GCP Data engineer - Improving Ottawa

Tags: jd ImprovingDotCom DataEngineer [[ImprovingOttawaInc?]]

About the job Looking for meaningful work where you can have an impact? Improving Ottawa Inc. is the place for you!

As a global market leader, Improving Ottawa Inc. exclusively offers consulting services to help guide your enterprise to success. Using open source technology, we provide mentorship to your technical teams, drive the implementation of product delivery, and offer staff augmentation engagements. Our focus is in helping organizations develop systems of innovation based on Reactive Principles.

This is a fully remote role where the candidate can be anywhere in Canada!

When you Work at Improving Ottawa Inc.

You’ll have the once-in-a-career opportunity to be a part of a movement— Improving Ottawa Inc. is committed to the Open-Source Community and we strongly believe all good projects start with open-source technology. As a dedicated partner of Lightbend and Google, it is the Improving Ottawa Inc. mission to ensure every project engagement is a success. Our Partners have some great commercial products available to support each phase of the project lifecycle. You’ll make more than just a paycheque. You’ll have the opportunity to combine your passion with purpose every day while achieving tangible results. You’ll join a high-performing, purpose-driven team that will help you advance your skills and adopt the growth mindset that’s essential to success at our company (and in everyday life). Our inclusive environment will allow you to come to work each day and be your best, most authentic self.

About the role:

A GCP Data Engineer creates data pipelines in GCP or uses other built-in GCP technologies to ingest data from different data systems (available on-premises or in one or more public clouds), integrate this data, cleanse it, transform it, normalize it, enrich it, and make it available for analytics. Our company is proud to utilize industry-leading technology, proven SDLC methodologies and processes, and the latest software engineering and systems design techniques to achieve outstanding results for our clients. We offer ongoing learning opportunities and encourage employees to gain more knowledge and earn certifications. The candidate will work in a remote self-governed team of highly motivated professionals analyzing and processing huge volumes of data from tens of near-real-time sources for databases holding petabytes of data.

The successful candidates will have:

• 7+ years of overall Data Engineering experience
• 3+ years of GCP experience designing and developing solutions on Google Cloud Platform, including experience with on-prem to GCP migration
• 3+ years of developing code using Python, Java, or Scala
• Working experience with Apache/Confluent Kafka, Kafka topics, brokers, stream processing and event streaming platforms.
• Familiarity with data governance, security, and compliance best practices in a cloud environment.
• Working knowledge and experience with containerization technologies and orchestration tools (Docker, OpenShift?, Kubernetes, GKE, CloudRun?)
• Solid SQL knowledge and experience with relational and NoSQL? Databases
• Experience with Terraform or other IaC? tools
• Experience with CI/CD Tools (Git, GitLab?, Jira, Jenkins)
• Solid Experience with Linux Operating Systems, command line utilities and shell scripting.
• BSc Degree in Computer Science, Software Engineering or related discipline
• Strong communication and collaboration skills, with the ability to work effectively with stakeholders at all levels of the organization
• Dedicated to producing quality code and dedicated to best practices such as automated testing, code reviews, pair programming, test driven development, continuous integration, and continuous deployment.

Nice to Have:

• Google Cloud Certification: Professional Data Engineer or Professional Cloud Architect
• 2+ years of Experience developing end-to-end big data solutions in Hadoop Environment (HDFS, Spark, Oozie, Hive, Impala, Sqoop)
• Knowledge and experience with other Cloud Platforms ( Azure / AWS)
• Data modeling, ETL and data integration experience
• Experience working in Telecom industry

Professional Skill Requirements:

• Personable and enthusiastic
• Strong analytical and problem-solving skills, with attention to detail.
• Ability to work as a team member in a creative, analytical, problem-solving environment
• Flexible with the ability to travel as required (once Covid-19 restrictions are removed)

What you can expect:

• An environment where constant learning is the norm.
• Opportunity to work in a fast-paced environment for a dynamic company with a history of proven success.
• Join a team of innovative thinkers as part of a rapidly growing company that is all about helping businesses create innovative corporate and workplace giving programs.
• Connect with a passionate group in an open, collaborative, and fun environment.

Our Commitment to a Diverse Culture

We believe in the power of diversity and we’re dedicated to creating a diverse, equitable, and inclusive environment at Improving Ottawa. We ensure equal opportunity for all applicants and encourage people of all visible minorities, including Indigenous applicants, and those of any religion, sex, age, ability, sexual orientation, gender identity or expression to apply. Gender diversity and equality benefits everyone. We’re committed to supporting all gender identities and expressions in tech by sharing stories and advocating for equality.