Data Engineer

Johannesburg

Join us to transform the way people work, everywhere. Our products are the global standard for process intelligence and automation at more than 10,000 organizations across 90 countries. You’ll help customers accelerate their digital transformation, bringing them a quicker, easier, better way to work.

 

About the Role:

This is a role for the problem-solvers, creators, the data engineers who like building things from the ground up. We’re looking for someone who already has solid experience and is ready to take their skills and career to the next level!

The Data Engineer work on the next generation of our analytics and AI product, where they will spend most of their time working on ETL’s, Data Ingestion, Apache Spark, Scala and mentoring other members of the team to design and implement our Analytics and AI/ML powered features.

 

Your contribution will be: 

  • Participate actively in agile development cycle meetings
  • Design, code, and unit test data engineering components and features that can be released / deployed through automation
  • Ensure data completeness and correctness through cross-referencing to original data source
  • Design and develop ETL’s in line with best practices and techniques for data transformation and storage
  • Deliver data engineering functions that ingest, sanitize, and join data from multiple sources
  • Create data models that meets the needs of management stakeholders, data scientists, and analysts as required
  • Analyze and evaluate data product/output to identify and recommend optimizations as required in its extraction, cleansing, and organization
  • Identify and pursue opportunities to create or improve organizational data standards
  • Take ownership of assigned work and liaise proactively and collaboratively with stakeholders to ensure quality features are produced on time
  • Participate in technical and team interviews as directed and provide clear input into the decision-making process
  • Proactively communicate your work and progress to your manager, extended technical team, and stakeholders during the development process, and immediately escalate any product quality or delivery issues
  • Contribute to the support and maintenance of data engineering functions, including liaising with the support team to resolve issues that have been escalated
  • Active part of the incident management process, including on-call rotation and working with the IM team to resolve incidents
  • Work with data providers to document the incoming data stream’s domain boundaries, field datatypes, and term definitions in sufficient detail to enable transformation of the data for end-user consumption
  • Design and implement data engineering solutions that adhere to Nintex guidelines in support of security, disaster recovery, scalability, availability, reliability, and durability

 

To be successful we think you need: 

  • Hands-on expertise with Apache Spark (Spark structured streaming), Scala and Spark SQL
  • Experience in data munging, manipulation, cleansing and blending from multiple data sources and exposure to various data types and storage paradigms
  • Recent experience as a Data Engineer
  • Experience with Azure technologies
  • MS Databricks experience it highly advantageous
  • Python experience will be a bonus
  • Familiarity with the Delta Lake House paradigm is preferable
  • Familiarity with streaming data sources is preferable

 

How we operate:
Our day-to-day is guided by three core tenets that help us work collaboratively, effectively, and respectfully in a way that allows us to ideate, and improve, together.
·      We deliver on our commitments. We focus on a few key priorities and ensure we deliver with quality on time. Every time.
·      We don’t wait. If we see an issue, we fix it. If we see an opportunity to accelerate our success, we take it.
·      We operate with respect and consideration. We will move fast and deliver…and we will do it the right way.

We foster a workplace that gives amazing people the freedom and support to do their very best work every day – work that accelerates digital transformation across the globe with a best-in-class process platform.

Be part of the transformation. Apply today.

Nintex participates in E-Verify for work authorization. We are an Equal Employment Opportunity Organization.

 

#LI-SO1

#LI-REMOTE