Job Description

Design/Development Responsibilities

You will design and support the business’s database and table schemas for new and existing data sources for the lakehouse. Additionally, you will create and support the ETL processes to facilitate the movement of data into the Lakehouse.

Your Work Will Ensure:

• The data platform is scalable for large amounts of data ingestion and processing without service degradation.
• Processes are built for monitoring and optimizing performance to ensure consistent reliability.
• Implement Chaos Engineering practices and measures that allow the end-to-end infrastructure to function as expected, even if individual components fail.

Collaboration Responsibilities

You will work closely with Product Owners, application engineers, and other data consumers within the business to gather and deliver high-quality data for business cases. You’ll collaborate across departments and teams to create simple, functional, and elegant solutions that balance data needs across the business.

Analytics Responsibilities

You will quickly and thoroughly analyze business requirements and translate the results into strong technical data designs. You will also document the data solutions and maintain technical specification documentation for all reports and processes.

Skills You MUST Have:

• 4+ years of proven professional Data Development experience.
• 3+ years of experience with SQL.
• 3+ years of experience developing with Python, Java, or Scala.
• Full understanding of ETL and Data Warehousing concepts.
• Experience with Azure.
• Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables.
• Bachelor’s Degree in Computer Science, Management Information Systems, Mathematics, Business Analytics, or a related STEM field.

Bonus Points For Experience In The Following:

• Proficiency with Relational Data Modeling.
• Experience with Python Library Development.
• Experience with Structured Streaming (Spark or otherwise).

• Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.).