Senior Data Engineer

KellyMitchell Group


Date: 7 hours ago
City: Glendale, CA
Contract type: Contractor
Job Summary

Our client is seeking a Senior Data Engineer to join their team! This position is located in Glendale, California.

Duties

  • Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
  • Build tools and services to support data discovery, lineage, governance, and privacy
  • Collaborate with other software/data engineers and cross-functional teams
  • Tech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Kubernetes, and AWS
  • Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
  • Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
  • Ensure high operational efficiency and quality of the Core Data platform datasets to ensure solutions meet SLAs and project reliability and accuracy for all stakeholders
  • Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for the team
  • Engage with and understand customers, forming relationships to prioritize both innovative new offerings and incremental platform improvements
  • Maintain detailed documentation of work and changes to support data quality and data governance requirements

Desired Skills/Experience

  • 5+ years of data engineering experience developing large data pipelines
  • Proficiency in at least one major programming language
  • Strong SQL skills and ability to create queries to analyze complex datasets
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology
  • Experience in developing APIs with GraphQL
  • Deep understanding of AWS or other cloud providers as well as infrastructure as code
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
  • Advanced understanding of OLTP vs. OLAP environments

Benefits

  • Medical, Dental, & Vision Insurance Plans
  • 401K offered

$59.50 - $85.00 (est. hourly)

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume