03 Sep
Data Engineer (Experience with Databricks is must)
California, Sanfrancisco , 94101 Sanfrancisco USA

Vacancy expired!

What You Know:
  • Plans, designs, develops and tests data systems or applications for analytics, customer personalization and reporting.

What’ll You Do:
  • Work independently and with other engineers, architects, business analysts, product managers, QA and Operations teams, design and develop strategic and tactical processes and create solutions that meet business requirements
  • Design and implement complex multi-terabyte data applications, document and test systems, modify as necessary
  • Review and provide recommendations related to engineering efforts, plan implementations and rollout for complex data applications
  • Participate in release management and on-call duties, and provide recommendations for project or production issues and diagnostics
  • Identifies feature and module dependencies
  • Proposes mitigation plans for identified risks and problems
  • Provide technical leadership and mentoring to one’s team members, and throughout other groups.
  • Suggests process improvements and best practices
  • Identifies new areas that could be measured
  • Works independently on complex problems, including implementation and evaluation of systems and/or subsystems. Perform design work at the subsystem level
  • Data analysis is complex and requires input from multiple sources and innovative problem solving
  • Regularly interfaces to negotiate and exchange information with all levels of management on significant projects
  • Proficiently developed, through advanced experience in making decisions based on our purpose and values, finding balance, using our “smarts,” and thinking of the whole.
  • Proficiently developed, through advanced experience in giving and building trust, dealing with conflict, and encouraging diversity of thought
  • Works with contract resources, providing guidance
  • Assesses the quality of work of contract resources
  • Actively shares knowledge within domain
  • Able to share knowledge outside domain
  • Uses judgment, creativity and sound technical knowledge to recommend solutions
  • Works independently on complex issues where analysis of situations or data requires an in-depth evaluation of variable factors
  • Exercises judgment in selecting methods, techniques and evaluation criteria for obtaining results on matters of significance to the business
  • Authorized to deviate from regular methods and techniques. Internal and external contacts often pertain to company plans and objectives

Experience:
  • 4-5 years of experience as a Data Engineer
  • Experience in driving end-to-end programs from Source to consumption, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time.
  • Strong SQL and Scala -Spark programming experience
  • Strong knowledge of programming languages/tools including Hive, Big Data toolsDevelop and unit test ETL/ ELT data pipelines using ADF V2 and other components like Azure SQL, Azure SQL DW, ADLS Gen2 etc

Education:
  • Bachelor's degree in Computer Science, Engineering or equivalent demonstrable experience

Vacancy expired!


Related jobs

Report job