Data Engineer

Data Engineer Job Functions, Essential Duties, And Responsibilities:

• Write production-grade code using standard software engineering methodologies
• Implement data solutions with software engineering best practices
• Own data pipelines end-to-end
• Collaborate with business teams to design and implement a solution
• Contribute to a data driven culture where everyone is valued
• Analyze large data sets and develop custom models to uncover trends, patterns and insights
• Provide critical thought leadership to enhance organizational capabilities by utilizing big and small data

• Motivated to learn and collaborate
• Drive to build sustainable and reliable solutions
• Knowledge of Python, Java, SQL, Git, AWS, Docker, Kubernetes, etc.
• Ability to effectively and concisely communicate with both business and technical audiences
• Knowledge of ML pipeline frameworks like kubeflow, MLflow, etc.
• ML frameworks (sklearn, Tensorflow, PyTorch, MXNet or similar)
• ETL tools like Airflow, Celery, Luigi, etc.
• AWS services like s3, Sagemaker, lambda, SQS, SNS, EMR, ECR, EKS, etc
• MPP cloud data warehouses like Snowflake, Redshift, etc.