20 Feb
Senior Data Engineer
Vacancy expired!
- Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure
- Data Factory with development expertise on batch and real-time data integration
- Experience in programming using Python
- Azure and AWS Data pipeline experience
- SQL and ETL experience
- RDBMS knowledge and experience in writing the Store Procedures
- Strong experience with AWS Cloud on data integration with Databricks, Apache Spark, Airflow, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
- Experience with Agile development methodologies
- Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
- Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
- Experience to own end-to-end development, including coding, testing, debugging and deployment
- Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
- Experience working with structured and unstructured data
- Ability to provide solutions that are forward-thinking in data and analytics.
- Bachelor's degree in Information Systems, Computer Science, Engineering, or related field
- Databricks Certification(Desired)
- AWS and Azure certification
Vacancy expired!