Data Engineer
Key ResponsibilitiesPipeline Architecture & Development: Design, build, and maintain scalable, reliable batch and streaming data pipelines using modern distributed frameworks (e.g., Spark, Flink, Kafka, Airflow).Data Modeling & Storage: Architect robust data models and storage strategies optimized for analytical query performance in cloud data warehouses and data lakes (e.g., Snowflake, BigQuery, AWS S3/Redshift).System Quality & Reliability: Monitor data pipeline health, establish automated testing and data validation frameworks, and optimize pipeline throughput, latency, and query performance.Security & Compliance: Ensure all data management practices strictly comply with security protocols, privacy standards, and regulatory frameworks required for financial infrastructure.Cross-Functional Collaboration: Partner with Analytics, Data Science, Product, and Infrastructure teams to translate raw protocol and product telemetry into canonical, reliable data platforms.