18 Jan
Data Engineer
Vacancy expired!
Are you passionate about work? Do you want to be associated with a company in which the work you do affects the healthcare of millions? Make your contribution and join us on this opportunity!
Excellent Benefits Available!Q Analysts is looking for a Data Engineer to work on a project with a leading social media company in Silicon Valley. Role will be focused on supporting data management for a team that is focused on internal dogfooding, data collection and QA initiatives for our client's hardware user trials team.Responsibilities- Create and manage Python / SQL Data Pipelines and automation to improve operational efficiencies
- Create and manage Data Dashboards to effectively capture and present team data / KPIs
- Create and manage alerting systems based on business rules
- Upload, parse, and organize data into proprietary BI tools
- Report data in readable formatting as desired
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Work closely with a team of frontend and backend engineers, product managers, and analysts.
- Define company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.
- Design data integrations and data quality framework.
- Design and evaluates open source and vendor tools for data lineage.
- Excellent problem-solving and troubleshooting skills
- Process oriented with great documentation skills
- Excellent oral and written communication skills with a keen sense of customer service
- 3+ Years experience with Python
- 3+ Years experience with SQL / Data Modeling / Data Warehousing. Preferably using Presto and Spark.
- 2-3 Years using DAG Pipeline Management/Alert tools such as Airflow and Luigi
- Proficient in using Command Line
- Experience building analytical Data Products and dashboards using Tableau or PowerBI
- We offer excellent benefits to our employees, including:
- Medical Insurance
- Dental Insurance
- Vision Insurance
- Section 125 Pre - Tax Payment of Insurance Premiums
- Company Paid Group Life AD&D Premiums
- Company Paid Employee Assistance Program
- Company Paid Travel Assistance
- 401 (K) Plan with Employer Matching
- Credit Union & Premium Banking Membership
Vacancy expired!