24 Jan
Sr Big Data Engineer
Oregon, Beaverton , 97003 Beaverton USA

Vacancy expired!

Position:

Sr Big Data Engineer

Location: Beaverton, OR

Duration: 12 months Contract on W2

Job ID: 11873300

Updates from HMProject details – Inventory projects, building snapshots. Will also be a part of scrum team along with products managers.

Initial remote. They need a person to be onsite once campus opensInterview – Initial zoom. Second round –Writing code and detailed technical questions – 2 interviewsTeam – Completely operates in AWS. Some of the core tool – Spark on EMR and PythonThey are looking for a Big data engineerThey will come onboard to their existing teamIdeal candidate – Looking for a 5+ years of experience Big data engineer who will be doing ETL. Building pipelinesRetail BG is nice to haveLooking for somebody with combination of two level of high skills - ETL and Big data BG5+ years of experience neededAWS stack – highly preferred. Somebody worked with Cloudera is also fine

MUST HAVE SKILLS:AWS (S3, EMR) - MANDATESpark – MANDATEHive - MANDATEPython - MANDATESQL – MANDATEAirflow – MANDATESnowflake – MANDATEThey will be dealing with Millions /billions of records. High volume dataSome knowledge of BI is also important – Understanding data warehousing concepts

Other: Good communication skills

Job DescriptionEstablishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. Documents and communicates database design.Evaluates and installs database management systems. Codes complex programs and derives logical processes on technical platforms.Builds windows, screens and reports.Assists in the design of user interface and business application prototypes.Participates in quality assurance and develops test application code in client server environment.Provides expertise in devising, negotiating and defending the tables and fields provided in the database.Adapts business requirements, developed by modeling/development staff and systems engineers, and develops the data, database specifications, and table and element attributes for an application.At more experienced levels, helps to develop an understanding of client's original data and storage mechanisms.Determines appropriateness of data for storage and optimum storage organization.Determines how tables relate to each other and how fields interact within the tables for a relational model.

Vacancy expired!


Related jobs

Report job