02 Dec
Big Data Engineer, Analytics
Vacancy expired!
Technology is constantly changing, and our adversaries are digitally "going dark" at a rate that is exceeding law enforcement's ability to keep pace. Those charged with protecting the United States are not always able to access the evidence needed to prosecute crime and prevent terrorism. The Government has trusted in
Peraton to provide the technical ability, tools, and resources to bring criminals to justice. In response to this challenge, we are seeking a talented Big Data Engineer with a focus in Analytics.What you'll do- Provide entity resolution expertise in support of a large scale search and discovery application
- Work closely with entity resolution subject matter experts, program engineers and stakeholders to integrate complex data sources into operation and develop new analytics and algorithms
- Support advanced data exploitation capabilities using Hadoop related technologies
- Enhance the data processing infrastructure using open source and commercial technologies
- Capture and define requirements for entity resolution features and functionality from a UI end-user perspective
- Analyze documentation and source data of new data feeds
- Develop scripts to ETL source data into destination format
- Provide O&M monitoring and resolution of production web services using monitoring tools including Ganglia, Jenkins, and other means
- Modify pipeline scripts to enhance functionality and support bug fixes
- Resolve bugs by modifying pipeline scripts and entity resolution explanation service scripts
- Coordinate development efforts in an agile team
- You've obtained a BS degree and have five (5) years of relevant experience. However, equivalent experience may be considered in lieu of degree.
- You have three (3) or more years of experience using Hadoop or other large-scale data warehouse technologies to support entity and relationship resolution and operations
- You have one (1) year of experience in Apache, Spark, Hive, Pig, ER Resolution Engines, Unix scripting, Novetta Entity Analytics, Waremen Pro or similar ER engines
- You have a current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph
- Have hands on experience with any of the following technologies:
- SQL
- Linux scripting
- AWK, PERL, BASH or other scripting language
- SOLR
- Jenkins configuration to perform O&M operations
- Spark
- An immediately-vested 401(K) with employer matching
- Comprehensive medical, dental, and vision coverage
- Tuition assistance, financing, and refinancing
- Company-paid infertility treatments
- Cross-training and professional development opportunities
- Influence major initiatives
Vacancy expired!