Job Board Powered by Bullhorn
Aug 9, 2018
Job #10982: Engineering
Job Code: #10982
Title: Sr. Developer – Hadoop/ETL
Date Posted: 08/08/2018
Job Type: Temp to Perm
Job Location: Falls Church VA
Blackstone Technology Group is looking for a reliable, motivated and results-oriented Big Data senior Developer. The candidate must have 8-10 years progressive experience in designing/developing IT solutions and at least 3 years’ experience in developing Big Data solutions using Hadoop stack in AWS cloud.
Successful candidate will be a self-starter with ability to work with multiple platforms, architectures, and diverse technologies gathering requirements and design and develop ETL processes to transform information from multiple sources. Work with a team of talented engineers to install, configure and develop a highly scalable, fault tolerant, and responsive big data ELT platform with next generation streaming data technologies. Perform as a key member of the team responsible for designing and supporting Hadoop Big Data technology solutions around data collection, storage and enrichment in the Cloud. Develop proof of concepts, evaluate technologies, and contribute to ideas that can turn into actionable implementations.
2-3 years of experience with designing stream processing data pipelines, including NiFi, Kafka, Flume, or Apache Spark Streaming.
At least 2 years of experience installing and configuring and securing real-time data ingestion technology Apache NiFi
Extensive experience with XML and JSON and parsing and enriching data preferably in the aviation data/sensor data
Experience with messaging-oriented application stacks, pub-sub architecture, and clustering and brokers, queues, and topics
Familiarity with Hadoop security frameworks such as Knox, Ranger and extending enterprise security to ELT data pipelines.
Ability to play a technical role as a part of a team, implement solutions based on industry standard architecture patterns, loosely coupled architecture, Web-oriented architecture, and service-oriented architecture
o Atleast 1 year of experience with search-based solutions for real-time indexing, analysis, and visualization, including ElasticSearch, Kibana (ELK), Splunk, Solr, or others
o Experience with real-time data visualization techniques and enabling live analytics
o Experience with building distributed systems
o Experience with Java and other modern languages, including Scala, R, and Node.js
o Ability to be a real-time thinker who can imagine the future state
o Ability to code and debug and display an engineering background
EOE of Minorities/Females/Veterans/Disabilities
To apply for this job please visit itjobpro.com.