IT Job Pro

Most Popular Tech Job site – Find Jobs || Post Jobs

Big Data Engineer

Raleigh NC Carpenter Technology
Carpenter Technology Corporation is a leading producer and distributor of premium specialty alloys, including titanium alloys, nickel and cobalt based superalloys, stainless steels, alloy steels and tool steels. Carpenter’s high-performance materials and advanced process solutions are an integral part of critical applications used within the aerospace, transportation, medical and energy markets, among other markets. Building on its history of innovation, Carpenter’s wrought and powder technology capabilities support a range of next-generation products and manufacturing techniques, including novel magnetic materials and additive manufacturing.
BIG DATA ENGINEER – (Must be US Citizen or Green Card Holder)
Location: Raleigh NC

Primary Duties

  • Build distributed, high-volume data pipelines to power new solutions based on analytics and machine-learning

  • Develop models and perform ad-hoc data analysis to identify patterns and insights

  • Optimize performance of the company's big data ecosystem

  • Write complex queries to ensure data is easy to access and manage

  • Work all over the stack, moving fluidly between programming languages

  • Collaborate with new, cross-functional teams on accelerated projects to scale data architecture, build digital products, and execute data science solutions

  • Accountable for the design and development of new Big Data applications for evaluating data for actionable insights

  • Provide mentorship to other team members and partake in cross-training.

  • Deploy current project planning techniques to simplify very complex projects into tasks and manageable scope to ensure deliverables are achieve within deadlines.

  • Be up to date on current technology trends as regards Big Data and Analytics

  • Make sure there is platform integrity conceptually and architecturally

  • Can take on large-scale, multi-tier big data projects

  • Design and build improved architectural models for scalable data processing along with scalable data storage

  • Contribute to collective software and system design and advancement of the new platform.

  • Perform all other duties and special projects as assigned.

Required for the Big Data Engineer

  • Bachelor’s degree or MS/PhD in computer science, software engineering, applied mathematics, statistics, or related field.

  • 7+ years of experience in structuring databases and working with Big Data technologies and tools accompanied with a capacity to communicate ideas within a team.

  • 5+years of hands on experience in big data frameworks and tools (e.g. Hadoop, Spark, MapReduce, Hive, Pig, Luigi/Airflow, Kafka, Data streaming, NoSQL, SQL)

  • US citizen or green card holder (due to compliance requirements)

Preferred for the Big Data Engineer

  • Ability to build and operate data pipelines and reusable data ingestion code packages

  • Working experience of building applications on cloud computing clusters (e.g. Azure, AWS, GCP)

  • Command strong knowhow of commercial/manufacturing IT infrastructures, comprising networking, storage, security, and systems management with familiarity and awareness of industry standards and trends

  • Expertise in Parallel Processing (MPP) Database along with strong conceptual and analytical thinking

  • Competence in multiple scripting languages (Python/Java/ Shell/Perl/ Scala/Go/ JVM/C++, etc.)

  • Must have hands on experience of usage and execution at scale of NoSQL solutions like MongoDB, CouchDB, HBase, HIVE, and Cassandra

  • Command expertise in open source Big data technologies comprising Hadoop eco-system (Spark Scala, Impala, Spark, HBase, MapReduce, Streaming, Pig)

  • Access to commercial platform in Big data technologies from providers such as IBM (Netezza), Cloudera, or Oracle (Exadata)

  • Proficiency in Relational SQL databases (e.g. MySQL, Oracle, SQL Server, etc.), Analytics platforms (e.g. DataStage or similar) and OLAP technologies

  • Solid experience with agile development methodologies

  • Excellent verbal and written communication skills.

  • Multi-tasking skills: Capability to skillfully manage multiple priorities with little or no supervision and on schedule

  • Applicants must be good team and individual player.


Raleigh, NC

Carpenter Technology Company offers a competitive salary and a comprehensive benefits package including life, medical, dental, vision, flexible spending accounts, disability coverage, 401k with company contributions as well as many other options to employees.

Carpenter Technology Corporation’s policy is to fully and effectively maintain a program of equal employment opportunity and nondiscrimination for all employees, to employ affirmative action for all protected classes, and to recruit and develop the best qualified persons available regardless of age, race, color, religion, sex, gender identity, sexual orientation, marital status, national origin, political affiliation or any other characteristic protected by law. The Company also will recruit, develop and provide opportunities for qualified persons with disabilities and protected veterans.

To apply for this job please visit