Data Engineer

Please email your resume to info@shld.co

  • Chantilly, VA
  • Active Top Secret – SCI

Responsibilities

Primarily responsible for working with data providers within the IC and DoD Enterprise to identify and ingest data sets into the CDF data broker. In this role you will:

  • Develop, optimize, and maintain data ingest flows using Apache Nifi and Python.
  • Develop within the components in the cloud platform, such as Apache Kafka, NiFi, and HBase.
  • Communicate with data owners to set up and ensure CDF streaming and batching components are working (including configuration parameters).
  • Document SOP related to streaming configuration, batch configuration or API management depending on role requirement.
  • Document details of each data ingest activity to ensure they can be understood by the rest of the team

Requirements

Successful candidates will meet many–not necessarily all–of the following:

  • A minimum of 3 years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems
  • DoD 8570 IAT Level II Certification (e.g. Security+)
  • Demonstrable CentOS command line knowledge
  • Working knowledge of web services environments, languages, and formats such as RESTful APIs, SOAP, FTP/SFTP, HTML, JavaScript, XML, and JSON
  • Understanding of foundational ETL concepts
  • Experience implementing data ignorations with in the IC DoD Enterprise

Strongly Desired

  • Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs (desired)
  • 2+ Experience in Python Development
  • Experience or expertise configuring an LDAP client to connect to IPA (desired)
  • Advanced organizational skills with the ability to handle multiple assignments
  • Strong written and oral communication skills

Other requirements

  • Years of Experience: 5 years of experience or more.
  • Education: Bachelor’s degree in systems engineering, computer engineering, or a related technical field
  • Location: On-Site at Chantilly, VA
  • Clearance: Active TS/SCI w/ ability to obtain CI Poly
  • Citizenship: U.S. Citizen

Please email your resume to info@shld.co