Senior Big Data Engineer in Pittsburgh, PA at Vaco

Date Posted: 9/24/2019

Job Snapshot

Job Description

Position Summary: The Sr. Software Engineer will participate in design/architecture and lead implement of complex, mission-critical, enterprise applications. The position will be working with a moderately sized team in a fast-paced environment and will have the opportunity to work in all architectural layers on a variety of programming projects.

Significant Responsibilities & Accountabilities:

  • Develop a Data Analytics Solution using Hadoop (preferably CDH), Spark, SOLR and Kafka
  • Performance tuning of CDH or similar platforms
  • Translate high level design into logical and physical detailed design
  • Build and incorporate automated unit tests and participate in integration testing efforts
  • Work across teams to resolve operational and performance issues
  • Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed

Minimum Qualifications Required:

  • Education: Bachelor's degree in Computer Science or relevant field
  • 10+ years overall IT experience in Software Development with 5+ years of experience in Big Data Analytics area. Must have delivered at least 4 big data projects to production.
  • Experience in Hadoop distributions (Apache / Cloudera / Hortonworks)
  • Experience working with Big Data eco-system including tools such as Hadoop, Map Reduce, Yarn, Hive, Impala, Spark, Kafka, Sqoop and Storm to name a few
  • 1+ year of experience with techniques of performance optimization for both data loading and data retrieval
  • 2+ years of experience with NoSQL databases such as Cassandra/HBase
  • 3+ years of experience in development of Spark streaming applications and ETL
  • 1+ year of experience with graph databases such as GraphDB/Neo4j
  • Proficiency in Sqoop, Nifi, Flume and Kafka
    Expert level experience with software development processes and experience taking enterprise scale projects from inception to deployment
  • Strong problem-solving skills and ability to think creatively
  • Solid understanding and hands-on experience with Linux commands
  • Strong unit and integration testing knowledge and habits
  • Knowledge of source code control systems (SVN, GIT)
  • Proven leadership skills leading project activities for programmers in an agile environment
  • Individual track record of completing assignments on time or ahead of schedule
  • A keen interest in a fast-paced scientific learning environment with an emphasis on applying new skills
  • Must have excellent written and oral communication skills, a team -oriented work ethic and positive attitude
  • Ability to quickly, effectively, and persuasively communicate inputs and ideas within collaborative sessions, presentations and in written or verbal form to various audiences with wide ranges of technical knowledge and ability

Technical Lead - 2 positions - 1 here in Pittsburgh; 1 seated in Wright Patterson AFB CTH 120K

Job Summary:

The Technical Lead will contribute to the design/architecture and lead the implement of complex, mission-critical, enterprise applications. The position will give technical and management direction to a moderately sized team in a fast paced environment and will have the opportunity to work in all architectural layers on a variety of programming projects.

Job Responsibilities:

  • Contribute to the Architecture/ Object Oriented Design
  • Design and implement interactive applications according to architecture and requirements
  • Provide technical direction to team of Software Engineers across multiple products and projects
  • Participate in defining detailed functional requirements by observing, interacting with, and gathering feedback from all users/customers
  • Contribute to the growth of team through professional qualities, mentoring and coaching
  • Ability to work and manage effectively in an agile team environment
  • Ability to quickly, effectively, and persuasively communicate inputs and ideas within collaborative sessions, presentations and in written or verbal form to various audiences with wide ranges of technical knowledge and ability
  • Lead planning sessions and provide construction estimates
  • Manage small technical team

Qualifications and Requirements:

The ideal candidate will possess a Bachelor's degree in Computer Science or relevant field. An advanced degree is a plus with experience in the following areas:

  • 7+ years implementing enterprise-scale, distributed, data centric applications with graphical user interfaces.
  • Expert level experience with software development processes and experience taking enterprise scale projects from inception to deployment
  • A minimum of 2 years of management experience
  • 3-5 years of experience developing java applications in an agile software environment using Java, Python, AngularJS, HTML
  • Experience managing project activities for Software Engineers
  • Solid understanding and hands-on experience with Unix/Linux commands, MS windows and writing SQL Server queries
  • Experience using one or more of the technologies in the Hadoop ecosystem components (HDFS, Spark, Storm, HBase, Flume, Zookeeper, Solr, Kafka, Sqoop) Preferred

Knowledge, Skills, & Abilities:

  • Management of software development projects
  • Excellent problem-solving/troubleshooting skills and ability to think creatively
  • Strong Object Orient Design and Programming
  • Familiarity with UI technologies and MVC Framework
  • Strong supporter of unit and integration testing
  • Knowledgeable of graph databases a plus
  • Customer and quality focused
  • Knowledge of source code control systems (SVN, etc.)
  • Individual track record of completing assignments on time or ahead of schedule
  • Excellent written and oral communication skills
  • A team oriented attitude and strong work ethic

Job Requirements

Position Summary: The Sr. Software Engineer will participate in design/architecture and lead implement of complex, mission-critical, enterprise applications. The position will be working with a moderately sized team in a fast-paced environment and will have the opportunity to work in all architectural layers on a variety of programming projects. Significant Responsibilities & Accountabilities: Develop a Data Analytics Solution using Hadoop (preferably CDH), Spark, SOLR and Kafka Performance tuning of CDH or similar platforms Translate high level design into logical and physical detailed design Build and incorporate automated unit tests and participate in integration testing efforts Work across teams to resolve operational and performance issues Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed Minimum Qualifications Required: Education: Bachelor’s degree in Computer Science or relevant field 10+ years overall IT experience in Software Development with 5+ years of experience in Big Data Analytics area. Must have delivered at least 4 big data projects to production. Experience in Hadoop distributions (Apache / Cloudera / Hortonworks) Experience working with Big Data eco-system including tools such as Hadoop, Map Reduce, Yarn, Hive, Impala, Spark, Kafka, Sqoop and Storm to name a few 1+ year of experience with techniques of performance optimization for both data loading and data retrieval 2+ years of experience with NoSQL databases such as Cassandra/HBase 3+ years of experience in development of Spark streaming applications and ETL 1+ year of experience with graph databases such as GraphDB/Neo4j Proficiency in Sqoop, Nifi, Flume and Kafka Expert level experience with software development processes and experience taking enterprise scale projects from inception to deployment Strong problem-solving skills and ability to think creatively Solid understanding and hands-on experience with Linux commands Strong unit and integration testing knowledge and habits Knowledge of source code control systems (SVN, GIT) Proven leadership skills leading project activities for programmers in an agile environment Individual track record of completing assignments on time or ahead of schedule A keen interest in a fast-paced scientific learning environment with an emphasis on applying new skills Must have excellent written and oral communication skills, a team -oriented work ethic and positive attitude Ability to quickly, effectively, and persuasively communicate inputs and ideas within collaborative sessions, presentations and in written or verbal form to various audiences with wide ranges of technical knowledge and ability Technical Lead – 2 positions – 1 here in Pittsburgh; 1 seated in Wright Patterson AFB CTH 120K Job Summary: The Technical Lead will contribute to the design/architecture and lead the implement of complex, mission-critical, enterprise applications. The position will give technical and management direction to a moderately sized team in a fast paced environment and will have the opportunity to work in all architectural layers on a variety of programming projects. Job Responsibilities: Contribute to the Architecture/ Object Oriented Design Design and implement interactive applications according to architecture and requirements Provide technical direction to team of Software Engineers across multiple products and projects Participate in defining detailed functional requirements by observing, interacting with, and gathering feedback from all users/customers Contribute to the growth of team through professional qualities, mentoring and coaching Ability to work and manage effectively in an agile team environment Ability to quickly, effectively, and persuasively communicate inputs and ideas within collaborative sessions, presentations and in written or verbal form to various audiences with wide ranges of technical knowledge and ability Lead planning sessions and provide construction estimates Manage small technical team Qualifications and Requirements: The ideal candidate will possess a Bachelor’s degree in Computer Science or relevant field. An advanced degree is a plus with experience in the following areas: 7+ years implementing enterprise-scale, distributed, data centric applications with graphical user interfaces. Expert level experience with software development processes and experience taking enterprise scale projects from inception to deployment A minimum of 2 years of management experience 3-5 years of experience developing java applications in an agile software environment using Java, Python, AngularJS, HTML Experience managing project activities for Software Engineers Solid understanding and hands-on experience with Unix/Linux commands, MS windows and writing SQL Server queries Experience using one or more of the technologies in the Hadoop ecosystem components (HDFS, Spark, Storm, HBase, Flume, Zookeeper, Solr, Kafka, Sqoop) Preferred Knowledge, Skills, & Abilities: Management of software development projects Excellent problem-solving/troubleshooting skills and ability to think creatively Strong Object Orient Design and Programming Familiarity with UI technologies and MVC Framework Strong supporter of unit and integration testing Knowledgeable of graph databases a plus Customer and quality focused Knowledge of source code control systems (SVN, etc.) Individual track record of completing assignments on time or ahead of schedule Excellent written and oral communication skills A team oriented attitude and strong work ethic