This site uses cookies. To find out more, see our Cookies Policy

Lead Big Data Engineer in Costa Mesa at Vaco

Date Posted: 9/12/2018

Job Snapshot

Job Description

Big Data Engineer Lead/Senior (2 openings):

* Work in a collaborative manner with our scaled agile (SAFe) teams to rapidly deliver solutions

* Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services

* Integrate new data sources and tools

* Implement scalable and reliable distributed data replication strategies

* Leverage Amazon Web Services to provide innovative solutions

* Convert business requirements to working prototypes and then deployable solutions

* Design and implement high-performance, scalable data solutions

* Provide best in class security in everything you do

* Automate everything

Knowledge, Experience & Qualifications:

* BS degree in computer science, computer engineering or equivalent

* 5-10 years of hands-on programming using, Java and Scala

* 3 years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, Cassandra, HBase, Hive, Flume, Sqoop, Spark, Kafka.

* 3 years of experience in Cloud technologies - AWS, BOTO, S3 and Security protocols

5+ year experience delivering enterprise software solutions.

Familiarity with scripting languages

* Familiarity with AWS scripting and automation

* Must be able to quickly understand technical and business requirements and can translate them into technical implementations

* Experience with Agile Development methodologies

* Experience with data ingestion and transformation

* Solid understanding of secure application development methodologies

Pluses:

* Experience in streaming data processing platform such as Kafka, etc.

* Experience with other NoSQL technologies such as HBase, mongoDB, Cassandra, etc.

* Experience with data collection using public API's

* Experience in developing real