Senior Core Data Engineer

Position: Senior Core Data Engineer

Location: SFO, CA

Duration: 12 Months

Ideal candidate:

Solid Java programmer who has production-level hands-on experience on Hadoop MapReduce and HBase or Cassandra database.

Examples of previous project experience we are looking for

* ingested large amount of raw data (web logs, web pages, data feeds, ... )

* run Hadoop map reduce jobs to parse them and process them. (simple reporting, machine learning, ...)

* loaded the outcome to NoSQL database (HBase / Cassandra) and served them to other applications (live website traffic, other internal tools, ... )

Technologies that are a must

* Programming language -- Java

* Batch processing -- Hadoop MapReduce

* Stream processing -- Apache Storm

* NoSQL -- HBase, Cassandra

* Restful web services -- Spring boot, Jackson

* Code/Build/Deployment -- git, maven, jenkins

Technologies that would get our attention….

*Programming lang: Python, Scala, Shell scripting

*Batch Processing: Cascading/Scalding, Apache Spark

* Stream processing -- AKKA, Samza, Spark streaming

* NoSQL -- MongoDB, Riak, ...

* Restful web services -- DropWizard, Jersey, , GSON

* Code/Build/Deployment -- hg, svn, sbt, bamboo, ...

All your information will be kept confidential according to EEO guidelines.