Job Details:
Java Hadoop Developer
Java a must
Hadoop a must
Please consider joining our technology team as a Big Data Developer. We’re looking for strong application developers with Big Data experience who will help design, build and maintain our automated data workflows/pipelines.
RESPONSIBILITIES
• Design, build and maintain Big Data workflows/pipelines to process billions of records into and out of our data lake
• Fine tune application performance
• Troubleshoot and resolve data processing issues
• Engage in application design and data modeling discussions
• Participate in developing and enforcing data security policies
• Participate in capacity monitoring and planning
• Build, maintain and execute unit test cases with high code coverage
QUALIFICATIONS
• BS/BA degree in Computer Science, Information Systems or related field
• 5 years programming in Java, Python or GO
• 2 years developing on Hadoop/Spark or AWS EMR
• 2 years developing on an RDBMS such as Microsoft SQL Server, PostgreSQL, MySQL or Oracle
• Experience with large data sets – regularly transforming and querying tables or sets of greater than 20 million records
• Exposure to data hygiene routines and models
• Experience in database design, development and data modeling
• Ability to identify problems, and effectively communicate solutions to team
• Ability to work in a dynamic multi-team environment as well as independently
ADDED VALUABLE SKILLS
• Hadoop: HDFS, MapReduce, Hive, Pig
• Exposure to AWS services such as EMR, Glue, Lambda, Step Functions, Aurora, DynamoDB
• Data architecture
• Database security
• ETL using SQL or a scripting/programming language
• Experience with fuzzy-logic matching and tools
• NoSQL: HBase, AWS DynamoDB, Cassandra, MongoDB
• Familiarity with Linux
DevOps Environment Experience
Kevin McCarthy
Liberty Personnel Services, Inc.
410 Feheley Drive | King of Prussia, PA 19406
Direct Line: 484.238.1949
kevin@libertyjobs.com www.libertyjobs.com
http://www.linkedin.com/pub/kevin-mccarthy/0/521/133