Job Details:
Azure DataBricks Data Engineer
Job Summary/Description :
Design, build, and scale data pipelines across a variety of source systems and streams (internal, thirdparty, as well as cloudbased), distributed / elastic environments, and downstream applications and/or selfservice solutions.
Develop solutions combining data blending, profiling, mining, and machine learning, to better define and curate models, test hypothesis, and deliver key insights.
Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
Partner with business analysts, application engineers, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.
Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
Qualifications:
- 2 years of progressive data application development experience progressive data application development experience.
- Experience in Source/Target: Azure SQL, Azure SQL.
- Orchestration Using Databricks Jupyter Notebooks preferred.
- Experience working in SQL
- 2+ years of experience modeling and implementing
- Experience with streaming e.g. Kafka, Stream, PubSub.
- Junior level Data Modeling experience.
- Please forward your resume in word format to kevin@libertyjobs.com
#associate
#mid-senior
#IT
#libertyjobs