YonkersRecruiter Since 2001
the smart solution for Yonkers jobs

Data Engineer

Company: Clarity Technology Partners
Location: Yonkers
Posted on: November 22, 2021

Job Description:

CTP is partnering with a client hiring a Data Engineer to join the Data Engineering & Intelligence team to design, develop, deploy, and maintain a data lake along with a data management system with sophisticated data pipelines, data reports and data visualizations. Responsibilities:Design, build, operationalize, and maintain the data platform and data management applications. Develop and document data architecture artifacts - data dictionaries, data flows, data models (Conceptual / Logical / Physical) etc. Good judgment will be required to balance various factors (ACID, CAP, etc.) in database designDevelop data pipelines needed to integrate variety of internal and external data sources through efficient ETLsWork with other software engineers, database developers, infrastructure, operations, QA and other cross functional teams to design and implement data solutions.Support, troubleshoot, monitor and optimize existing data engineering systems.Help streamline software development by contributing to the implementation of a continuous integration process, automating manual processes, and eliminating defects.Requirements:You have a Bachelor's in CS or IT along with 2+ years of work experience in backend development, with a focus on Data Engineering in cloud.You have 3 years of experience with Python and (Py)Spark in an agile environment using CI/CD (Terraform, Codebuild, Codepipeline)You have 3 years of experience with exploratory data analysis (EDA), data profiling and data reporting using Advanced SQL, Python (using libraries like Pandas , Numpy etc) and Unix Shell ScriptingYou are skilled in building large scale data warehouses and data lakes, Data Modeling (Relational, Dimensional etc), developing ETL & ELT processes and complex data migration strategiesYou have experience working with Cloud Technologies (AWS) - Specifically services used in Big Data ecosystem (AWS Glue, Step Function, Lambdas, S3 , EC2 etc) Desirable Skill:Exposure to Tableau or data visualization toolsPlease reach out at chantal@ to learn more!by Jobble

Keywords: Clarity Technology Partners, Yonkers , Data Engineer, Engineering , Yonkers, New York

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest New York jobs by following @recnetNY on Twitter!

Yonkers RSS job feeds