Back to jobs

Senior Data Engineer

BrooksourceNew York, NY, USPosted 3w ago
Senior Data Engineer
Apply on company site

Job Description

Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our dynamic data team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures that support advanced analytics and business intelligence initiatives. The ideal candidate will leverage expertise in big data systems, cloud platforms, and data modeling to enable efficient data management and integration across diverse sources. This position offers an exciting opportunity to work with cutting-edge technologies in a collaborative environment dedicated to innovation and data-driven decision-making.Key Responsibilities:Design, develop, and optimize large-scale ETL pipelines utilizing tools such as Informatica, Talend, Apache Spark, and Apache HiveBuild and maintain robust data architectures on cloud platforms including AWS, Azure Data Lake, and Public Cloud environmentsCollaborate with cross-functional teams to gather requirements and translate them into scalable data solutionsDevelop and implement data models using dimensional modeling techniques for data warehousing and analytics purposesManage data integration processes involving linked data, RESTful APIs, and other external sourcesEnsure data quality, security, and compliance standards are met throughout the data lifecycleSupport the deployment of machine learning models through efficient data pipeline integrationUtilize SQL, Python, Java, Bash scripting, and Shell Scripting for automation and process enhancementContribute to agile development cycles by participating in sprint planning, reviews, and continuous improvement initiativesMaintain documentation of data workflows and architecture diagrams for transparency and knowledge sharingExperience:Proven experience as a Data Engineer or similar role with a focus on big data systems and cloud-based architecturesExtensive knowledge of AWS services such as S3, Redshift, Glue; Azure Data Lake; Hadoop ecosystem components; and other public cloud offeringsStrong proficiency in SQL databases including Microsoft SQL Server, Oracle, and cloud databasesHands-on experience with ETL/ELT development using tools like Informatica or TalendDemonstrated expertise in data modeling techniques including dimensional modeling for enterprise data warehousesSkilled in programming languages such as Python, Java, VBA, Bash scripting for automation tasksFamiliarity with business intelligence tools like Looker or similar platforms for reporting and analysisUnderstanding of RESTful API integration for linked data accessKnowledge of analysis skills related to database design, query management, model training, and analytics methodologiesExperience working within Agile methodologies to deliver iterative value in fast-paced environmentsIf you are passionate about harnessing the power of big data through innovative engineering solutions and thrive in a collaborative setting focused on continuous improvement, we encourage you to apply today. Join us in shaping the future of data-driven insights across our organization.Pay: $65.00 - $85.00 per hourWork Location: Remote