

Job Information
The Prudential Insurance Company of America Director, Data Engineer in Newark, New Jersey
Director, Data Engineer (The Prudential Insurance Company of America, Newark, NJ): Build the design and development of highly scalable and efficient data architectures that align with business requirements and support analytical use-cases. Provide technical guidance to the data engineering team, offering guidance on best practices, coding standards, and architectural designs. Design and implement robust ETL/ELT pipelines, leveraging AWS Cloud, Big Data technologies (Spark & Python), and Snowflake for seamless data ingestion, transformation, and loading from diverse sources. Develop AWS data services, including S3, Glue, Redshift, EMR, Kinesis, Lambda, and showcase strong knowledge in Snowflake services such as external stage, security, assisted engineering, and the Snowflake marketplace. Create automations and CI/CD pipelines using tools like BitBucket, Jenkins, and Cloud Formation to streamline development and deployment processes. Optimize data storage, query performance, and costs on AWS and Snowflake resources to enhance operational efficiency. Ensure the implementation of data security best practices, encryption measures, and access controls to meet industry standards and regulations. Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and deliver actionable insights. Maintain comprehensive documentation of data engineering processes, data models, and infrastructure configurations to ensure transparency and ease of knowledge transfer.Telecommuting permitted up to 40% per week. Full time employment, Monday - Friday, 40 hours per week.MINIMUM REQUIREMENTS:Bachelor’s degree in Computer Science, Data Science, Information Systems, Electronic Engineering, or a related field and 8 years of progressive, post-baccalaureate work experience. Of the required experience, must have at least 6 years of experience in all of the following:-Extract-Transform-Load Experience-Python-SQLOf the required experience, must have at least 5 years of experience in all of the following: -Spark, Hadoop, Hive, and Pyspark-Database - Oracle, MySQL, Snowflake, or RedshiftOf the required experience, must have at least 4 years of experience in all of the following: -Version Control Tool - BitBucket or GithubOf the required experience, must have at least 3 years of experience in all of the following: -CI/CD Pipelines - Jenkins or flyway pipelines-Datawarehouse and Datalake design-AWS Services : S3, Glue, Lambda, IAM and DynamoDb-Job Orchestration - Jenkins, Step Function or AirflowCertification: Must have or be willing to obtain AWS, Snowflake, AND Data certifications in the next 12 months. Telecommuting: Telecommuting permitted up to 40% per week. To Apply: Apply online at "https://bit.ly/4l6mVaM". Should you have any difficulty in applying for this position through our website, please contact Ramona.wallace@prudential.com for assistance in the application process.