Aws Databricks Data Engineer Lead

Details of the offer

job summary:
Overview

Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise As a Data Engineer you will play a key role in growing and transforming analytics landscape

Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks

Requirements

strong python skills

AWSCloud infrastructure knowledge commonly used AWS Glue S3 IAM Airflow

Experience with building data pipelines using Databricks on AWS

Knowledge and Handson Snowflake

Experience in Agile methodologies and Atlassian tools like JIRA

Expertise in using version control tools like Git Bitbucket

Experience on CICD using Kubernetes GIT and Monitoring and ing tools

Experience on data migration from OnPrem databases to AWS Cloud on S3

Roles resposibilities

Acts as a single point of contact for databricks projects for customer

Provides innovative and costeffective solution using AWS databricks python

Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit

As a leader in the Cloud Engineering you will be responsible for the overseeing development

Learnadapt quickly to new Technologies as per the business need

Develop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availability

Understand where to obtain information needed to make the appropriate decisions

Demonstrate ability to break down a problem to manageable pieces and implement effective timely solutions

Identify the problem versus the symptoms

Develop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit

Skills

The Candidate must have 3-5 yrs of experience in Databricks AWS Python

Hands on experience on AWS Cloud platform especially S3 Glue Lamda

Experience on spark scripting

Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform

Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses

strong experience with relational databases and data access methods especially SQL

Knowledge of Amazon AWS architecture and design

Minimum Qualifications

Bachelors degree or equivalent training with data tools techniques and manipulation

Four years of data engineering or equivalent experience

Skills

Databricks-SparkSQL-Scala/Python/Java

location: Hartford, Connecticut
job type: Contract
salary: $50.55 - 55.55 per hour
work hours: 8am to 4pm
education: Bachelors

responsibilities:
Overview

Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise As a Data Engineer you will play a key role in growing and transforming analytics landscape

Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks

Requirements

strong python skills

AWSCloud infrastructure knowledge commonly used AWS Glue S3 IAM Airflow

Experience with building data pipelines using Databricks on AWS

Knowledge and Handson Snowflake

Experience in Agile methodologies and Atlassian tools like JIRA

Expertise in using version control tools like Git Bitbucket

Experience on CICD using Kubernetes GIT and Monitoring and ing tools

Experience on data migration from OnPrem databases to AWS Cloud on S3

Roles resposibilities

Acts as a single point of contact for databricks projects for customer

Provides innovative and costeffective solution using AWS databricks python

Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit

As a leader in the Cloud Engineering you will be responsible for the overseeing development

Learnadapt quickly to new Technologies as per the business need

Develop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availability

Understand where to obtain information needed to make the appropriate decisions

Demonstrate ability to break down a problem to manageable pieces and implement effective timely solutions

Identify the problem versus the symptoms

Develop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit

Skills

The Candidate must have 3-5 yrs of experience in Databricks AWS Python

Hands on experience on AWS Cloud platform especially S3 Glue Lamda

Experience on spark scripting

Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform

Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses

strong experience with relational databases and data access methods especially SQL

Knowledge of Amazon AWS architecture and design

Minimum Qualifications

Bachelors degree or equivalent training with data tools techniques and manipulation

Four years of data engineering or equivalent experience

Skills

Databricks-SparkSQL-Scala/Python/Java

qualifications:
Experience level: ExperiencedEducation: Bachelors
skills: Data Analysis

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants.
If you require a reasonable accommodation to make your application or interview experience a great one, please contact ******.

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc.
In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).


This posting is open for thirty (30) days.


Nominal Salary: To be agreed

Requirements

Ct Tech - Travel - - Excellent Benefits 2024-11-02

AlliedTravelCareers is working with Aya Healthcare to find a qualified CT Tech in Stamford, Connecticut, 06901! About The Position Aya Healthcare has an imme...


Alliedtravelcareers - Connecticut

Published 12 days ago

Roofing & Gutter Field Technician

Join Our Trusted Team at Gutter Ethics LLC as a Roofing & Gutter Field Technician! Job Title: Roofing & Gutter Field Technician Company Name: Gutter Ethi...


The Contractor Consultants - Connecticut

Published 12 days ago

Snow Itsm Catalog Developer

Job Description: SNOW ITSM Catalog Developer Hybrid - 3 days onsite, Hartford, CT What are the top skills required for this role? ServiceNow ITSM catalog dev...


Diverse Lynx - Connecticut

Published 11 days ago

Associate Direct Support Manager

Hourly Rate: $19.46 Per Hour   If making a positive impact in the lives of others is always on your to-do list — you'll LOVE working with a team that puts pe...


Mosaic - Connecticut

Published 11 days ago

Built at: 2024-11-14T07:31:10.147Z